Skip to content
GPUZone

H100 NVL 94GB vs RTX 4090

The cheapest RTX 4090 ($0.16) costs 65% less per hour than the cheapest H100 NVL 94GB ($0.46).

Per unit of performance, the H100 NVL 94GB is 37% cheaper: $0.16 versus $0.25 per A100-equivalent hour.

The H100 NVL 94GB has 94 GB of memory against 24 GB on the RTX 4090.

MeasureNVIDIA H100 NVL 94GBNVIDIA GeForce RTX 4090
Lowest per GPU-hour$0.46$0.16
Median per GPU-hour$4.77$0.58
On-demand from$0.83$0.19
Spot from$0.46$0.16
Reserved from$3.27$0.18
Lowest per A100-equivalent hour$0.16$0.25
Live offers177427
Providers2591
Memory94 GB HBM324 GB GDDR6X
Memory bandwidth3,900 GB/s1,008 GB/s
FP16 / BF16835 TFLOPS165.2 TFLOPS
FP81,671 TFLOPS330.3 TFLOPS
Performance vs A100 80GB2.88×0.63×
ArchitectureHopperAda Lovelace
Power400 W450 W

Where the offers sit

NVIDIA H100 NVL 94GB

NVIDIA GeForce RTX 4090