Skip to content
GPUZone

H100 SXM 80GB vs RTX 4090

The cheapest RTX 4090 ($0.16) costs 68% less per hour than the cheapest H100 SXM 80GB ($0.50).

Per unit of performance, the H100 SXM 80GB is 34% cheaper: $0.17 versus $0.25 per A100-equivalent hour.

The H100 SXM 80GB has 80 GB of memory against 24 GB on the RTX 4090.

MeasureNVIDIA H100 80GB SXM5NVIDIA GeForce RTX 4090
Lowest per GPU-hour$0.50$0.16
Median per GPU-hour$3.51$0.58
On-demand from$0.58$0.19
Spot from$0.50$0.16
Reserved from$1.41$0.18
Lowest per A100-equivalent hour$0.17$0.25
Live offers317427
Providers8391
Memory80 GB HBM324 GB GDDR6X
Memory bandwidth3,350 GB/s1,008 GB/s
FP16 / BF16989 TFLOPS165.2 TFLOPS
FP81,979 TFLOPS330.3 TFLOPS
Performance vs A100 80GB3×0.63×
ArchitectureHopperAda Lovelace
Power700 W450 W

Where the offers sit

NVIDIA H100 80GB SXM5

NVIDIA GeForce RTX 4090