Skip to content
GPUZone

H100 SXM 80GB vs RTX 4060

The cheapest RTX 4060 ($0.03) costs 94% less per hour than the cheapest H100 SXM 80GB ($0.50).

Per unit of performance, the H100 SXM 80GB is 25% cheaper: $0.17 versus $0.22 per A100-equivalent hour.

The H100 SXM 80GB has 80 GB of memory against 8 GB on the RTX 4060.

MeasureNVIDIA H100 80GB SXM5NVIDIA GeForce RTX 4060
Lowest per GPU-hour$0.50$0.03
Median per GPU-hour$3.51$0.13
On-demand from$0.58$0.03
Spot from$0.50$0.054
Reserved from$1.41$0.25
Lowest per A100-equivalent hour$0.17$0.22
Live offers31724
Providers8312
Memory80 GB HBM38 GB GDDR6
Memory bandwidth3,350 GB/s272 GB/s
FP16 / BF16989 TFLOPS30.2 TFLOPS
FP81,979 TFLOPS60.4 TFLOPS
Performance vs A100 80GB3×0.14×
ArchitectureHopperAda Lovelace
Power700 W115 W

Where the offers sit

NVIDIA H100 80GB SXM5

NVIDIA GeForce RTX 4060