Skip to content
GPUZone

GH200 96GB vs RTX 4090

The cheapest RTX 4090 ($0.16) costs 94% less per hour than the cheapest GH200 96GB ($2.59).

Per unit of performance, the RTX 4090 is 69% cheaper: $0.25 versus $0.80 per A100-equivalent hour.

The GH200 96GB has 96 GB of memory against 24 GB on the RTX 4090.

MeasureNVIDIA GH200 Grace Hopper 96GB HBM3NVIDIA GeForce RTX 4090
Lowest per GPU-hour$2.59$0.16
Median per GPU-hour$3.87$0.58
On-demand from$2.59$0.19
Spot from—$0.16
Reserved from—$0.18
Lowest per A100-equivalent hour$0.80$0.25
Live offers5427
Providers491
Memory96 GB HBM324 GB GDDR6X
Memory bandwidth4,000 GB/s1,008 GB/s
FP16 / BF16989 TFLOPS165.2 TFLOPS
FP81,979 TFLOPS330.3 TFLOPS
Performance vs A100 80GB3.23×0.63×
ArchitectureHopperAda Lovelace
Power1,000 W450 W

Where the offers sit