Skip to content
GPUZone

GH200 96GB vs RTX 3090

The cheapest RTX 3090 ($0.067) costs 97% less per hour than the cheapest GH200 96GB ($2.59).

Per unit of performance, the RTX 3090 is 73% cheaper: $0.22 versus $0.80 per A100-equivalent hour.

The GH200 96GB has 96 GB of memory against 24 GB on the RTX 3090.

MeasureNVIDIA GH200 Grace Hopper 96GB HBM3NVIDIA GeForce RTX 3090
Lowest per GPU-hour$2.59$0.067
Median per GPU-hour$3.87$0.30
On-demand from$2.59$0.11
Spot from—$0.067
Reserved from—$0.12
Lowest per A100-equivalent hour$0.80$0.22
Live offers5307
Providers463
Memory96 GB HBM324 GB GDDR6X
Memory bandwidth4,000 GB/s936 GB/s
FP16 / BF16989 TFLOPS71.2 TFLOPS
FP81,979 TFLOPS—
Performance vs A100 80GB3.23×0.3×
ArchitectureHopperAmpere
Power1,000 W350 W

Where the offers sit