Skip to content
GPUZone

GAUDI 2 vs RTX 4090

The cheapest RTX 4090 ($0.16) costs 76% less per hour than the cheapest GAUDI 2 ($0.66).

Per unit of performance, the RTX 4090 is 38% cheaper: $0.25 versus $0.41 per A100-equivalent hour.

The GAUDI 2 has 96 GB of memory against 24 GB on the RTX 4090.

MeasureIntel Gaudi 2 96GBNVIDIA GeForce RTX 4090
Lowest per GPU-hour$0.66$0.16
Median per GPU-hour$1.08$0.58
On-demand from$1.06$0.19
Spot from—$0.16
Reserved from$0.66$0.18
Lowest per A100-equivalent hour$0.41$0.25
Live offers16427
Providers991
Memory96 GB HBM2e24 GB GDDR6X
Memory bandwidth2,450 GB/s1,008 GB/s
FP16 / BF16432 TFLOPS165.2 TFLOPS
FP8865 TFLOPS330.3 TFLOPS
Performance vs A100 80GB1.61×0.63×
ArchitectureGaudi 2Ada Lovelace
Power600 W450 W

Where the offers sit