GAUDI 2 vs RTX PRO 6000
The cheapest GAUDI 2 and RTX PRO 6000 cost about the same per hour.
Per unit of performance, the GAUDI 2 is 8% cheaper: $0.41 versus $0.44 per A100-equivalent hour.
| Measure | Intel Gaudi 2 96GB | NVIDIA RTX PRO 6000 Blackwell 96GB |
|---|---|---|
| Lowest per GPU-hour | $0.66 | $0.66 |
| Median per GPU-hour | $1.08 | $2.14 |
| On-demand from | $1.06 | $0.66 |
| Spot from | — | $0.81 |
| Reserved from | $0.66 | $1.03 |
| Lowest per A100-equivalent hour | $0.41 | $0.44 |
| Live offers | 16 | 517 |
| Providers | 9 | 106 |
| Memory | 96 GB HBM2e | 96 GB GDDR7 |
| Memory bandwidth | 2,450 GB/s | 1,597 GB/s |
| FP16 / BF16 | 432 TFLOPS | 503.8 TFLOPS |
| FP8 | 865 TFLOPS | 1,007.6 TFLOPS |
| Performance vs A100 80GB | 1.61× | 1.49× |
| Architecture | Gaudi 2 | Blackwell |
| Power | 600 W | 600 W |