MI350X vs RTX PRO 6000
The cheapest RTX PRO 6000 ($0.66) costs 78% less per hour than the cheapest MI350X ($3.00).
Per unit of performance, the MI350X is 4% cheaper: $0.42 versus $0.44 per A100-equivalent hour.
The MI350X has 288 GB of memory against 96 GB on the RTX PRO 6000.
| Measure | AMD Instinct MI350X 288GB | NVIDIA RTX PRO 6000 Blackwell 96GB |
|---|---|---|
| Lowest per GPU-hour | $3.00 | $0.66 |
| Median per GPU-hour | $5.49 | $2.14 |
| On-demand from | $5.49 | $0.66 |
| Spot from | $3.00 | $0.81 |
| Reserved from | $3.60 | $1.03 |
| Lowest per A100-equivalent hour | $0.42 | $0.44 |
| Live offers | 7 | 517 |
| Providers | 6 | 106 |
| Memory | 288 GB HBM3e | 96 GB GDDR7 |
| Memory bandwidth | 8,000 GB/s | 1,597 GB/s |
| FP16 / BF16 | 2,309.6 TFLOPS | 503.8 TFLOPS |
| FP8 | 4,614.4 TFLOPS | 1,007.6 TFLOPS |
| Performance vs A100 80GB | 7.07× | 1.49× |
| Architecture | CDNA 4 | Blackwell |
| Power | 1,000 W | 600 W |