Skip to content
GPUZone

INFERENTIA 2 vs RTX PRO 6000

The RTX PRO 6000 has 96 GB of memory against 32 GB on the INFERENTIA 2.

MeasureAWS Inferentia2NVIDIA RTX PRO 6000 Blackwell 96GB
Lowest per GPU-hour—$0.66
Median per GPU-hour—$2.14
On-demand from—$0.66
Spot from—$0.81
Reserved from—$1.03
Lowest per A100-equivalent hour—$0.44
Live offers0517
Providers0106
Memory32 GB HBM2e96 GB GDDR7
Memory bandwidth820 GB/s1,597 GB/s
FP16 / BF16190 TFLOPS503.8 TFLOPS
FP8190 TFLOPS1,007.6 TFLOPS
Performance vs A100 80GB0.52×1.49×
ArchitectureInferentia2 (NeuronCore v2)Blackwell
Power—600 W

Where the offers sit