Skip to content
GPUZone

INFERENTIA 2 vs RTX 5090

MeasureAWS Inferentia2NVIDIA GeForce RTX 5090
Lowest per GPU-hour—$0.22
Median per GPU-hour—$0.87
On-demand from—$0.34
Spot from—$0.25
Reserved from—$0.22
Lowest per A100-equivalent hour—$0.24
Live offers0405
Providers084
Memory32 GB HBM2e32 GB GDDR7
Memory bandwidth820 GB/s1,792 GB/s
FP16 / BF16190 TFLOPS209.5 TFLOPS
FP8190 TFLOPS419 TFLOPS
Performance vs A100 80GB0.52×0.92×
ArchitectureInferentia2 (NeuronCore v2)Blackwell
Power—575 W

Where the offers sit

AWS Inferentia2

No live offers right now.

NVIDIA GeForce RTX 5090