Skip to content
GPUZone

INFERENTIA 2 vs RTX 4090

The INFERENTIA 2 has 32 GB of memory against 24 GB on the RTX 4090.

MeasureAWS Inferentia2NVIDIA GeForce RTX 4090
Lowest per GPU-hour—$0.16
Median per GPU-hour—$0.58
On-demand from—$0.19
Spot from—$0.16
Reserved from—$0.18
Lowest per A100-equivalent hour—$0.25
Live offers0427
Providers091
Memory32 GB HBM2e24 GB GDDR6X
Memory bandwidth820 GB/s1,008 GB/s
FP16 / BF16190 TFLOPS165.2 TFLOPS
FP8190 TFLOPS330.3 TFLOPS
Performance vs A100 80GB0.52×0.63×
ArchitectureInferentia2 (NeuronCore v2)Ada Lovelace
Power—450 W

Where the offers sit

AWS Inferentia2

No live offers right now.

NVIDIA GeForce RTX 4090