Skip to content
GPUZone

INFERENTIA 1 vs RTX 4090

The RTX 4090 has 24 GB of memory against 8 GB on the INFERENTIA 1.

MeasureINFERENTIA 1NVIDIA GeForce RTX 4090
Lowest per GPU-hour—$0.16
Median per GPU-hour—$0.58
On-demand from—$0.19
Spot from—$0.16
Reserved from—$0.18
Lowest per A100-equivalent hour—$0.25
Live offers0427
Providers091
Memory8 GB DDR424 GB GDDR6X
Memory bandwidth—1,008 GB/s
FP16 / BF1664 TFLOPS165.2 TFLOPS
FP8—330.3 TFLOPS
Performance vs A100 80GB0.14×0.63×
ArchitectureInferentia (NeuronCore v1)Ada Lovelace
Power—450 W

Where the offers sit

INFERENTIA 1

No live offers right now.

NVIDIA GeForce RTX 4090