Skip to content
GPUZone

INFERENTIA 1 vs L40S

The L40S has 48 GB of memory against 8 GB on the INFERENTIA 1.

MeasureINFERENTIA 1NVIDIA L40S 48GB
Lowest per GPU-hour—$0.38
Median per GPU-hour—$1.30
On-demand from—$0.38
Spot from—$0.45
Reserved from—$0.49
Lowest per A100-equivalent hour—$0.40
Live offers0284
Providers085
Memory8 GB DDR448 GB GDDR6
Memory bandwidth—864 GB/s
FP16 / BF1664 TFLOPS362 TFLOPS
FP8—733 TFLOPS
Performance vs A100 80GB0.14×0.96×
ArchitectureInferentia (NeuronCore v1)Ada Lovelace
Power—350 W

Where the offers sit

INFERENTIA 1

No live offers right now.

NVIDIA L40S 48GB