Skip to content
GPUZone

INFERENTIA 1 vs TRAINIUM 2

The TRAINIUM 2 has 96 GB of memory against 8 GB on the INFERENTIA 1.

MeasureINFERENTIA 1AWS Trainium2
Lowest per GPU-hour—$7.49
Median per GPU-hour—$7.49
On-demand from——
Spot from—$7.49
Reserved from——
Lowest per A100-equivalent hour—$3.38
Live offers01
Providers01
Memory8 GB DDR496 GB HBM3
Memory bandwidth—2,900 GB/s
FP16 / BF1664 TFLOPS667 TFLOPS
FP8—1,299 TFLOPS
Performance vs A100 80GB0.14×2.22×
ArchitectureInferentia (NeuronCore v1)Trainium2 (NeuronCore v3)
Power—500 W

Where the offers sit

INFERENTIA 1

No live offers right now.

AWS Trainium2