Skip to content
GPUZone

INFERENTIA 2 vs TRAINIUM 2

The TRAINIUM 2 has 96 GB of memory against 32 GB on the INFERENTIA 2.

MeasureAWS Inferentia2AWS Trainium2
Lowest per GPU-hour—$7.49
Median per GPU-hour—$7.49
On-demand from——
Spot from—$7.49
Reserved from——
Lowest per A100-equivalent hour—$3.38
Live offers01
Providers01
Memory32 GB HBM2e96 GB HBM3
Memory bandwidth820 GB/s2,900 GB/s
FP16 / BF16190 TFLOPS667 TFLOPS
FP8190 TFLOPS1,299 TFLOPS
Performance vs A100 80GB0.52×2.22×
ArchitectureInferentia2 (NeuronCore v2)Trainium2 (NeuronCore v3)
Power—500 W

Where the offers sit

AWS Inferentia2

No live offers right now.

AWS Trainium2