Skip to content
GPUZone

A100 SXM 80GB vs INFERENTIA 2

The A100 SXM 80GB has 80 GB of memory against 32 GB on the INFERENTIA 2.

MeasureNVIDIA A100 80GB SXM4AWS Inferentia2
Lowest per GPU-hour$0.61—
Median per GPU-hour$1.71—
On-demand from$0.68—
Spot from$0.86—
Reserved from$0.61—
Lowest per A100-equivalent hour$0.61—
Live offers2880
Providers680
Memory80 GB HBM2e32 GB HBM2e
Memory bandwidth2,039 GB/s820 GB/s
FP16 / BF16312 TFLOPS190 TFLOPS
FP8—190 TFLOPS
Performance vs A100 80GB1×0.52×
ArchitectureAmpereInferentia2 (NeuronCore v2)
Power400 W—

Where the offers sit

NVIDIA A100 80GB SXM4

AWS Inferentia2

No live offers right now.