Skip to content
GPUZone

H100 SXM 80GB vs INFERENTIA 2

The H100 SXM 80GB has 80 GB of memory against 32 GB on the INFERENTIA 2.

MeasureNVIDIA H100 80GB SXM5AWS Inferentia2
Lowest per GPU-hour$0.50—
Median per GPU-hour$3.51—
On-demand from$0.58—
Spot from$0.50—
Reserved from$1.41—
Lowest per A100-equivalent hour$0.17—
Live offers3170
Providers830
Memory80 GB HBM332 GB HBM2e
Memory bandwidth3,350 GB/s820 GB/s
FP16 / BF16989 TFLOPS190 TFLOPS
FP81,979 TFLOPS190 TFLOPS
Performance vs A100 80GB3×0.52×
ArchitectureHopperInferentia2 (NeuronCore v2)
Power700 W—

Where the offers sit

NVIDIA H100 80GB SXM5

AWS Inferentia2

No live offers right now.