Skip to content
GPUZone

A100 SXM 40GB vs H100 SXM 80GB

The cheapest A100 SXM 40GB ($0.31) costs 39% less per hour than the cheapest H100 SXM 80GB ($0.50).

Per unit of performance, the H100 SXM 80GB is 51% cheaper: $0.17 versus $0.34 per A100-equivalent hour.

The H100 SXM 80GB has 80 GB of memory against 40 GB on the A100 SXM 40GB.

MeasureNVIDIA A100 40GB SXM4NVIDIA H100 80GB SXM5
Lowest per GPU-hour$0.31$0.50
Median per GPU-hour$1.00$3.51
On-demand from$0.38$0.58
Spot from$0.58$0.50
Reserved from$0.31$1.41
Lowest per A100-equivalent hour$0.34$0.17
Live offers148317
Providers4283
Memory40 GB HBM280 GB HBM3
Memory bandwidth1,555 GB/s3,350 GB/s
FP16 / BF16312 TFLOPS989 TFLOPS
FP8—1,979 TFLOPS
Performance vs A100 80GB0.9×3×
ArchitectureAmpereHopper
Power400 W700 W

Where the offers sit

NVIDIA A100 40GB SXM4

NVIDIA H100 80GB SXM5