Skip to content
GPUZone

A40 vs H100 SXM 80GB

The cheapest A40 ($0.23) costs 54% less per hour than the cheapest H100 SXM 80GB ($0.50).

Per unit of performance, the H100 SXM 80GB is 70% cheaper: $0.17 versus $0.55 per A100-equivalent hour.

The H100 SXM 80GB has 80 GB of memory against 48 GB on the A40.

MeasureNVIDIA A40 48GBNVIDIA H100 80GB SXM5
Lowest per GPU-hour$0.23$0.50
Median per GPU-hour$0.79$3.51
On-demand from$0.30$0.58
Spot from—$0.50
Reserved from$0.23$1.41
Lowest per A100-equivalent hour$0.55$0.17
Live offers72317
Providers2983
Memory48 GB GDDR680 GB HBM3
Memory bandwidth696 GB/s3,350 GB/s
FP16 / BF16149.7 TFLOPS989 TFLOPS
FP8—1,979 TFLOPS
Performance vs A100 80GB0.42×3×
ArchitectureAmpereHopper
Power300 W700 W

Where the offers sit

NVIDIA A40 48GB

NVIDIA H100 80GB SXM5