Skip to content
GPUZone

A100 SXM 40GB vs RTX 4090

The cheapest RTX 4090 ($0.16) costs 48% less per hour than the cheapest A100 SXM 40GB ($0.31).

Per unit of performance, the RTX 4090 is 26% cheaper: $0.25 versus $0.34 per A100-equivalent hour.

The A100 SXM 40GB has 40 GB of memory against 24 GB on the RTX 4090.

MeasureNVIDIA A100 40GB SXM4NVIDIA GeForce RTX 4090
Lowest per GPU-hour$0.31$0.16
Median per GPU-hour$1.00$0.58
On-demand from$0.38$0.19
Spot from$0.58$0.16
Reserved from$0.31$0.18
Lowest per A100-equivalent hour$0.34$0.25
Live offers148427
Providers4291
Memory40 GB HBM224 GB GDDR6X
Memory bandwidth1,555 GB/s1,008 GB/s
FP16 / BF16312 TFLOPS165.2 TFLOPS
FP8—330.3 TFLOPS
Performance vs A100 80GB0.9×0.63×
ArchitectureAmpereAda Lovelace
Power400 W450 W

Where the offers sit

NVIDIA A100 40GB SXM4

NVIDIA GeForce RTX 4090