Skip to content
GPUZone

A100 SXM 80GB vs RTX 4090

The cheapest RTX 4090 ($0.16) costs 74% less per hour than the cheapest A100 SXM 80GB ($0.61).

Per unit of performance, the RTX 4090 is 59% cheaper: $0.25 versus $0.61 per A100-equivalent hour.

The A100 SXM 80GB has 80 GB of memory against 24 GB on the RTX 4090.

MeasureNVIDIA A100 80GB SXM4NVIDIA GeForce RTX 4090
Lowest per GPU-hour$0.61$0.16
Median per GPU-hour$1.71$0.58
On-demand from$0.68$0.19
Spot from$0.86$0.16
Reserved from$0.61$0.18
Lowest per A100-equivalent hour$0.61$0.25
Live offers288427
Providers6891
Memory80 GB HBM2e24 GB GDDR6X
Memory bandwidth2,039 GB/s1,008 GB/s
FP16 / BF16312 TFLOPS165.2 TFLOPS
FP8—330.3 TFLOPS
Performance vs A100 80GB1×0.63×
ArchitectureAmpereAda Lovelace
Power400 W450 W

Where the offers sit

NVIDIA A100 80GB SXM4

NVIDIA GeForce RTX 4090