Skip to content
GPUZone

A100 SXM 40GB vs RTX 3090

The cheapest RTX 3090 ($0.067) costs 78% less per hour than the cheapest A100 SXM 40GB ($0.31).

Per unit of performance, the RTX 3090 is 35% cheaper: $0.22 versus $0.34 per A100-equivalent hour.

The A100 SXM 40GB has 40 GB of memory against 24 GB on the RTX 3090.

MeasureNVIDIA A100 40GB SXM4NVIDIA GeForce RTX 3090
Lowest per GPU-hour$0.31$0.067
Median per GPU-hour$1.00$0.30
On-demand from$0.38$0.11
Spot from$0.58$0.067
Reserved from$0.31$0.12
Lowest per A100-equivalent hour$0.34$0.22
Live offers148307
Providers4263
Memory40 GB HBM224 GB GDDR6X
Memory bandwidth1,555 GB/s936 GB/s
FP16 / BF16312 TFLOPS71.2 TFLOPS
FP8——
Performance vs A100 80GB0.9×0.3×
ArchitectureAmpereAmpere
Power400 W350 W

Where the offers sit

NVIDIA A100 40GB SXM4

NVIDIA GeForce RTX 3090