Skip to content
GPUZone

RTX 4090 vs TRAINIUM 2

The cheapest RTX 4090 ($0.16) costs 98% less per hour than the cheapest TRAINIUM 2 ($7.49).

Per unit of performance, the RTX 4090 is 93% cheaper: $0.25 versus $3.38 per A100-equivalent hour.

The TRAINIUM 2 has 96 GB of memory against 24 GB on the RTX 4090.

MeasureNVIDIA GeForce RTX 4090AWS Trainium2
Lowest per GPU-hour$0.16$7.49
Median per GPU-hour$0.58$7.49
On-demand from$0.19—
Spot from$0.16$7.49
Reserved from$0.18—
Lowest per A100-equivalent hour$0.25$3.38
Live offers4271
Providers911
Memory24 GB GDDR6X96 GB HBM3
Memory bandwidth1,008 GB/s2,900 GB/s
FP16 / BF16165.2 TFLOPS667 TFLOPS
FP8330.3 TFLOPS1,299 TFLOPS
Performance vs A100 80GB0.63×2.22×
ArchitectureAda LovelaceTrainium2 (NeuronCore v3)
Power450 W500 W

Where the offers sit

NVIDIA GeForce RTX 4090

AWS Trainium2