Kovara
Loading your page…
You can continue using the navigation while this page loads.
You can continue using the navigation while this page loads.
A100 40GB SXM has 58% less memory than RTX PRO 6000 Blackwell Server Edition (40 GB vs 96 GB). Its memory bandwidth is about the same (1.555 vs 1.597 TB/s). In the cloud, the median on-demand A100 40GB SXM price is $1.64 per GPU-hour against $2.19 for the RTX PRO 6000 Blackwell Server Edition. Per gigabyte of GPU memory, that is $0.041 vs $0.023 per hour.
Manufacturer figures as recorded by Kovara. Higher memory and bandwidth are highlighted; neither is a benchmark of your workload.
| A100 40GB SXM | RTX PRO 6000 Blackwell Server Edition | |
|---|---|---|
| Manufacturer | NVIDIA | NVIDIA |
| Architecture | Ampere | Blackwell |
| Memory | 40 GB HBM2 | 96 GB GDDR7 |
| Memory bandwidth | 1.555 TB/s | 1.597 TB/s |
| Power (TDP) | 400 W | 600 W |
| Form factor | SXM | PCIe dual-slot / single-slot liquid |
Public offers Kovara tracks, normalised to US dollars per GPU-hour. Prices use on-demand terms where available; spot and reserved offers are on each GPU’s price pages. Lower is highlighted.
| A100 40GB SXM | RTX PRO 6000 Blackwell Server Edition | |
|---|---|---|
| Lowest price | $1.15 | $1.80 |
| Median price | $1.64 | $2.19 |
| Highest price | $1.99 | $3.00 |
| Median per GB of memory | $0.041 | $0.023 |
| Public offers (all terms) | 5 | 34 |
| Providers | 3 | 9 |
Lowest tracked price per provider. Open a provider to see every offer, region and term.
Right now the cheapest on-demand A100 40GB SXM Kovara tracks is $1.15 per GPU-hour and the cheapest RTX PRO 6000 Blackwell Server Edition is $1.80. Medians are $1.64 and $2.19. The cheaper GPU per hour is not always cheaper per job: a faster or larger GPU can finish sooner or need fewer units.
The RTX PRO 6000 Blackwell Server Edition has more memory: 96 GB against 40 GB. Memory decides which models and batch sizes fit on one GPU.
No. This page compares manufacturer specifications and public prices. Real performance depends on the model, precision, software and interconnect. Kova can help you estimate cost for a specific workload.