AMD Instinct MI300X 192GB vs NVIDIA A100 80GB PCIe
Instinct MI300X 192GB has 140% more memory than A100 80GB PCIe (192 GB vs 80 GB). Its memory bandwidth is 174% more (5.3 vs 1.935 TB/s). In the cloud, the median on-demand Instinct MI300X 192GB price is $2.99 per GPU-hour against $4.78 for the A100 80GB PCIe. Per gigabyte of GPU memory, that is $0.016 vs $0.060 per hour.
Specifications
Manufacturer figures as recorded by Kovara. Higher memory and bandwidth are highlighted; neither is a benchmark of your workload.
| Instinct MI300X 192GB | A100 80GB PCIe | |
|---|---|---|
| Manufacturer | AMD | NVIDIA |
| Architecture | CDNA 3 | Ampere |
| Memory | 192 GB HBM3 | 80 GB HBM2E |
| Memory bandwidth | 5.3 TB/s | 1.935 TB/s |
| Power (TDP) | 750 W | 300 W |
| Form factor | OAM Module | PCIe dual-slot |
Cloud prices today
Public offers Kovara tracks, normalised to US dollars per GPU-hour. Prices use on-demand terms where available; spot and reserved offers are on each GPU’s price pages. Lower is highlighted.
| Instinct MI300X 192GB | A100 80GB PCIe | |
|---|---|---|
| Lowest price | $2.59 | $1.59 |
| Median price | $2.99 | $4.78 |
| Highest price | $3.45 | $7.35 |
| Median per GB of memory | $0.016 | $0.060 |
| Public offers (all terms) | 8 | 83 |
| Providers | 3 | 5 |
Where to rent each
Lowest tracked price per provider. Open a provider to see every offer, region and term.
Questions
Which is cheaper to rent, the Instinct MI300X 192GB or the A100 80GB PCIe?
Right now the cheapest on-demand Instinct MI300X 192GB Kovara tracks is $2.59 per GPU-hour and the cheapest A100 80GB PCIe is $1.59. Medians are $2.99 and $4.78. The cheaper GPU per hour is not always cheaper per job: a faster or larger GPU can finish sooner or need fewer units.
Which has more memory?
The Instinct MI300X 192GB has more memory: 192 GB against 80 GB. Memory decides which models and batch sizes fit on one GPU.
Are these benchmark results?
No. This page compares manufacturer specifications and public prices. Real performance depends on the model, precision, software and interconnect. Kova can help you estimate cost for a specific workload.