A100: price per hour on every cloud
An hour of one A100 (40 GB) costs from $2.74 on AWS. 3 clouds rent it on demand.
| Cloud | Per GPU-hour | Cheapest instance | GPUs in it | Instance, an hour | Region | Instances with it |
|---|---|---|---|---|---|---|
| AWS | $2.74 | p4d.24xlarge | 8 × 40 GB | $21.96 | us-east-1 | 2 |
| Azure | $3.40 | Standard_ND96asr_v4 | 8 × 40 GB | $27.20 | eastus | 5 |
| Google Cloud | $3.48 | a2-megagpu-16g | 16 × 40 GB | $55.74 | us-central1 | 9 |
What one of them can run
- Phi-4, which needs 36.6 GB
- Llama 3.1 8B, which needs 20.1 GB
- Mistral 7B, which needs 18.1 GB
- OpenAI gpt-oss 20B, which needs 13.1 GB
List prices collected 5 October 2026, refreshed every three hours. No negotiated rates or taxes.