LLM Opex Every way to run an LLM, every cloud

GPU prices per hour on every cloud

The on-demand list price of an hour of one GPU, on each cloud that rents it.

GPUMemoryFrom, per GPU-hourCheapest onRented by
A10040 GB$2.74AWSAWS, Azure, Google Cloud
H10080 GB$6.88AWSAWS, Azure, Google Cloud
H200141 GB$7.91AWSAWS, Google Cloud, Azure
T416 GB$0.526AWSAWS, Azure, Alibaba Cloud
A104 GB$0.454AzureAzure, Alibaba Cloud
L424 GB$0.7068Google CloudGoogle Cloud, AWS
RTX PRO 600024 GB$1.44AzureAzure, Google Cloud
A10G24 GB$1.01AWSAWS
B200179 GB$14.24AWSAWS
B300268 GB$17.80AWSAWS
GB200192 GB$27.04AzureAzure
GPU H96 GB$7.19Alibaba CloudAlibaba Cloud
L2048 GB$2.25Alibaba CloudAlibaba Cloud
L20N72 GB$6.71Alibaba CloudAlibaba Cloud
L40S48 GB$1.86AWSAWS
MI300X192 GB$8.58AzureAzure