LLM Opex Every way to run an LLM, every cloud

GPUs

RTX PRO 6000: price per hour on every cloud

An hour of one RTX PRO 6000 (24 GB) costs from $1.44 on Azure. 2 clouds rent it on demand.

CloudPer GPU-hourCheapest instanceGPUs in itInstance, an hourRegionInstances with it
Azure$1.44Standard_NC36ds_xl_RTXPRO6000BSE_v61 × 24 GB$1.44eastus4
Google Cloud$4.50g4-standard-481 × 96 GB$4.50us-central14

What one of them can run

List prices collected 5 October 2026, refreshed every three hours. No negotiated rates or taxes.