LLM Opex Every way to run an LLM, every cloud

Models

Qwen3.5-122B-A10B-NVFP4: GPU memory and hosting cost

Open weights · 122.56 billion parameters · Mixture of experts · 262,144-token context · licence apache-2.0

No cloud sells this model per token: to use it you run it yourself, on GPU instances you rent.

Run it yourself

It needs 76.6 GB of GPU memory at int4, the precision it ships in.

CloudCheapest instance that fitsGPUsAn hourA month, around the clock
AzureStandard_NC24ads_A100_v41 × A100 80 GB$3.67$2,681
Google Cloudg4-standard-481 × RTX PRO 6000 96 GB$4.50$3,285
AWSp5.4xlarge1 × H100 80 GB$6.88$5,022
Alibaba Cloudecs.gn8v.4xlarge1 × GPU H 96 GB$7.31$5,337

More from NVIDIA

Similar size, open weights

List prices collected 5 October 2026, refreshed every three hours. No negotiated rates or taxes.