LLM Opex Every way to run an LLM, every cloud

Models

Llama-3.2-3B (meta-llama): GPU memory and hosting cost

Open weights · 3.21 billion parameters · licence llama3.2

No cloud sells this model per token: to use it you run it yourself, on GPU instances you rent.

Run it yourself

It needs 8 GB of GPU memory at bf16, the precision it ships in.

CloudCheapest instance that fitsGPUsAn hourA month, around the clock
AWSg4dn.xlarge1 × T4 16 GB$0.526$384
AzureStandard_NC4as_T4_v31 × T4 16 GB$0.526$384
Google Cloudg2-standard-41 × L4 24 GB$0.7068$516
Alibaba Cloudecs.gn6i-c4g1.xlarge1 × T4 16 GB$1.12$816

More from Meta

Similar size, open weights

List prices collected 5 October 2026, refreshed every three hours. No negotiated rates or taxes.