LLM Opex

Models

shieldgemma-9b: GPU memory and hosting cost

Open weights · 9.24 billion parameters · licence gemma

No cloud sells this model per token: to use it you run it yourself, on GPU instances you rent.

Run it yourself

It needs 23.1 GB of GPU memory at bf16, the precision it ships in.

CloudCheapest instance that fitsGPUsAn hourA month, around the clock
HF Endpointsgcp.nvidia-l4.x11 × L4 24 GB$0.70$511
Google Cloudg2-standard-41 × L4 24 GB$0.7068$516
AWSg6.xlarge1 × L4 24 GB$0.8048$588
AzureStandard_NC36ds_xl_RTXPRO6000BSE_v61 × RTX PRO 6000 24 GB$1.44$1,053
DeepInfraa100.1x1 × A100 80 GB$1.49$1,088
Crusoel40s.1x1 × L40S 48 GB$1.50$1,095
Nebiusgpu-l40s-a.1gpu-8vcpu-32gb1 × L40S 48 GB$1.55$1,130
Alibaba Cloudecs.gn7i-c8g1.2xlarge1 × A10 24 GB$1.68$1,224
OCIVM.GPU.A10.11 × A10 24 GB$2.00$1,460
Core42h100.1x1 × H100 80 GB$2.50$1,825
IBM watsonxdeploy-on-demand.1xL40S1 × L40S 48 GB$4.43$3,234
Fireworks AIh100.1x1 × H100 80 GB$8.00$5,840
Together AIhgx-h100.8gpu8 × H100 80 GB$31.92$23,302

More from Google

Similar size, open weights

List prices collected 4 November 2026, refreshed every three hours. No negotiated rates or taxes.