gemma-2-9b: GPU memory and hosting cost
Open weights · 9.24 billion parameters · licence gemma
No cloud sells this model per token: to use it you run it yourself, on GPU instances you rent.
Run it yourself
It needs 46.2 GB of GPU memory at fp32, the precision it ships in.
| Cloud | Cheapest instance that fits | GPUs | An hour | A month, around the clock |
|---|---|---|---|---|
| AWS | g6e.xlarge | 1 × L40S 48 GB | $1.86 | $1,359 |
| Alibaba Cloud | ecs.gn8is.2xlarge | 1 × L20 48 GB | $2.26 | $1,648 |
| Azure | Standard_NC72ds_xl_RTXPRO6000BSE_v6 | 1 × RTX PRO 6000 48 GB | $2.83 | $2,066 |
| Google Cloud | g4-standard-48 | 1 × RTX PRO 6000 96 GB | $4.50 | $3,285 |
More from Google
- Gemini 2.5 Flash
- Gemini 2.5 Flash Lite
- Gemini 2.5 Pro
- gemma-4-26B-A4B-it
- gemma-4-31b-it
- gemma-3-1b-it (google)
Similar size, open weights
List prices collected 5 October 2026, refreshed every three hours. No negotiated rates or taxes.