granite-3.2-8b-instruct: GPU memory and hosting cost
Open weights · 8.17 billion parameters · 131,072-token context · licence apache-2.0
No cloud sells this model per token: to use it you run it yourself, on GPU instances you rent.
Run it yourself
It needs 20.4 GB of GPU memory at bf16, the precision it ships in.
| Cloud | Cheapest instance that fits | GPUs | An hour | A month, around the clock |
|---|---|---|---|---|
| Google Cloud | g2-standard-4 | 1 × L4 24 GB | $0.7068 | $516 |
| AWS | g6.xlarge | 1 × L4 24 GB | $0.8048 | $588 |
| Azure | Standard_NC36ds_xl_RTXPRO6000BSE_v6 | 1 × RTX PRO 6000 24 GB | $1.44 | $1,053 |
| Alibaba Cloud | ecs.gn7i-c8g1.2xlarge | 1 × A10 24 GB | $1.68 | $1,224 |
More from IBM
- granite-4.1-3b
- granite-4.1-30b
- granite-4.1-8b
- granite-4.2-8b
- granite-3.0-1b-a400m-instruct
- granite-3.3-8b-instruct
Similar size, open weights
List prices collected 5 October 2026, refreshed every three hours. No negotiated rates or taxes.