bloomz-560m: GPU memory and hosting cost
Open weights · 0.56 billion parameters · licence bigscience-bloom-rail-1.0
No cloud sells this model per token: to use it you run it yourself, on GPU instances you rent.
Run it yourself
It needs 1.4 GB of GPU memory at fp16, the precision it ships in.
| Cloud | Cheapest instance that fits | GPUs | An hour | A month, around the clock |
|---|---|---|---|---|
| Azure | Standard_NV6ads_A10_v5 | 1 × A10 4 GB | $0.454 | $331 |
| AWS | g4dn.xlarge | 1 × T4 16 GB | $0.526 | $384 |
| Google Cloud | g2-standard-4 | 1 × L4 24 GB | $0.7068 | $516 |
| Alibaba Cloud | ecs.gn6i-c4g1.xlarge | 1 × T4 16 GB | $1.12 | $816 |
More from BigScience
Similar size, open weights
- Qwen3-0.6B (Qwen)
- Qwen3-Embedding-0.6B
- Qwen2.5-0.5B-Instruct
- whisper-large-v3-turbo
- gemma-3-1b-it (google)
- Qwen3-Reranker-0.6B
List prices collected 5 October 2026, refreshed every three hours. No negotiated rates or taxes.