OLMo-2-1124-13B-Instruct: GPU memory and hosting cost
Open weights · 13.72 billion parameters · 4,096-token context · licence apache-2.0
No cloud sells this model per token: to use it you run it yourself, on GPU instances you rent.
Run it yourself
It needs 34.3 GB of GPU memory at bf16, the precision it ships in.
| Cloud | Cheapest instance that fits | GPUs | An hour | A month, around the clock |
|---|---|---|---|---|
| AWS | g6e.xlarge | 1 × L40S 48 GB | $1.86 | $1,359 |
| Alibaba Cloud | ecs.gn8is.2xlarge | 1 × L20 48 GB | $2.26 | $1,648 |
| Azure | Standard_NC72ds_xl_RTXPRO6000BSE_v6 | 1 × RTX PRO 6000 48 GB | $2.83 | $2,066 |
| Google Cloud | a2-highgpu-1g | 1 × A100 40 GB | $3.67 | $2,682 |
More from Ai2
Similar size, open weights
List prices collected 5 October 2026, refreshed every three hours. No negotiated rates or taxes.