gpt-neox-20b: GPU memory and hosting cost
Open weights · 20.74 billion parameters · 2,048-token context · licence apache-2.0
No cloud sells this model per token: to use it you run it yourself, on GPU instances you rent.
Run it yourself
It needs 51.8 GB of GPU memory at fp16, the precision it ships in.
| Cloud | Cheapest instance that fits | GPUs | An hour | A month, around the clock |
|---|---|---|---|---|
| Azure | Standard_NC24ads_A100_v4 | 1 × A100 80 GB | $3.67 | $2,681 |
| Google Cloud | g4-standard-48 | 1 × RTX PRO 6000 96 GB | $4.50 | $3,285 |
| Alibaba Cloud | ecs.gn9gc.4xlarge | 1 × L20N 72 GB | $6.71 | $4,898 |
| AWS | p5.4xlarge | 1 × H100 80 GB | $6.88 | $5,022 |
More from EleutherAI
Similar size, open weights
List prices collected 5 October 2026, refreshed every three hours. No negotiated rates or taxes.