Kimi-K2-Thinking-NVFP4: GPU memory and hosting cost
Open weights · 1026.41 billion parameters · Mixture of experts · 262,144-token context · licence other
No cloud sells this model per token: to use it you run it yourself, on GPU instances you rent.
Run it yourself
It needs 641.5 GB of GPU memory at int4, the precision it ships in.
| Cloud | Cheapest instance that fits | GPUs | An hour | A month, around the clock |
|---|---|---|---|---|
| Alibaba Cloud | ecs.gn8v-8x.16xlarge | 8 × GPU H 96 GB | $58.49 | $42,698 |
| AWS | p5en.48xlarge | 8 × H200 141 GB | $63.30 | $46,206 |
| Azure | Standard_ND96isr_MI300X_v5 | 8 × MI300X 192 GB | $68.64 | $50,107 |
| Google Cloud | a3-ultragpu-8g | 8 × H200 141 GB | $84.81 | $61,909 |
More from NVIDIA
- Qwen3.6-35B-A3B-NVFP4
- NVIDIA-Nemotron-3-Nano-4B-BF16
- Gemma-4-31B-IT-NVFP4
- Qwen2.5-VL-7B-Instruct-NVFP4
- NVIDIA-Nemotron-3-Super-120B-A12B-BF16
- Qwen3.5-122B-A10B-NVFP4
Similar size, open weights
List prices collected 5 October 2026, refreshed every three hours. No negotiated rates or taxes.