LLM Opex

Models

Nous Research models: prices and the hardware each needs

11 models, 1 sold per token by 1 vendor. Vendors are in alphabetical order; the price is the cheapest list price among them, per million tokens.

ModelSizeSold per token byFrom, inputOutputGPU memory
Hermes 4 405B406 BNebius$1.00$3.001014.6 GB
Hermes-2-Pro-Mistral-7B7.24 Bnot sold per token18.1 GB
Hermes-3-Llama-3.1-8B8.03 Bnot sold per token20.1 GB
Llama-3.2-1B (NousResearch)1.24 Bnot sold per token3.1 GB
Meta-Llama-3-70B-Instruct (NousResearch)70.55 Bnot sold per token176.4 GB
Meta-Llama-3-8B (NousResearch)8.03 Bnot sold per token20.1 GB
Meta-Llama-3-8B-Instruct (NousResearch)8.03 Bnot sold per token20.1 GB
Meta-Llama-3.1-8B (NousResearch)8.03 Bnot sold per token20.1 GB
Meta-Llama-3.1-8B-Instruct (NousResearch)8.03 Bnot sold per token20.1 GB
Nous-Hermes-2-Mixtral-8x7B-DPO46.7 Bnot sold per token116.8 GB
Nous-Hermes-llama-2-7b6.74 Bnot sold per token16.9 GB