LLM Opex

Models

Mistral models: prices and the hardware each needs

15 models, 7 sold per token by 5 vendors. Vendors are in alphabetical order; the price is the cheapest list price among them, per million tokens.

ModelSizeSold per token byFrom, inputOutputGPU memory
Codestral 25.08closedMistral$0.30$0.90
Devstral-2-123B-Instruct-2512125.03 Bnot sold per token156.3 GB
Magistral-Small-250924.01 Bnot sold per token60 GB
Mistral 7B7 BAWS, Snowflake$0.15$0.2018.1 GB
Mistral LargeclosedAWS$0.50$1.50
Mistral Large 3675 BSnowflake$0.60$1.80
Mistral Large 4closedMistral$0.70$2.10
Mistral Small24 BAWS, Core42, DeepInfra$0.05$0.0858.9 GB
Mistral Small 4119.4 BMistral$0.15$0.60149.2 GB
Mistral-7B-Instruct-v0.17.24 Bnot sold per token18.1 GB
Mistral-7B-Instruct-v0.27.24 Bnot sold per token18.1 GB
Mistral-7B-v0.17.24 Bnot sold per token18.1 GB
Mistral-Medium-3.5-128B127.7 Bnot sold per token159.6 GB
Mistral-Nemo-Instruct-240712.25 Bnot sold per token30.6 GB
Mixtral-8x7B-Instruct-v0.146.7 Bnot sold per token116.8 GB