LLM Opex

Models

TII models: prices and the hardware each needs

7 models, 0 sold per token by 0 vendors. Vendors are in alphabetical order; the price is the cheapest list price among them, per million tokens.

ModelSizeSold per token byFrom, inputOutputGPU memory
falcon-7b7.22 Bnot sold per token18.1 GB
falcon-7b-instruct7.22 Bnot sold per token18.1 GB
Falcon-H1-0.5B-Base0.52 Bnot sold per token1.3 GB
Falcon-H1-3B-Instruct3.15 Bnot sold per token7.9 GB
Falcon-H1-7B-Instruct7.59 Bnot sold per token19 GB
falcon-mamba-7b7.27 Bnot sold per token18.2 GB
falcon-mamba-7b-instruct7.27 Bnot sold per token18.2 GB