EleutherAI models: prices and the hardware each needs
12 models, 0 sold per token by 0 vendors. Vendors are in alphabetical order; the price is the cheapest list price among them, per million tokens.
| Model | Size | Sold per token by | From, input | Output | GPU memory |
|---|---|---|---|---|---|
| gpt-neo-1.3B | 1.37 B | not sold per token | 6.9 GB | ||
| gpt-neo-2.7B | 2.72 B | not sold per token | 13.6 GB | ||
| gpt-neox-20b | 20.74 B | not sold per token | 51.8 GB | ||
| pythia-1.4b | 1.52 B | not sold per token | 3.8 GB | ||
| pythia-1.4b-deduped | 1.41 B | not sold per token | 7 GB | ||
| pythia-12b | 12 B | not sold per token | 30 GB | ||
| pythia-1b | 1.08 B | not sold per token | 2.7 GB | ||
| pythia-1b-deduped | 1.08 B | not sold per token | 2.7 GB | ||
| pythia-2.8b | 2.91 B | not sold per token | 7.3 GB | ||
| pythia-410m | 0.51 B | not sold per token | 1.3 GB | ||
| pythia-410m-deduped | 0.51 B | not sold per token | 1.3 GB | ||
| pythia-6.9b | 6.99 B | not sold per token | 17.5 GB |