LLM Opex

Vendors

HF Endpoints

Hugging Face hosts the largest public library of open models. Its Inference Endpoints run a chosen model on dedicated GPUs by the hour, on AWS or Google Cloud.

HF Endpoints sells 0 of the compared models per token and prices 7 kinds of GPU for hosting your own.

GPUs for hosting your own

On demand.
GPUFrom, per GPU-hourCheapest instanceGPUs in it
T4$0.50aws.nvidia-t4.x11 × 14 GB
L4$0.70gcp.nvidia-l4.x11 × 24 GB
A10G$1.00aws.nvidia-a10g.x11 × 24 GB
L40S$1.80aws.nvidia-l40s.x11 × 48 GB
A100$2.50aws.nvidia-a100.x11 × 80 GB
H200$5.00aws.nvidia-h200.x11 × 141 GB
H100$10.00gcp.nvidia-h100.x11 × 80 GB

Where it runs

One global price; HF Endpoints chooses where a request is processed.

Where the prices come from

Sources

List prices collected 4 November 2026, refreshed every three hours. No negotiated rates or taxes.