Meta: Llama 3.1 8B Instruct
meta-llama/llama-3.1-8b-instruct
Cheapest provider
$0.02 / 1M
DeepInfra
Fastest provider (p95)
1000 tok/s
Cerebras
Intelligence (estimated)
54.5
Family + generation + popularity + price tier
Per-provider performance
Latency / throughput / uptime measured across providers over the last 30 minutes of live traffic. Atlas’s router weighs these per call (with the eval-gate signal) when picking a variant for Standard and Batch tiers.
| Provider | Quant | Input $/1M | Output $/1M | Latency p50 / p95 | Throughput p50 / p95 | Uptime 30m | Success |
|---|---|---|---|---|---|---|---|
| DeepInfra | full· bf16 | $0.0200 | $0.0500 | 255ms / 894ms | 33 / 56 tok/s | 99.95% | 89.2% |
| Novita | q8· fp8 | $0.0200 | $0.0500 | 396ms / 1055ms | 36 / 60 tok/s | 96.16% | 86.2% |
| Groq | undisclosed | $0.0500 | $0.0800 | 213ms / 616ms | 203 / 448.4 tok/s | 100.00% | 83.4% |
| Cerebras | full· fp16 | $0.1000 | $0.1000 | 145ms / 356ms | 312 / 1000 tok/s | 100.00% | 82.9% |
| Friendli | undisclosed | $0.1000 | $0.1000 | 282ms / 295ms | 97 / 175.3 tok/s | — | 0.0% |
| Cloudflare | q8· fp8 | $0.1520 | $0.2870 | 596ms / 2868ms | 16 / 22 tok/s | 100.00% | 94.9% |
| WandB | full· bf16 | $0.2200 | $0.2200 | 138ms / 195ms | 133 / 202.4 tok/s | 100.00% | 94.6% |
“—” means live telemetry hasn’t accumulated enough recent traffic for that endpoint. “undisclosed” means the provider serves the model but doesn’t expose the quantization label (typically running fp8 / int8 internally).
Intelligence estimate
No public benchmark numbers indexed for this model yet, so the leaderboard score is derived from the catalogue data we sync: model family standing, generation, and live usage rank — applied identically to open- and closed-weight models. The heuristic ceiling sits below confirmed-benchmark frontier models so curated rankings stay clearly on top.
- ·meta llama sm family base
- ·v3.1 generation +1
Want a curated score? File a benchmark report and we’ll add it to the next sync.
How Atlas routes Meta: Llama 3.1 8B Instruct
- Realtime tier — direct passthrough at the upstream’s native precision. Best for hard latency / quality guarantees.
- Standard tier — Atlas picks the cheapest provider variant whose quantization has stayed green on your operation’s eval gates. For Meta: Llama 3.1 8B Instruct that’s currently DeepInfra at $0.02/1M.
- Batch tier — async, biggest discount. Roadmapped to use provider batch APIs (OpenAI / Anthropic) where available and queued spot capacity for open-weight workloads.