Sao10K: Llama 3.1 70B Hanami x1
sao10k/l3.1-70b-hanami-x1
Cheapest provider
$3.00 / 1M
Infermatic
Fastest provider (p95)
4 tok/s
Infermatic
Intelligence (estimated)
50.0
Family + generation + popularity + price tier
Per-provider performance
Latency / throughput / uptime measured across providers over the last 30 minutes of live traffic. Atlas’s router weighs these per call (with the eval-gate signal) when picking a variant for Standard and Batch tiers.
| Provider | Quant | Input $/1M | Output $/1M | Latency p50 / p95 | Throughput p50 / p95 | Uptime 30m | Success |
|---|---|---|---|---|---|---|---|
| Infermatic | full· bf16 | $3.0000 | $3.0000 | 3577ms / 6390ms | 3.5 / 4 tok/s | — | 100.0% |
“—” means live telemetry hasn’t accumulated enough recent traffic for that endpoint. “undisclosed” means the provider serves the model but doesn’t expose the quantization label (typically running fp8 / int8 internally).
Intelligence estimate
No public benchmark numbers indexed for this model yet, so the leaderboard score is derived from the catalogue data we sync: model family standing, generation, and live usage rank — applied identically to open- and closed-weight models. The heuristic ceiling sits below confirmed-benchmark frontier models so curated rankings stay clearly on top.
- ·unknown family base
Want a curated score? File a benchmark report and we’ll add it to the next sync.
How Atlas routes Sao10K: Llama 3.1 70B Hanami x1
- Realtime tier — direct passthrough at the upstream’s native precision. Best for hard latency / quality guarantees.
- Standard tier — Atlas picks the cheapest provider variant whose quantization has stayed green on your operation’s eval gates. For Sao10K: Llama 3.1 70B Hanami x1 that’s currently Infermatic at $3.00/1M.
- Batch tier — async, biggest discount. Roadmapped to use provider batch APIs (OpenAI / Anthropic) where available and queued spot capacity for open-weight workloads.