OpenAI: GPT-4o
openai/gpt-4o
Cheapest provider
$2.50 / 1M
Azure
Fastest provider (p95)
162 tok/s
Azure
Intelligence (composite)
74.5
MMLU-Pro · HumanEval · math · GPQA
Per-provider performance
Latency / throughput / uptime / price measured across providers over the last 30 minutes of live traffic. This is what proves “sourced cheapest” — Atlas mode draws on these per call to serve the cheapest path that holds quality.
| Provider | Quant | Input $/1M | Output $/1M | Latency p50 / p95 | Throughput p50 / p95 | Uptime 30m | Success |
|---|---|---|---|---|---|---|---|
| Azure | full· unknown | $2.5000 | $10.0000 | 955ms / 2769ms | 57 / 162 tok/s | 99.77% | 99.8% |
| OpenAI | full· unknown | $2.5000 | $10.0000 | 538ms / 1822ms | 59 / 141 tok/s | 99.91% | 99.9% |
“—” means live telemetry hasn’t accumulated enough recent traffic for that endpoint. “undisclosed” means the provider serves the model but doesn’t expose the quantization label (typically running fp8 / int8 internally).
Intelligence breakdown
Composite score is a weighted average of public benchmarks (30% MMLU-Pro, 25% code pass@1, 25% math, 20% GPQA). Numbers come from model cards and the Artificial Analysis intelligence harness; missing components are renormalised over what’s present.
MMLU-Pro
73.6
broad reasoning
Code
90.2
pass@1 (HumanEval / LiveCodeBench)
MATH
76.2
math accuracy
GPQA Diamond
53.9
hard reasoning
Source: OpenAI GPT-4o System Card (Aug 2024)
How Atlas mode sources OpenAI: GPT-4o
- Strict mode — pin OpenAI: GPT-4o exactly and we pass it straight through, sourced from the cheapest provider above. The same model, no substitutions — currently Azure at $2.50/1M.
- Atlas mode — the default. Each call is auto-optimized for the cheapest path that holds quality, at least 5% off going direct from call one and climbing as it ramps. You always see which model served the call and exactly what you saved — thumbs-down anything you don’t like for a full refund.