87.4%
MMLU
Models / DeepSeek
DeepSeek R1 · Released 2025-01-20
DeepSeek's January 2025 reasoning model. Open weights, chain-of-thought style. MATH 79.8%, strong AIME scores with extended thinking.
Self-hosted reasoning route before V4 shipped. Still relevant for reproducible CoT research and local inference stacks.
71average across 7 tested families
Where DeepSeek R1 places on each public benchmark source that publishes a row. Rank counts every model with a latest row in the same test — not a universal quality score.
The three highest-scoring carded models in each capability family. Where DeepSeek R1 shows up, it's highlighted.
Benchmark rows added to the public ledger for DeepSeek R1 in the last 120 days. Older rows live in the full table below.
| Benchmark | Family | Score | Source | Days ago |
|---|---|---|---|---|
| AA-LCR | Long context | 54.67% | Artificial Analysis | 2 |
| AA output speed | Performance | 0 t/s | Artificial Analysis | 2 |
| AA time to first token | Performance | 0.00s | Artificial Analysis | 2 |
| Artificial Analysis Intelligence Index | Reasoning | 20.1% | Artificial Analysis | 2 |
| GPQA Diamond | Reasoning | 81.3% | Artificial Analysis | 2 |
| Humanity's Last Exam | Reasoning | 14.9% | Artificial Analysis | 2 |
| IFBench | Reasoning | 39.59% | Artificial Analysis | 2 |
| LiveCodeBench | Coding | 77% | Artificial Analysis | 2 |
| MMLU-Pro | Knowledge | 84.9% | Artificial Analysis | 2 |
| SciCode | Coding | 40.3% | Artificial Analysis | 2 |
| τ³-Bench Banking | Agentic | 36.55% | Artificial Analysis | 2 |
| Terminal-Bench | Agentic | 15.91% | Artificial Analysis | 2 |
| BFCL | Tool use | 72.4% | Berkeley Function Calling Leaderboard V4 | 99 |
| LiveBench | Reasoning | 64.1% | LiveBench leaderboard | 99 |
A high composite that hides a weak family is a trap. These bars surface the families where this model hasn't been publicly tested, and where it leads.
Hover or tab any dot for name, score, and input price.
Every catalog benchmark for DeepSeek R1. Scores link to the original source; gaps mean no public row exists yet.
17 of 32 catalog benchmarks have a sourced row for DeepSeek R1.
20.1%
AA Intelligence Index v4.1
81.3%
GPQA Diamond (AA run)
14.9%
HLE (AA run)
39.59%
IFBench (AA run)
64.1%
LiveBench
77%
LiveCodeBench (AA run)
40.3%
SciCode (AA run)
15.91%
Terminal-Bench Hard (AA run)
36.55%
τ²-Bench Banking (AA run; maps to τ³ explainer)
54.67%
AA-LCR (AA run)
72.4%
BFCL
0 t/s
Median output tokens/s (1k prompt, default provider)
0.00s
Median time to first token (1k prompt, default provider)