DeepSeek, proprietary
DeepSeek-R1
DeepSeek-R1 by DeepSeek ranks 115th of 354 ranked models on the Noometry Index as of October 2026, with a score of 42.3. Its strongest category is long context, where it ranks 36th. API pricing starts at $0.50 per million input tokens and $2.15 per million output tokens, with a 164K-token context window.
Last verified
Specifications
- Noometry rank
- #115 of 354
- Index score
- 42.3
- Evidence
- Confirmed 52 results
- Provider
DeepSeek
- Released
- January 20, 2025
- Weights
- Proprietary
- Reasoning
- Yes
- Context window
- 164K
- Max output
- 64K
- Input price
- $0.50 / M
- Output price
- $2.15 / M
- Blended price
- $0.91 / M
- Output speed
- 10 tokens/s Kagi
- Value
- #101 of 219
- Knowledge cutoff
- July 2024
- Input
- text
- Hugging Face
- deepseek-ai/DeepSeek-R1
Category scores
Each category score combines every public result we have in that category.
- Coding 46.3
- Agentic & Tool Use 30.7
- Reasoning 18.6
- Math 43.8
- Knowledge 44.5
- Multilingual 52.4
- Instruction Following 72.0
- Long Context 45.4
- Writing & Preference 61.4
| Category | Score | Rank | Results |
|---|---|---|---|
| Coding | 46.3 | #68 | 5 |
| Agentic & Tool Use | 30.7 | #75 | 2 |
| Reasoning | 18.6 | #278 | 8 |
| Math | 43.8 | #79 | 5 |
| Knowledge | 44.5 | #87 | 6 |
| Multilingual | 52.4 | #85 | 1 |
| Instruction Following | 72.0 | #143 | 3 |
| Long Context | 45.4 | #36 | 2 |
| Writing & Preference | 61.4 | #88 | 7 |
Strengths and weaknesses
Categories where DeepSeek-R1 places highest and lowest among the models ranked in each, with its score against that category's median.
Strongest categories
| Category | Score | vs median | Rank |
|---|---|---|---|
| Long Context | 45.4 | +4.5 | #36 of 296, top 13% |
| Coding | 46.3 | +7.6 | #68 of 340, top 20% |
| Math | 43.8 | +7.2 | #79 of 327, top 25% |
Weakest categories
| Category | Score | vs median | Rank |
|---|---|---|---|
| Reasoning | 18.6 | −5.0 | #278 of 350, top 80% |
| Agentic & Tool Use | 30.7 | +0.3 | #75 of 154, top 49% |
| Instruction Following | 72.0 | +0.7 | #143 of 305, top 47% |
Closest competitors
The models ranked just above and below DeepSeek-R1. When scores are this close, price and speed are often the better way to choose.
| Model | Rank | Score | Blended $/M | Speed | |
|---|---|---|---|---|---|
| GPT-5.2 Codex | #111 | 42.6 | $4.81 | — | Compare |
| Qwen3.5-Flash | #112 | 42.5 | $0.18 | — | Compare |
| Nemotron 3 Ultra | #113 | 42.5 | $0.93 | — | Compare |
| Hunyuan T1 20250711 | #114 | 42.5 | — | — | Compare |
| Step 3.5 Flash | #116 | 42.3 | $0.15 | — | Compare |
| Qwen3.6 27B | #117 | 42.2 | $1.35 | — | Compare |
| Amazon Nova Experimental Chat 10 20 | #118 | 42.1 | — | — | Compare |
| Qwen3.5 122B-A10B | #119 | 42.1 | $1.10 | — | Compare |
Sponsored placements are available on pages like this one. Advertise on Noometry
Benchmark results
Every published result we track, with its source. Bold rows are the ones used for ranking; where several exist we prefer independent runs over self-reported numbers.
Coding
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| Aider Polyglot | 56.9% | Epoch AI | |||
| Aider Polyglot | 71.4% | #9 of 44, top 21% | Epoch AI | ||
| SciCode | 35.7% | #97 of 121, top 81% | Epoch AI | ||
| WeirdML | 36.5% | Epoch AI | |||
| WeirdML | 41.6% | #72 of 119, top 61% | Epoch AI | ||
| LiveBench Coding | 66.7% | #10 of 39, top 26% | Epoch AI | ||
| LMArena Coding | 1427 | #112 of 294, top 39% | LMArena | 2026-10-08 | |
| LMArena Coding | 1371 | LMArena | 2026-10-08 | ||
| ALE-Bench | 804.12 | #56 of 105, top 54% | Epoch AI | ||
| AlgoTune | 1.7 | #7 of 18, top 39% | Epoch AI |
Agentic & Tool Use
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| DeepResearch Bench | 35.1% | #23 of 24, top 96% | Epoch AI | ||
| BALROG | 34.9% | #12 of 35, top 35% | Epoch AI | ||
| METR Time Horizons | 51.9% | Epoch AI | |||
| METR Time Horizons | 53.8% | #22 of 32, top 69% | Epoch AI |
Reasoning
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| ARC-AGI-2 | 1.3% | #66 of 83, top 80% | Epoch AI | ||
| ARC-AGI-2 | 1.1% | Epoch AI | |||
| SimpleBench | 40.8% | #53 of 77, top 69% | Epoch AI | ||
| SimpleBench | 30.9% | Epoch AI | |||
| Kagi LLM Benchmark | 69.4% | #25 of 99, top 26% | Kagi LLM Benchmark | ||
| ARC-AGI-1 | 15.8% | Epoch AI | |||
| ARC-AGI-1 | 21.2% | #68 of 83, top 82% | Epoch AI | ||
| CritPt | 1.1% | #82 of 134, top 62% | Epoch AI | ||
| LiveBench Reasoning | 83.2% | #7 of 39, top 18% | Epoch AI | ||
| LMArena Hard Prompts | 1416 | #111 of 297, top 38% | LMArena | 2026-10-08 | |
| LMArena Hard Prompts | 1361 | LMArena | 2026-10-08 | ||
| LiveBench Data Analysis | 69.8% | #5 of 39, top 13% | Epoch AI | ||
| Epoch Capabilities Index | 141.29 | #104 of 213, top 49% | Epoch AI | 2025-05-28 | |
| Epoch Capabilities Index | 138.97 | Epoch AI | 2025-01-20 | ||
| ForecastBench | 60 | #33 of 72, top 46% | Epoch AI | ||
| LiveBench | 71.6% | #7 of 39, top 18% | Epoch AI |
Math
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| OTIS Mock AIME 2024-2025 | 66.4% | #98 of 173, top 57% | Epoch AI | 2025-05-29 | |
| OTIS Mock AIME 2024-2025 | 53.3% | Epoch AI | 2025-02-26 | ||
| Omni-MATH | 42.4% | #23 of 57, top 41% | HELM Capabilities | ||
| LiveBench Math | 80.7% | #3 of 39, top 8% | Epoch AI | ||
| LMArena Math | 1393 | LMArena | 2026-10-08 | ||
| LMArena Math | 1400 | #125 of 285, top 44% | LMArena | 2026-10-08 | |
| MATH Level 5 | 96.6% | #7 of 79, top 9% | Epoch AI | 2025-05-29 | |
| MATH Level 5 | 93.1% | Epoch AI | 2025-01-31 |
Knowledge
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| GPQA Diamond | 76.3% | #88 of 186, top 48% | Epoch AI | 2025-05-29 | |
| GPQA Diamond | 71.7% | Epoch AI | 2025-05-26 | ||
| MMLU-Pro | 79.3% | #18 of 58, top 32% | HELM Capabilities | ||
| Confabulations (lower is better) | 12.7% | #9 of 51, top 18% | Lech Mazur benchmarks | ||
| Confabulations (lower is better) | 14.6% | Lech Mazur benchmarks | |||
| Vectara Hallucination Rate (lower is better) | 11.3% | #68 of 96, top 71% | Vectara Hallucination Leaderboard | ||
| GPQA (HELM) | 66.6% | #15 of 57, top 27% | HELM Capabilities | ||
| LMArena Expert | 1394 | #131 of 273, top 48% | LMArena | 2026-10-08 | |
| LMArena Expert | 1338 | LMArena | 2026-10-08 |
Multilingual
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Non-English | 1412 | #85 of 297, top 29% | LMArena | 2026-10-08 | |
| LMArena Non-English | 1357 | LMArena | 2026-10-08 | ||
| LMArena Chinese | 1400 | LMArena | 2026-10-08 | ||
| LMArena Chinese | 1442 | #110 of 285, top 39% | LMArena | 2026-10-08 | |
| LMArena French | 1417 | #105 of 223, top 48% | LMArena | 2026-10-08 | |
| LMArena French | 1366 | LMArena | 2026-10-08 | ||
| LMArena German | 1404 | #92 of 231, top 40% | LMArena | 2026-10-08 | |
| LMArena German | 1384 | LMArena | 2026-10-08 | ||
| LMArena Japanese | 1324 | LMArena | 2026-10-08 | ||
| LMArena Japanese | 1391 | #68 of 211, top 33% | LMArena | 2026-10-08 | |
| LMArena Korean | 1329 | LMArena | 2026-10-08 | ||
| LMArena Korean | 1360 | #94 of 213, top 45% | LMArena | 2026-10-08 | |
| LMArena Russian | 1354 | LMArena | 2026-10-08 | ||
| LMArena Russian | 1423 | #76 of 283, top 27% | LMArena | 2026-10-08 | |
| LMArena Spanish | 1411 | #100 of 226, top 45% | LMArena | 2026-10-08 | |
| LMArena Spanish | 1379 | LMArena | 2026-10-08 |
Instruction Following
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LiveBench Instruction Following | 80.5% | #11 of 39, top 29% | Epoch AI | ||
| IFEval | 78.4% | #45 of 57, top 79% | HELM Capabilities | ||
| LMArena Instruction Following | 1357 | LMArena | 2026-10-08 | ||
| LMArena Instruction Following | 1382 | #120 of 298, top 41% | LMArena | 2026-10-08 |
Long Context
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| Fiction.LiveBench | 69.4% | Epoch AI | |||
| Fiction.LiveBench | 75% | #14 of 47, top 30% | Epoch AI | ||
| LMArena Longer Query | 1391 | #125 of 291, top 43% | LMArena | 2026-10-08 | |
| LMArena Longer Query | 1355 | LMArena | 2026-10-08 |
Writing & Preference
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Text | 1428 | #81 of 297, top 28% | LMArena | 2026-10-08 | |
| LMArena Text | 1373 | LMArena | 2026-10-08 | ||
| LMArena Creative Writing | 1354 | LMArena | 2026-10-08 | ||
| LMArena Creative Writing | 1405 | #68 of 295, top 24% | LMArena | 2026-10-08 | |
| Short-Story Creative Writing | 81.9% | Epoch AI | |||
| Short-Story Creative Writing | 83% | #9 of 39, top 24% | Epoch AI | ||
| EQ-Bench Creative Writing | 1421 | EQ-Bench | |||
| EQ-Bench Creative Writing | 1500 | #55 of 115, top 48% | EQ-Bench | ||
| WildBench | 82.8% | #20 of 57, top 36% | HELM Capabilities | ||
| LMArena Multi-Turn | 1391 | LMArena | 2026-10-08 | ||
| LMArena Multi-Turn | 1405 | #118 of 295, top 40% | LMArena | 2026-10-08 | |
| LiveBench Language | 48.5% | #13 of 39, top 34% | Epoch AI |
API pricing by provider
| Route | Input $/M | Output $/M | Cached input $/M | Checked |
|---|---|---|---|---|
| azure | $1.35 | $5.40 | — | 2026-10-10 |
| bedrock | $1.35 | $5.40 | — | 2026-10-10 |
| deepinfra | $0.50 | $2.15 | $0.35 | 2026-10-10 |
| openrouter | $0.70 | $2.50 | — | 2026-10-10 |
| together | $3 | $7 | — | 2026-10-10 |
Compare DeepSeek-R1
- DeepSeek-R1 vs DeepSeek-V3
- DeepSeek-R1 vs Hunyuan T1 20250711
- DeepSeek-R1 vs Step 3.5 Flash
- DeepSeek-R1 vs Nemotron 3 Ultra
- DeepSeek-R1 vs Qwen3.6 27B
- DeepSeek-R1 vs Qwen3.5-Flash
- DeepSeek-R1 vs Amazon Nova Experimental Chat 10 20
- DeepSeek-R1 vs GPT-6 Astra
- DeepSeek-R1 vs Claude Fable 5.1
- DeepSeek-R1 vs Gemini 3.8 Flash
- DeepSeek-R1 vs Kimi K3
- DeepSeek-R1 vs Grok 4.6
- DeepSeek-R1 vs Qwen3.8 Max
- DeepSeek-R1 vs GLM-5.3
Other DeepSeek models
Frequently asked questions
How good is DeepSeek-R1?
DeepSeek-R1 by DeepSeek ranks 115th of 354 ranked models on the Noometry Index as of October 2026, with a score of 42.3. Its strongest category is long context, where it ranks 36th. API pricing starts at $0.50 per million input tokens and $2.15 per million output tokens, with a 164K-token context window.
How much does DeepSeek-R1 cost?
DeepSeek-R1 costs $0.50 per million input tokens and $2.15 per million output tokens on deepinfra, with cached input at $0.35.
What is DeepSeek-R1's context window?
DeepSeek-R1 accepts up to 164K tokens of input and can write up to 64K tokens in one response.
Is DeepSeek-R1 open source?
No. DeepSeek-R1 is proprietary and available only through DeepSeek's API and partner platforms.
How fast is DeepSeek-R1?
DeepSeek-R1 generated about 10 output tokens per second in the Kagi LLM Benchmark's timed runs. Speed varies by provider, load and reasoning effort.
What are DeepSeek-R1's strengths and weaknesses?
Relative to other ranked models, DeepSeek-R1 places best in long context, coding, math and lowest in reasoning, agentic & tool use, instruction following.
What is DeepSeek-R1 best at?
Its best category is long context, where it ranks 36th on Noometry.