Model comparison

Claude 2 vs DeepSeek-R1

DeepSeek-R1 is the stronger model overall, scoring 42.3 to 25.0 on the Noometry Index.

Last verified . 4 shared benchmarks.

Claude 2 Anthropic

25.0

Rank #346 Reported

DeepSeek-R1 DeepSeek

42.3

Rank #115 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Claude 2 scores higher in 1 category and DeepSeek-R1 in 2 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where DeepSeek-R1 leads 43.8 to 9.3.
  • The biggest single-benchmark swing is MATH Level 5: 11.7% for Claude 2 and 96.6% for DeepSeek-R1.

Side by side

Claude 2 and DeepSeek-R1 specifications
Claude 2DeepSeek-R1
ProviderAnthropicDeepSeek
Noometry Index25.042.3
Released2023-07-112025-01-20
WeightsProprietaryProprietary
Context window—164K
Max output—64K
Input $ / M tokens—$0.50
Output $ / M tokens—$2.15
Results tracked852

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 2: —, DeepSeek-R1: 46.3 (#68)

Coding benchmarks
BenchmarkClaude 2DeepSeek-R1
Aider Polyglot—71.4%
SciCode—35.7%
WeirdML—41.6%
LiveBench Coding—66.7%
LMArena Coding—1427
ALE-Bench—804.12
AlgoTune—1.7
HumanEval+61.6%—

Agentic & Tool Use Not comparable

Claude 2: —, DeepSeek-R1: 30.7 (#75)

Agentic & Tool Use benchmarks
BenchmarkClaude 2DeepSeek-R1
DeepResearch Bench—35.1%
BALROG—34.9%
METR Time Horizons—53.8%

Reasoning Claude 2 leads

Claude 2: 21.7 (#216), DeepSeek-R1: 18.6 (#278)

Reasoning benchmarks
BenchmarkClaude 2DeepSeek-R1
Epoch Capabilities Index120.13141.29
ARC-AGI-2—1.3%
SimpleBench—40.8%
Kagi LLM Benchmark—69.4%
ARC-AGI-1—21.2%
CritPt—1.1%
LiveBench Reasoning—83.2%
LMArena Hard Prompts—1416
DTBench51.9%—
LiveBench Data Analysis—69.8%
ForecastBench—60
LiveBench—71.6%

Math DeepSeek-R1 leads

Claude 2: 9.3 (#320), DeepSeek-R1: 43.8 (#79)

Math benchmarks
BenchmarkClaude 2DeepSeek-R1
OTIS Mock AIME 2024-20252.5%66.4%
MATH Level 511.7%96.6%
Omni-MATH—42.4%
LiveBench Math—80.7%
LMArena Math—1400

Knowledge DeepSeek-R1 leads

Claude 2: 16.9 (#287), DeepSeek-R1: 44.5 (#87)

Knowledge benchmarks
BenchmarkClaude 2DeepSeek-R1
GPQA Diamond34.7%76.3%
MMLU-Pro—79.3%
Confabulations—12.7%
Vectara Hallucination Rate—11.3%
GPQA (HELM)—66.6%
LMArena Expert—1394
MMLU78.5%—
TriviaQA87.5%—

Multilingual Not comparable

Claude 2: —, DeepSeek-R1: 52.4 (#85)

Multilingual benchmarks
BenchmarkClaude 2DeepSeek-R1
LMArena Non-English—1412
LMArena Chinese—1442
LMArena French—1417
LMArena German—1404
LMArena Japanese—1391
LMArena Korean—1360
LMArena Russian—1423
LMArena Spanish—1411

Instruction Following Not comparable

Claude 2: —, DeepSeek-R1: 72.0 (#143)

Instruction Following benchmarks
BenchmarkClaude 2DeepSeek-R1
LiveBench Instruction Following—80.5%
IFEval—78.4%
LMArena Instruction Following—1382

Long Context Not comparable

Claude 2: —, DeepSeek-R1: 45.4 (#36)

Long Context benchmarks
BenchmarkClaude 2DeepSeek-R1
Fiction.LiveBench—75%
LMArena Longer Query—1391

Writing & Preference Not comparable

Claude 2: —, DeepSeek-R1: 61.4 (#88)

Writing & Preference benchmarks
BenchmarkClaude 2DeepSeek-R1
LMArena Text—1428
LMArena Creative Writing—1405
Short-Story Creative Writing—83%
EQ-Bench Creative Writing—1500
WildBench—82.8%
LMArena Multi-Turn—1405
LiveBench Language—48.5%

Frequently asked questions

Is Claude 2 better than DeepSeek-R1?

DeepSeek-R1 is the stronger model overall, scoring 42.3 to 25.0 on the Noometry Index.

How many benchmarks do Claude 2 and DeepSeek-R1 share?

4 benchmarks have published results for both models. Claude 2 has 8 scored results on Noometry and DeepSeek-R1 has 52.

Related comparisons

Go deeper