Noometry

Model comparison

Claude 2 vs Claude Opus 4

Claude Opus 4 is the stronger model overall, scoring 43.1 to 25.0 on the Noometry Index.

Last verified . 5 shared benchmarks.

Claude 2 Anthropic

25.0

Rank #346 Reported

Claude Opus 4 Anthropic

43.1

Rank #100 Confirmed

Summary

  • They share 5 benchmarks with published results for both. Claude 2 scores higher in 0 categories and Claude Opus 4 in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Opus 4 leads 42.0 to 9.3.
  • The biggest single-benchmark swing is MATH Level 5: 11.7% for Claude 2 and 85% for Claude Opus 4.

Side by side

Claude 2Claude Opus 4
ProviderAnthropicAnthropic
Noometry Index25.043.1
Released2023-07-112025-05-22
WeightsProprietaryProprietary
Context window—200K
Max output—32K
Input $ / M tokens—$15
Output $ / M tokens—$75
Results tracked856

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 2: —, Claude Opus 4: 47.2 (#62)

BenchmarkClaude 2Claude Opus 4
SWE-bench Verified—70.7%
SWE-bench Verified (bash only)—67.6%
Aider Polyglot—72%
GSO—6.9%
WeirdML—43.7%
LMArena Coding—1442
AlgoTune—1.33
HumanEval+61.6%—

Agentic & Tool Use Not comparable

Claude 2: —, Claude Opus 4: 34.8 (#42)

BenchmarkClaude 2Claude Opus 4
Cybench—38%
DeepResearch Bench—46.8%
LMArena Search—1127
METR Time Horizons—63.9%

Reasoning Claude Opus 4 leads

Claude 2: 21.7 (#216), Claude Opus 4: 27.3 (#121)

BenchmarkClaude 2Claude Opus 4
DTBench51.9%81.6%
Epoch Capabilities Index120.13142.67
ARC-AGI-2—8.6%
SimpleBench—58.8%
Kagi LLM Benchmark—74.3%
ARC-AGI-1—35.7%
CritPt—0.3%
EnigmaEval—5.6%
LMArena Hard Prompts—1399
LMCA—37.4%
ForecastBench—61.1

Math Claude Opus 4 leads

Claude 2: 9.3 (#320), Claude Opus 4: 42.0 (#86)

BenchmarkClaude 2Claude Opus 4
OTIS Mock AIME 2024-20252.5%64.4%
MATH Level 511.7%85%
Omni-MATH—61.6%
LMArena Math—1390
FrontierMath (Feb 2025 set)—4.5%
FrontierMath Tier 4 (v1)—4.2%

Knowledge Claude Opus 4 leads

Claude 2: 16.9 (#287), Claude Opus 4: 44.0 (#88)

BenchmarkClaude 2Claude Opus 4
GPQA Diamond34.7%76.3%
Humanity's Last Exam—10.7%
MMLU-Pro—87.5%
Confabulations—15.9%
Vectara Hallucination Rate—12%
GPQA (HELM)—70.8%
LMArena Expert—1386
MMLU78.5%—
TriviaQA87.5%—

Multimodal Not comparable

Claude 2: —, Claude Opus 4: 31.5 (#106)

BenchmarkClaude 2Claude Opus 4
LMArena Vision—1192
GeoBench—49%
VPCT—38%

Multilingual Not comparable

Claude 2: —, Claude Opus 4: 48.8 (#138)

BenchmarkClaude 2Claude Opus 4
LMArena Non-English—1362
LMArena Chinese—1386
LMArena French—1372
LMArena German—1391
LMArena Japanese—1331
LMArena Korean—1321
LMArena Russian—1392
LMArena Spanish—1389

Instruction Following Not comparable

Claude 2: —, Claude Opus 4: 77.1 (#28)

BenchmarkClaude 2Claude Opus 4
IFEval—91.8%
LMArena Instruction Following—1406

Long Context Not comparable

Claude 2: —, Claude Opus 4: 39.6 (#172)

BenchmarkClaude 2Claude Opus 4
Fiction.LiveBench—61.1%
LMArena Longer Query—1422

Writing & Preference Not comparable

Claude 2: —, Claude Opus 4: 61.2 (#89)

BenchmarkClaude 2Claude Opus 4
LMArena Text—1377
LMArena Creative Writing—1387
Short-Story Creative Writing—83.6%
EQ-Bench Creative Writing—1580
WildBench—85.2%
LMArena Multi-Turn—1396

Frequently asked questions

Is Claude 2 better than Claude Opus 4?

Claude Opus 4 is the stronger model overall, scoring 43.1 to 25.0 on the Noometry Index.

How many benchmarks do Claude 2 and Claude Opus 4 share?

5 benchmarks have published results for both models. Claude 2 has 8 scored results on Noometry and Claude Opus 4 has 56.

Related comparisons

Go deeper