Noometry

Model comparison

Claude 3.7 Sonnet vs Claude Opus 4.8

Claude Opus 4.8 is the stronger model overall, scoring 60.7 to 39.5 on the Noometry Index.

Last verified . 30 shared benchmarks.

Claude 3.7 Sonnet Anthropic

39.5

Rank #164 Confirmed

Claude Opus 4.8 Anthropic

60.7

Rank #13 Confirmed

Summary

  • They share 30 benchmarks with published results for both. Claude 3.7 Sonnet scores higher in 1 category and Claude Opus 4.8 in 9 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Claude Opus 4.8 leads 64.7 to 18.6.
  • The biggest single-benchmark swing is ARC-AGI-2: 0.9% for Claude 3.7 Sonnet and 72.1% for Claude Opus 4.8.

Side by side

Claude 3.7 SonnetClaude Opus 4.8
ProviderAnthropicAnthropic
Noometry Index39.560.7
Released2025-02-242026-05-28
WeightsProprietaryProprietary
Context window—1M
Max output—128K
Input $ / M tokens—$5
Output $ / M tokens—$25
Results tracked5865

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4.8 leads

Claude 3.7 Sonnet: 40.6 (#136), Claude Opus 4.8: 59.9 (#12)

BenchmarkClaude 3.7 SonnetClaude Opus 4.8
GSO3.8%47.1%
LMArena Coding13611490
SWE-bench Verified61%—
DeepSWE—59%
FrontierCode—46.5%
SWE-bench Verified (bash only)52.8%—
Aider Polyglot64.9%—
LMArena WebDev—1556
SciCode—53.5%
WeirdML—82.9%
LiveBench Coding74.5%—
CadEval54%—
ALE-Bench—1,564

Agentic & Tool Use Claude Opus 4.8 leads

Claude 3.7 Sonnet: 34.1 (#50), Claude Opus 4.8: 47.6 (#11)

BenchmarkClaude 3.7 SonnetClaude Opus 4.8
DeepResearch Bench43.6%50.2%
APEX-Agents—48.9%
OSWorld 2.0—20.6%
Remote Labor Index—8.3%
TheAgentCompany30.9%—
τ²-bench Banking—39.7%
Cybench20%—
OSWorld35.8%—
PostTrainBench—33.8%
GBAEval—70.9%
GDP.pdf—24%
LMArena Search—1204
METR Time Horizons60%—
Vending-Bench 2—5,787

Reasoning Claude Opus 4.8 leads

Claude 3.7 Sonnet: 18.6 (#277), Claude Opus 4.8: 64.7 (#16)

BenchmarkClaude 3.7 SonnetClaude Opus 4.8
ARC-AGI-20.9%72.1%
SimpleBench46.4%64.8%
ARC-AGI-128.6%92.5%
EnigmaEval4.2%23.5%
LMArena Hard Prompts13331482
Epoch Capabilities Index141.16158.21
ForecastBench61.859.9
Kagi LLM Benchmark—88.8%
NYT Connections (extended)—91.1%
CritPt—20.9%
Chess Puzzles—34%
EBR-Bench—28.6%
LiveBench Reasoning87.8%—
Mystery Game Puzzles—36%
DTBench—94.9%
LiveBench Data Analysis74%—
LMCA—57.5%
Surface Evolver Bench—87.5%
Bench to the Future 3—0.14
LiveBench76.1%—

Math Claude Opus 4.8 leads

Claude 3.7 Sonnet: 37.5 (#153), Claude Opus 4.8: 78.4 (#13)

BenchmarkClaude 3.7 SonnetClaude Opus 4.8
OTIS Mock AIME 2024-202557.8%98.3%
LMArena Math13371487
FrontierMath (Feb 2025 set)4.1%47.2%
FrontierMath (Tiers 1-3)—80%
FrontierMath Tier 4—56.1%
MathArena Final-Answer Competitions—91.8%
ProofBench—69%
Omni-MATH33%—
LiveBench Math79%—
MATH Level 591.2%—
FrontierMath Tier 4 (v1)—31.3%

Knowledge Claude Opus 4.8 leads

Claude 3.7 Sonnet: 39.8 (#130), Claude Opus 4.8: 61.3 (#29)

BenchmarkClaude 3.7 SonnetClaude Opus 4.8
GPQA Diamond79.7%91%
LMArena Expert13211502
Humanity's Last Exam8%—
SimpleQA Verified—53%
MMLU-Pro78.4%—
Confabulations14.7%—
GPQA (HELM)60.8%—

Multimodal Claude Opus 4.8 leads

Claude 3.7 Sonnet: 33.7 (#95), Claude Opus 4.8: 42.9 (#26)

BenchmarkClaude 3.7 SonnetClaude Opus 4.8
LMArena Vision11691294
GeoBench68%—
VPCT39%—
Blueprint-Bench 2—14.5%
Furniture Assembly—42.5%
LMArena Document—1475
SpatialViz-Bench33.9%—

Multilingual Claude Opus 4.8 leads

Claude 3.7 Sonnet: 44.1 (#179), Claude Opus 4.8: 55.2 (#33)

BenchmarkClaude 3.7 SonnetClaude Opus 4.8
LMArena Non-English12961450
LMArena Chinese12991507
LMArena French13031481
LMArena German13011472
LMArena Japanese12671440
LMArena Korean12491432
LMArena Russian13111474
LMArena Spanish12981466

Instruction Following Claude Opus 4.8 leads

Claude 3.7 Sonnet: 72.9 (#125), Claude Opus 4.8: 77.4 (#24)

BenchmarkClaude 3.7 SonnetClaude Opus 4.8
LMArena Instruction Following13521476
LiveBench Instruction Following81.3%—
IFEval83.4%—

Long Context Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 50.3 (#10), Claude Opus 4.8: 45.4 (#35)

BenchmarkClaude 3.7 SonnetClaude Opus 4.8
LMArena Longer Query13731483
Fiction.LiveBench83.3%—

Writing & Preference Claude Opus 4.8 leads

Claude 3.7 Sonnet: 54.4 (#150), Claude Opus 4.8: 72.0 (#16)

BenchmarkClaude 3.7 SonnetClaude Opus 4.8
LMArena Text13141461
LMArena Creative Writing13321454
EQ-Bench Creative Writing14121840
LMArena Multi-Turn13391476
Short-Story Creative Writing81.1%—
WildBench81.4%—
EQ-Bench 4—1281
LiveBench Language59.9%—

Frequently asked questions

Is Claude 3.7 Sonnet better than Claude Opus 4.8?

Claude Opus 4.8 is the stronger model overall, scoring 60.7 to 39.5 on the Noometry Index.

Is Claude 3.7 Sonnet or Claude Opus 4.8 better for coding?

Claude Opus 4.8 scores higher on coding benchmarks: 59.9 versus 40.6 in the Noometry coding category.

How many benchmarks do Claude 3.7 Sonnet and Claude Opus 4.8 share?

30 benchmarks have published results for both models. Claude 3.7 Sonnet has 58 scored results on Noometry and Claude Opus 4.8 has 65.

Related comparisons

Go deeper