Noometry

Model comparison

Claude 3.5 Sonnet vs Claude Opus 4.5

Claude Opus 4.5 is the stronger model overall, scoring 50.5 to 34.6 on the Noometry Index.

Last verified . 35 shared benchmarks.

Claude 3.5 Sonnet Anthropic

34.6

Rank #231 Confirmed

Claude Opus 4.5 Anthropic

50.5

Rank #47 Confirmed

Summary

  • They share 35 benchmarks with published results for both. Claude 3.5 Sonnet scores higher in 0 categories and Claude Opus 4.5 in 10 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Claude Opus 4.5 leads 56.5 to 28.6.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 8.5% for Claude 3.5 Sonnet and 86.1% for Claude Opus 4.5.

Side by side

Claude 3.5 SonnetClaude Opus 4.5
ProviderAnthropicAnthropic
Noometry Index34.650.5
Released2024-06-202025-11-01
WeightsProprietaryProprietary
Context window—200K
Max output—64K
Input $ / M tokens—$5
Output $ / M tokens—$25
Results tracked6069

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4.5 leads

Claude 3.5 Sonnet: 39.0 (#165), Claude Opus 4.5: 54.8 (#27)

BenchmarkClaude 3.5 SonnetClaude Opus 4.5
GSO4.6%26.5%
WeirdML40%63.7%
LMArena Coding13421504
SWE-bench Verified—76.7%
SWE-bench Verified (bash only)—76.8%
Aider Polyglot51.6%—
LMArena WebDev—1494
SWE-bench Multilingual—70.7%
BigCodeBench Instruct46.8%—
LiveBench Coding67.1%—
BigCodeBench Complete58.6%—
CadEval48%—
ALE-Bench—1,025
AlgoTune—1.77
HumanEval+81.7%—
MBPP+74.3%—

Agentic & Tool Use Claude Opus 4.5 leads

Claude 3.5 Sonnet: 32.3 (#67), Claude Opus 4.5: 47.3 (#12)

BenchmarkClaude 3.5 SonnetClaude Opus 4.5
Cybench17.5%82%
BALROG32.6%43.5%
METR Time Horizons45.2%75%
Terminal-Bench—63.1%
Berkeley Function Calling Leaderboard—77.5%
GDPval—45.5%
Remote Labor Index—3.8%
TheAgentCompany24%—
τ²-bench Airline—84%
τ²-bench Banking—24.7%
τ²-bench Retail—79.6%
τ²-bench Telecom—92.3%
DeepResearch Bench—54.8%
OSWorld—66.3%
LMArena Search—1180
Vending-Bench 2—4,967

Reasoning Claude Opus 4.5 leads

Claude 3.5 Sonnet: 23.1 (#183), Claude Opus 4.5: 42.6 (#51)

BenchmarkClaude 3.5 SonnetClaude Opus 4.5
SimpleBench41.4%62%
EnigmaEval0.9%11.9%
LMArena Hard Prompts13051476
DTBench67.8%89.9%
Epoch Capabilities Index133.55150.09
ForecastBench60.760.7
ARC-AGI-2—37.6%
Kagi LLM Benchmark—80.2%
NYT Connections (extended)—52.5%
ARC-AGI-1—80%
Chess Puzzles—12%
EBR-Bench—14.3%
LiveBench Reasoning56.7%—
Mystery Game Puzzles—22%
LiveBench Data Analysis55%—
LMCA—44.5%
LiveBench59%—

Math Claude Opus 4.5 leads

Claude 3.5 Sonnet: 19.2 (#288), Claude Opus 4.5: 38.6 (#132)

BenchmarkClaude 3.5 SonnetClaude Opus 4.5
OTIS Mock AIME 2024-20258.5%86.1%
LMArena Math13071463
FrontierMath (Feb 2025 set)2.1%20.7%
FrontierMath Tier 4 (v1)0%4.2%
FrontierMath (Tiers 1-3)—34.4%
FrontierMath Tier 4—4.9%
ProofBench—36%
Omni-MATH27.6%—
LiveBench Math52.3%—
MATH Level 556.9%—

Knowledge Claude Opus 4.5 leads

Claude 3.5 Sonnet: 28.6 (#245), Claude Opus 4.5: 56.5 (#44)

BenchmarkClaude 3.5 SonnetClaude Opus 4.5
GPQA Diamond55.3%86%
Humanity's Last Exam4.1%25.2%
LMArena Expert12651487
SimpleQA Verified—45.7%
MMLU-Pro77.7%—
Confabulations19.9%—
Vectara Hallucination Rate—10.9%
GPQA (HELM)56.5%—
MMLU87.3%—

Multimodal Claude Opus 4.5 leads

Claude 3.5 Sonnet: 26.5 (#120), Claude Opus 4.5: 31.4 (#107)

BenchmarkClaude 3.5 SonnetClaude Opus 4.5
GeoBench62%75%
VPCT33%40%
LMArena Vision1125—
Video-MME60%—
Furniture Assembly—28.3%
LMArena Document—1462

Multilingual Claude Opus 4.5 leads

Claude 3.5 Sonnet: 43.2 (#185), Claude Opus 4.5: 54.3 (#47)

BenchmarkClaude 3.5 SonnetClaude Opus 4.5
LMArena Non-English12831438
LMArena Chinese12721470
LMArena French13051471
LMArena German12971449
LMArena Japanese12341416
LMArena Korean12001424
LMArena Russian13061447
LMArena Spanish12901458

Instruction Following Claude Opus 4.5 leads

Claude 3.5 Sonnet: 68.8 (#182), Claude Opus 4.5: 77.5 (#19)

BenchmarkClaude 3.5 SonnetClaude Opus 4.5
LMArena Instruction Following12971478
LiveBench Instruction Following69.3%—
IFEval85.5%—

Long Context Claude Opus 4.5 leads

Claude 3.5 Sonnet: 39.9 (#167), Claude Opus 4.5: 46.5 (#22)

BenchmarkClaude 3.5 SonnetClaude Opus 4.5
LMArena Longer Query13111480
CL-bench—21.1%

Writing & Preference Claude Opus 4.5 leads

Claude 3.5 Sonnet: 52.9 (#164), Claude Opus 4.5: 68.1 (#28)

BenchmarkClaude 3.5 SonnetClaude Opus 4.5
LMArena Text12981451
LMArena Creative Writing12921445
EQ-Bench Creative Writing14511687
LMArena Multi-Turn13261466
Short-Story Creative Writing80.3%—
WildBench79.2%—
LiveBench Language53.8%—

Frequently asked questions

Is Claude 3.5 Sonnet better than Claude Opus 4.5?

Claude Opus 4.5 is the stronger model overall, scoring 50.5 to 34.6 on the Noometry Index.

Is Claude 3.5 Sonnet or Claude Opus 4.5 better for coding?

Claude Opus 4.5 scores higher on coding benchmarks: 54.8 versus 39.0 in the Noometry coding category.

How many benchmarks do Claude 3.5 Sonnet and Claude Opus 4.5 share?

35 benchmarks have published results for both models. Claude 3.5 Sonnet has 60 scored results on Noometry and Claude Opus 4.5 has 69.

Related comparisons

Go deeper