Model comparison

Claude 3.5 Sonnet vs Claude Sonnet 5

Claude Sonnet 5 is the stronger model overall, scoring 54.5 to 34.4 on the Noometry Index.

Last verified . 27 shared benchmarks.

Claude 3.5 Sonnet Anthropic

34.4

Rank #225 Confirmed

Claude Sonnet 5 Anthropic

54.5

Rank #26 Confirmed

Summary

  • They share 27 benchmarks with published results for both. Claude 3.5 Sonnet scores higher in 0 categories and Claude Sonnet 5 in 10 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Sonnet 5 leads 66.1 to 18.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 8.5% for Claude 3.5 Sonnet and 94.7% for Claude Sonnet 5.

Side by side

Claude 3.5 Sonnet and Claude Sonnet 5 specifications
Claude 3.5 SonnetClaude Sonnet 5
ProviderAnthropicAnthropic
Noometry Index34.454.5
Released2024-06-202026-06-29
WeightsProprietaryProprietary
Context window—1M
Max output—128K
Input $ / M tokens—$2
Output $ / M tokens—$10
Results tracked6051

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5 leads

Claude 3.5 Sonnet: 39.5 (#145), Claude Sonnet 5: 55.5 (#20)

Coding benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
GSO4.6%37.3%
WeirdML40%68.8%
LMArena Coding13431483
DeepSWE—53.8%
FrontierCode—42.7%
Aider Polyglot51.6%—
CursorBench—34.1%
LMArena WebDev—1540
SciCode—53.6%
BigCodeBench Instruct46.8%—
LiveBench Coding67.1%—
BigCodeBench Complete58.6%—
CadEval48%—
ALE-Bench—1,463
HumanEval+81.7%—
MBPP+74.3%—

Agentic & Tool Use Claude Sonnet 5 leads

Claude 3.5 Sonnet: 32.1 (#61), Claude Sonnet 5: 42.7 (#16)

Agentic & Tool Use benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
APEX-Agents—54.5%
TheAgentCompany24%—
Cybench17.5%—
BALROG32.6%—
GBAEval—65.3%
LMArena Search—1194
METR Time Horizons45.2%—
Vending-Bench 2—6,378

Reasoning Claude Sonnet 5 leads

Claude 3.5 Sonnet: 22.5 (#176), Claude Sonnet 5: 48.2 (#37)

Reasoning benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
SimpleBench41.4%60.6%
LMArena Hard Prompts13051461
DTBench67.8%92.5%
Epoch Capabilities Index133.55156.34
ForecastBench60.761.1
NYT Connections (extended)—75.1%
CritPt—16.9%
Chess Puzzles—35%
EnigmaEval0.9%—
LiveBench Reasoning56.7%—
Mystery Game Puzzles—35%
LiveBench Data Analysis55%—
LMCA—50%
Surface Evolver Bench—60%
Bench to the Future 3—0.14
LiveBench59%—

Math Claude Sonnet 5 leads

Claude 3.5 Sonnet: 18.0 (#282), Claude Sonnet 5: 66.1 (#21)

Math benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
OTIS Mock AIME 2024-20258.5%94.7%
LMArena Math13061467
FrontierMath (Tiers 1-3)—65.6%
FrontierMath Tier 4—29.3%
ProofBench—77%
Omni-MATH27.6%—
LiveBench Math52.3%—
MATH Level 556.9%—
FrontierMath (Feb 2025 set)2.1%—
FrontierMath Tier 4 (v1)0%—

Knowledge Claude Sonnet 5 leads

Claude 3.5 Sonnet: 28.5 (#236), Claude Sonnet 5: 55.7 (#42)

Knowledge benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
GPQA Diamond55.3%90.5%
LMArena Expert12641491
Humanity's Last Exam4.1%—
SimpleQA Verified—33.7%
MMLU-Pro77.7%—
Confabulations19.9%—
GPQA (HELM)56.5%—
MMLU87.3%—

Multimodal Claude Sonnet 5 leads

Claude 3.5 Sonnet: 26.0 (#115), Claude Sonnet 5: 42.4 (#26)

Multimodal benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
LMArena Vision11251275
Video-MME60%—
GeoBench62%—
VPCT33%—
Blueprint-Bench 2—24.9%
LMArena Document—1466

Multilingual Claude Sonnet 5 leads

Claude 3.5 Sonnet: 43.4 (#180), Claude Sonnet 5: 54.0 (#55)

Multilingual benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
LMArena Non-English12831431
LMArena Chinese12711475
LMArena French13041457
LMArena German12971448
LMArena Japanese12341422
LMArena Korean12001411
LMArena Russian13051452
LMArena Spanish12891436

Instruction Following Claude Sonnet 5 leads

Claude 3.5 Sonnet: 69.0 (#177), Claude Sonnet 5: 76.6 (#39)

Instruction Following benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
LMArena Instruction Following12971453
LiveBench Instruction Following69.3%—
IFEval85.5%—

Long Context Claude Sonnet 5 leads

Claude 3.5 Sonnet: 39.9 (#162), Claude Sonnet 5: 44.8 (#53)

Long Context benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
LMArena Longer Query13111464

Writing & Preference Claude Sonnet 5 leads

Claude 3.5 Sonnet: 53.0 (#159), Claude Sonnet 5: 69.4 (#24)

Writing & Preference benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
LMArena Text12981443
LMArena Creative Writing12921416
EQ-Bench Creative Writing14511794
LMArena Multi-Turn13261454
Short-Story Creative Writing80.3%—
WildBench79.2%—
EQ-Bench 4—1236
LiveBench Language53.8%—

Frequently asked questions

Is Claude 3.5 Sonnet better than Claude Sonnet 5?

Claude Sonnet 5 is the stronger model overall, scoring 54.5 to 34.4 on the Noometry Index.

Is Claude 3.5 Sonnet or Claude Sonnet 5 better for coding?

Claude Sonnet 5 scores higher on coding benchmarks: 55.5 versus 39.5 in the Noometry coding category.

How many benchmarks do Claude 3.5 Sonnet and Claude Sonnet 5 share?

27 benchmarks have published results for both models. Claude 3.5 Sonnet has 60 scored results on Noometry and Claude Sonnet 5 has 51.

Related comparisons

Go deeper