Model comparison

Claude 3.5 Sonnet vs Claude Sonnet 5.5

Claude Sonnet 5.5 is the stronger model overall, scoring 60.5 to 34.4 on the Noometry Index.

Last verified . 2 shared benchmarks.

Claude 3.5 Sonnet Anthropic

34.4

Rank #225 Confirmed

Claude Sonnet 5.5 Anthropic

60.5

Rank #10 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Claude 3.5 Sonnet scores higher in 0 categories and Claude Sonnet 5.5 in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Sonnet 5.5 leads 88.7 to 18.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 8.5% for Claude 3.5 Sonnet and 100% for Claude Sonnet 5.5.

Side by side

Claude 3.5 Sonnet and Claude Sonnet 5.5 specifications
Claude 3.5 SonnetClaude Sonnet 5.5
ProviderAnthropicAnthropic
Noometry Index34.460.5
Released2024-06-202026-09-28
WeightsProprietaryProprietary
Context window—1M
Max output—128K
Input $ / M tokens—$2
Output $ / M tokens—$10
Results tracked6016

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5.5 leads

Claude 3.5 Sonnet: 39.5 (#145), Claude Sonnet 5.5: 65.5 (#6)

Coding benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5.5
FrontierCode—52.1%
Aider Polyglot51.6%—
CursorBench—55.5%
LMArena WebDev—1699
FrontierSWE—61.9%
SciCode—61%
GSO4.6%—
WeirdML40%—
BigCodeBench Instruct46.8%—
LiveBench Coding67.1%—
LMArena Coding1343—
BigCodeBench Complete58.6%—
CadEval48%—
ALE-Bench—1,819
HumanEval+81.7%—
MBPP+74.3%—

Agentic & Tool Use Claude Sonnet 5.5 leads

Claude 3.5 Sonnet: 32.1 (#61), Claude Sonnet 5.5: 44.9 (#14)

Agentic & Tool Use benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5.5
APEX-Agents—75.5%
TheAgentCompany24%—
Cybench17.5%—
BALROG32.6%—
METR Time Horizons45.2%—

Reasoning Claude Sonnet 5.5 leads

Claude 3.5 Sonnet: 22.5 (#176), Claude Sonnet 5.5: 52.4 (#29)

Reasoning benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5.5
SimpleBench41.4%—
CritPt—31.4%
EnigmaEval0.9%—
LiveBench Reasoning56.7%—
LMArena Hard Prompts1305—
Mystery Game Puzzles—65%
DTBench67.8%—
LiveBench Data Analysis55%—
Epoch Capabilities Index133.55—
ForecastBench60.7—
LiveBench59%—

Math Claude Sonnet 5.5 leads

Claude 3.5 Sonnet: 18.0 (#282), Claude Sonnet 5.5: 88.7 (#4)

Math benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5.5
OTIS Mock AIME 2024-20258.5%100%
FrontierMath (Tiers 1-3)—88.8%
FrontierMath Tier 4—80.5%
ProofBench—100%
Omni-MATH27.6%—
LiveBench Math52.3%—
LMArena Math1306—
MATH Level 556.9%—
FrontierMath (Feb 2025 set)2.1%—
FrontierMath Tier 4 (v1)0%—

Knowledge Claude Sonnet 5.5 leads

Claude 3.5 Sonnet: 28.5 (#236), Claude Sonnet 5.5: 66.0 (#11)

Knowledge benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5.5
GPQA Diamond55.3%95.6%
Humanity's Last Exam4.1%—
SimpleQA Verified—46.5%
MMLU-Pro77.7%—
Confabulations19.9%—
GPQA (HELM)56.5%—
LMArena Expert1264—
MMLU87.3%—

Multimodal Claude Sonnet 5.5 leads

Claude 3.5 Sonnet: 26.0 (#115), Claude Sonnet 5.5: 53.2 (#5)

Multimodal benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5.5
LMArena Vision1125—
Video-MME60%—
GeoBench62%—
VPCT33%—
Furniture Assembly—75%

Multilingual Not comparable

Claude 3.5 Sonnet: 43.4 (#180), Claude Sonnet 5.5: —

Multilingual benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5.5
LMArena Non-English1283—
LMArena Chinese1271—
LMArena French1304—
LMArena German1297—
LMArena Japanese1234—
LMArena Korean1200—
LMArena Russian1305—
LMArena Spanish1289—

Instruction Following Not comparable

Claude 3.5 Sonnet: 69.0 (#177), Claude Sonnet 5.5: —

Instruction Following benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5.5
LiveBench Instruction Following69.3%—
IFEval85.5%—
LMArena Instruction Following1297—

Long Context Not comparable

Claude 3.5 Sonnet: 39.9 (#162), Claude Sonnet 5.5: —

Long Context benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5.5
LMArena Longer Query1311—

Writing & Preference Not comparable

Claude 3.5 Sonnet: 53.0 (#159), Claude Sonnet 5.5: —

Writing & Preference benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5.5
LMArena Text1298—
LMArena Creative Writing1292—
Short-Story Creative Writing80.3%—
EQ-Bench Creative Writing1451—
WildBench79.2%—
LMArena Multi-Turn1326—
LiveBench Language53.8%—

Frequently asked questions

Is Claude 3.5 Sonnet better than Claude Sonnet 5.5?

Claude Sonnet 5.5 is the stronger model overall, scoring 60.5 to 34.4 on the Noometry Index.

Is Claude 3.5 Sonnet or Claude Sonnet 5.5 better for coding?

Claude Sonnet 5.5 scores higher on coding benchmarks: 65.5 versus 39.5 in the Noometry coding category.

How many benchmarks do Claude 3.5 Sonnet and Claude Sonnet 5.5 share?

2 benchmarks have published results for both models. Claude 3.5 Sonnet has 60 scored results on Noometry and Claude Sonnet 5.5 has 16.

Related comparisons

Go deeper