Noometry

Model comparison

Claude Sonnet 5.5 vs o1-mini

Claude Sonnet 5.5 is the stronger model overall, scoring 61.9 to 34.0 on the Noometry Index.

Last verified . 15 shared benchmarks.

Claude Sonnet 5.5 Anthropic

61.9

Rank #10 Confirmed

o1-mini OpenAI

34.0

Rank #235 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Claude Sonnet 5.5 scores higher in 9 categories and o1-mini in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Sonnet 5.5 leads 87.9 to 35.4.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 100% for Claude Sonnet 5.5 and 46.9% for o1-mini.

Side by side

Claude Sonnet 5.5o1-mini
ProviderAnthropicOpenAI
Noometry Index61.934.0
Released2026-09-282024-09-12
WeightsProprietaryProprietary
Context window1M—
Max output128K—
Input $ / M tokens$2—
Output $ / M tokens$10—
Results tracked3239

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 67.3 (#6), o1-mini: 35.5 (#224)

BenchmarkClaude Sonnet 5.5o1-mini
LMArena Coding15131362
FrontierCode52.1%—
Aider Polyglot—32.9%
CursorBench55.5%—
LMArena WebDev1774—
FrontierSWE61.9%—
SciCode61%—
WeirdML—36.3%
LiveBench Coding—48%
ALE-Bench1,819—
HumanEval+—89%
MBPP+—78.8%

Agentic & Tool Use Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 45.0 (#16), o1-mini: 24.6 (#118)

BenchmarkClaude Sonnet 5.5o1-mini
APEX-Agents75.5%—
Cybench—10%

Reasoning Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 54.0 (#28), o1-mini: 8.8 (#346)

BenchmarkClaude Sonnet 5.5o1-mini
LMArena Hard Prompts14951333
Epoch Capabilities Index165.03135.82
ARC-AGI-2—0.8%
SimpleBench—18.1%
NYT Connections (extended)80.5%—
ARC-AGI-1—14%
CritPt31.4%—
LiveBench Reasoning—72.3%
Mystery Game Puzzles65%—
LiveBench Data Analysis—57.9%
LiveBench—57.8%

Math Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 87.9 (#6), o1-mini: 35.4 (#186)

BenchmarkClaude Sonnet 5.5o1-mini
OTIS Mock AIME 2024-2025100%46.9%
LMArena Math15101358
FrontierMath (Tiers 1-3)88.8%—
FrontierMath Tier 480.5%—
ProofBench100%—
LiveBench Math—62%
MATH Level 5—89.2%
FrontierMath (Feb 2025 set)—1.7%
FrontierMath Erdős2.9%—

Knowledge Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 66.0 (#12), o1-mini: 34.9 (#192)

BenchmarkClaude Sonnet 5.5o1-mini
GPQA Diamond95.6%62.4%
LMArena Expert15401316
SimpleQA Verified46.5%—
Confabulations—18.6%

Multimodal Not comparable

Claude Sonnet 5.5: 51.5 (#6), o1-mini: —

BenchmarkClaude Sonnet 5.5o1-mini
LMArena Vision1289—
Furniture Assembly75%—

Multilingual Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 55.3 (#30), o1-mini: 43.6 (#182)

BenchmarkClaude Sonnet 5.5o1-mini
LMArena Non-English14521289
LMArena Chinese15221314
LMArena Russian14511283
LMArena French—1293
LMArena German—1278
LMArena Japanese—1245
LMArena Korean—1223
LMArena Spanish—1303

Instruction Following Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 78.3 (#11), o1-mini: 66.7 (#206)

BenchmarkClaude Sonnet 5.5o1-mini
LMArena Instruction Following14951304
LiveBench Instruction Following—65.4%

Long Context Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 45.9 (#28), o1-mini: 40.1 (#161)

BenchmarkClaude Sonnet 5.5o1-mini
LMArena Longer Query14981320

Writing & Preference Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 66.0 (#40), o1-mini: 48.4 (#202)

BenchmarkClaude Sonnet 5.5o1-mini
LMArena Text14711317
LMArena Creative Writing14651244
LMArena Multi-Turn14741314
Short-Story Creative Writing—64.9%
LiveBench Language—40.9%

Frequently asked questions

Is Claude Sonnet 5.5 better than o1-mini?

Claude Sonnet 5.5 is the stronger model overall, scoring 61.9 to 34.0 on the Noometry Index.

Is Claude Sonnet 5.5 or o1-mini better for coding?

Claude Sonnet 5.5 scores higher on coding benchmarks: 67.3 versus 35.5 in the Noometry coding category.

How many benchmarks do Claude Sonnet 5.5 and o1-mini share?

15 benchmarks have published results for both models. Claude Sonnet 5.5 has 32 scored results on Noometry and o1-mini has 39.

Related comparisons

Go deeper