Noometry

Model comparison

Claude Sonnet 5 vs GPT-6.1 Sol

GPT-6.1 Sol is the stronger model overall, scoring 65.6 to 54.6 on the Noometry Index.

Last verified . 29 shared benchmarks.

Claude Sonnet 5 Anthropic

54.6

Rank #29 Confirmed

GPT-6.1 Sol OpenAI

65.6

Rank #6 Confirmed

Summary

  • They share 29 benchmarks with published results for both. Claude Sonnet 5 scores higher in 2 categories and GPT-6.1 Sol in 8 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GPT-6.1 Sol leads 81.9 to 49.1.
  • The biggest single-benchmark swing is FrontierMath Tier 4: 29.3% for Claude Sonnet 5 and 100% for GPT-6.1 Sol.
  • Both cost about the same: $2 input and $10 output per million tokens.
  • GPT-6.1 Sol accepts more context: 1.05M tokens versus 1M.

Side by side

Claude Sonnet 5GPT-6.1 Sol
ProviderAnthropicOpenAI
Noometry Index54.665.6
Released2026-06-292026-09-29
WeightsProprietaryProprietary
Context window1M1.05M
Max output128K128K
Input $ / M tokens$2$2
Output $ / M tokens$10$10
Results tracked5134

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-6.1 Sol leads

Claude Sonnet 5: 55.5 (#26), GPT-6.1 Sol: 63.2 (#8)

BenchmarkClaude Sonnet 5GPT-6.1 Sol
DeepSWE53.8%75.2%
FrontierCode42.7%50.2%
LMArena WebDev15411755
SciCode54.3%55.8%
LMArena Coding14831487
CursorBench34.1%—
GSO37.3%—
WeirdML68.8%—
ALE-Bench1,463—

Agentic & Tool Use Claude Sonnet 5 leads

Claude Sonnet 5: 42.8 (#18), GPT-6.1 Sol: 39.6 (#26)

BenchmarkClaude Sonnet 5GPT-6.1 Sol
APEX-Agents54.5%60%
GBAEval65.3%—
GDP.pdf—32%
LMArena Search1194—
Vending-Bench 26,378—

Reasoning GPT-6.1 Sol leads

Claude Sonnet 5: 49.1 (#39), GPT-6.1 Sol: 81.9 (#2)

BenchmarkClaude Sonnet 5GPT-6.1 Sol
NYT Connections (extended)75.1%95.5%
CritPt16.9%31.7%
Chess Puzzles35%61%
LMArena Hard Prompts14611466
Mystery Game Puzzles35%80%
Epoch Capabilities Index156.21166.09
ARC-AGI-2—94.2%
SimpleBench60.6%—
ARC-AGI-1—98.5%
EBR-Bench—54.3%
DTBench92.5%—
LMCA50%—
Surface Evolver Bench60%—
Bench to the Future 30.14—
ForecastBench61.1—

Math GPT-6.1 Sol leads

Claude Sonnet 5: 66.2 (#27), GPT-6.1 Sol: 93.7 (#1)

BenchmarkClaude Sonnet 5GPT-6.1 Sol
FrontierMath (Tiers 1-3)65.6%93.7%
FrontierMath Tier 429.3%100%
OTIS Mock AIME 2024-202594.7%100%
ProofBench77%99%
LMArena Math14671464

Knowledge GPT-6.1 Sol leads

Claude Sonnet 5: 55.6 (#47), GPT-6.1 Sol: 71.8 (#4)

BenchmarkClaude Sonnet 5GPT-6.1 Sol
GPQA Diamond90.5%95.4%
SimpleQA Verified33.7%73.9%
LMArena Expert14901502

Multimodal GPT-6.1 Sol leads

Claude Sonnet 5: 42.4 (#31), GPT-6.1 Sol: 52.7 (#5)

BenchmarkClaude Sonnet 5GPT-6.1 Sol
LMArena Vision12741288
Blueprint-Bench 224.9%—
Furniture Assembly—80%
LMArena Document1466—

Multilingual Too close to call

Claude Sonnet 5: 53.8 (#55), GPT-6.1 Sol: 54.3 (#46)

BenchmarkClaude Sonnet 5GPT-6.1 Sol
LMArena Non-English14311438
LMArena Chinese14771477
LMArena Russian14511455
LMArena French1460—
LMArena German1440—
LMArena Japanese1422—
LMArena Korean1411—
LMArena Spanish1437—

Instruction Following Too close to call

Claude Sonnet 5: 76.3 (#41), GPT-6.1 Sol: 77.0 (#29)

BenchmarkClaude Sonnet 5GPT-6.1 Sol
LMArena Instruction Following14521468

Long Context Too close to call

Claude Sonnet 5: 44.8 (#55), GPT-6.1 Sol: 44.9 (#54)

BenchmarkClaude Sonnet 5GPT-6.1 Sol
LMArena Longer Query14631465

Writing & Preference Claude Sonnet 5 leads

Claude Sonnet 5: 69.2 (#25), GPT-6.1 Sol: 63.6 (#63)

BenchmarkClaude Sonnet 5GPT-6.1 Sol
LMArena Text14421447
LMArena Creative Writing14161432
LMArena Multi-Turn14541449
EQ-Bench Creative Writing1794—
EQ-Bench 41236—

Frequently asked questions

Is Claude Sonnet 5 better than GPT-6.1 Sol?

GPT-6.1 Sol is the stronger model overall, scoring 65.6 to 54.6 on the Noometry Index.

Which is cheaper, Claude Sonnet 5 or GPT-6.1 Sol?

GPT-6.1 Sol is cheaper. It lists at $2 per million input tokens and $10 per million output tokens; Claude Sonnet 5 lists at $2 and $10.

Is Claude Sonnet 5 or GPT-6.1 Sol better for coding?

GPT-6.1 Sol scores higher on coding benchmarks: 63.2 versus 55.5 in the Noometry coding category.

Which has the bigger context window?

GPT-6.1 Sol does, with 1.05M tokens against 1M.

How many benchmarks do Claude Sonnet 5 and GPT-6.1 Sol share?

29 benchmarks have published results for both models. Claude Sonnet 5 has 51 scored results on Noometry and GPT-6.1 Sol has 34.

Related comparisons

Go deeper