Noometry

Model comparison

Claude Sonnet 5.5 vs GPT-5.4 Pro

Claude Sonnet 5.5 is the stronger model overall, scoring 61.9 to 58.9 on the Noometry Index.

Last verified . 6 shared benchmarks.

Claude Sonnet 5.5 Anthropic

61.9

Rank #10 Confirmed

GPT-5.4 Pro OpenAI

58.9

Rank #18 Confirmed

Summary

  • They share 6 benchmarks with published results for both. Claude Sonnet 5.5 scores higher in 2 categories and GPT-5.4 Pro in 2 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Claude Sonnet 5.5 leads 67.3 to 43.2.
  • The biggest single-benchmark swing is FrontierMath Tier 4: 80.5% for Claude Sonnet 5.5 and 58.5% for GPT-5.4 Pro.
  • Claude Sonnet 5.5 is cheaper at $2 / $10 per million input/output tokens, against $30 / $180 for GPT-5.4 Pro.
  • GPT-5.4 Pro accepts more context: 1.05M tokens versus 1M.

Side by side

Claude Sonnet 5.5GPT-5.4 Pro
ProviderAnthropicOpenAI
Noometry Index61.958.9
Released2026-09-282026-03-05
WeightsProprietaryProprietary
Context window1M1.05M
Max output128K128K
Input $ / M tokens$2$30
Output $ / M tokens$10$180
Results tracked3216

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 67.3 (#6), GPT-5.4 Pro: 43.2 (#90)

BenchmarkClaude Sonnet 5.5GPT-5.4 Pro
FrontierCode52.1%—
CursorBench55.5%—
LMArena WebDev1774—
FrontierSWE61.9%—
SciCode61%—
WeirdML—57.4%
LMArena Coding1513—
ALE-Bench1,819—

Agentic & Tool Use Not comparable

Claude Sonnet 5.5: 45.0 (#16), GPT-5.4 Pro: —

BenchmarkClaude Sonnet 5.5GPT-5.4 Pro
APEX-Agents75.5%—

Reasoning GPT-5.4 Pro leads

Claude Sonnet 5.5: 54.0 (#28), GPT-5.4 Pro: 70.7 (#13)

BenchmarkClaude Sonnet 5.5GPT-5.4 Pro
CritPt31.4%30%
Epoch Capabilities Index165.03158.93
ARC-AGI-2—83.3%
SimpleBench—74.1%
NYT Connections (extended)80.5%—
ARC-AGI-1—94.5%
Chess Puzzles—58.6%
EnigmaEval—23.8%
LMArena Hard Prompts1495—
Mystery Game Puzzles65%—

Math Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 87.9 (#6), GPT-5.4 Pro: 72.4 (#22)

BenchmarkClaude Sonnet 5.5GPT-5.4 Pro
FrontierMath (Tiers 1-3)88.8%82.5%
FrontierMath Tier 480.5%58.5%
OTIS Mock AIME 2024-2025100%—
ProofBench100%—
LMArena Math1510—
FrontierMath (Feb 2025 set)—50%
FrontierMath Erdős2.9%—
FrontierMath Tier 4 (v1)—37.5%

Knowledge GPT-5.4 Pro leads

Claude Sonnet 5.5: 66.0 (#12), GPT-5.4 Pro: 68.3 (#7)

BenchmarkClaude Sonnet 5.5GPT-5.4 Pro
GPQA Diamond95.6%94.6%
SimpleQA Verified46.5%46.3%
Humanity's Last Exam—44.3%
Vectara Hallucination Rate—8.3%
LMArena Expert1540—

Multimodal Not comparable

Claude Sonnet 5.5: 51.5 (#6), GPT-5.4 Pro: —

BenchmarkClaude Sonnet 5.5GPT-5.4 Pro
LMArena Vision1289—
Furniture Assembly75%—

Multilingual Not comparable

Claude Sonnet 5.5: 55.3 (#30), GPT-5.4 Pro: —

BenchmarkClaude Sonnet 5.5GPT-5.4 Pro
LMArena Non-English1452—
LMArena Chinese1522—
LMArena Russian1451—

Instruction Following Not comparable

Claude Sonnet 5.5: 78.3 (#11), GPT-5.4 Pro: —

BenchmarkClaude Sonnet 5.5GPT-5.4 Pro
LMArena Instruction Following1495—

Long Context Not comparable

Claude Sonnet 5.5: 45.9 (#28), GPT-5.4 Pro: —

BenchmarkClaude Sonnet 5.5GPT-5.4 Pro
LMArena Longer Query1498—

Writing & Preference Not comparable

Claude Sonnet 5.5: 66.0 (#40), GPT-5.4 Pro: —

BenchmarkClaude Sonnet 5.5GPT-5.4 Pro
LMArena Text1471—
LMArena Creative Writing1465—
LMArena Multi-Turn1474—

Frequently asked questions

Is Claude Sonnet 5.5 better than GPT-5.4 Pro?

Claude Sonnet 5.5 is the stronger model overall, scoring 61.9 to 58.9 on the Noometry Index.

Which is cheaper, Claude Sonnet 5.5 or GPT-5.4 Pro?

Claude Sonnet 5.5 is cheaper. It lists at $2 per million input tokens and $10 per million output tokens; GPT-5.4 Pro lists at $30 and $180.

Is Claude Sonnet 5.5 or GPT-5.4 Pro better for coding?

Claude Sonnet 5.5 scores higher on coding benchmarks: 67.3 versus 43.2 in the Noometry coding category.

Which has the bigger context window?

GPT-5.4 Pro does, with 1.05M tokens against 1M.

How many benchmarks do Claude Sonnet 5.5 and GPT-5.4 Pro share?

6 benchmarks have published results for both models. Claude Sonnet 5.5 has 32 scored results on Noometry and GPT-5.4 Pro has 16.

Related comparisons

Go deeper