Noometry

Model comparison

Claude 3 Sonnet vs GPT-5.4 Pro

GPT-5.4 Pro is the stronger model overall, scoring 58.8 to 28.8 on the Noometry Index.

Last verified . 3 shared benchmarks.

Claude 3 Sonnet Anthropic

28.8

Rank #311 Confirmed

GPT-5.4 Pro OpenAI

58.8

Rank #16 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Claude 3 Sonnet scores higher in 0 categories and GPT-5.4 Pro in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.4 Pro leads 72.0 to 10.0.
  • The biggest single-benchmark swing is GPQA Diamond: 40.6% for Claude 3 Sonnet and 94.6% for GPT-5.4 Pro.

Side by side

Claude 3 SonnetGPT-5.4 Pro
ProviderAnthropicOpenAI
Noometry Index28.858.8
Released2024-02-292026-03-05
WeightsProprietaryProprietary
Context window—1.05M
Max output—128K
Input $ / M tokens—$30
Output $ / M tokens—$180
Results tracked3016

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.4 Pro leads

Claude 3 Sonnet: 29.2 (#296), GPT-5.4 Pro: 42.6 (#89)

BenchmarkClaude 3 SonnetGPT-5.4 Pro
WeirdML10.2%57.4%
BigCodeBench Instruct42.7%—
LMArena Coding1223—
BigCodeBench Complete53.8%—
HumanEval+64%—
MBPP+69.3%—

Reasoning GPT-5.4 Pro leads

Claude 3 Sonnet: 19.7 (#232), GPT-5.4 Pro: 71.0 (#10)

BenchmarkClaude 3 SonnetGPT-5.4 Pro
Epoch Capabilities Index120.69159.12
ARC-AGI-2—83.3%
SimpleBench—74.1%
ARC-AGI-1—94.5%
CritPt—30%
Chess Puzzles—58.6%
EnigmaEval—23.8%
LMArena Hard Prompts1197—
DTBench53.6%—
WinoGrande75.1%—

Math GPT-5.4 Pro leads

Claude 3 Sonnet: 10.0 (#305), GPT-5.4 Pro: 72.0 (#17)

BenchmarkClaude 3 SonnetGPT-5.4 Pro
FrontierMath (Tiers 1-3)—82.5%
FrontierMath Tier 4—58.5%
OTIS Mock AIME 2024-20252.5%—
LMArena Math1213—
MATH Level 518.2%—
FrontierMath (Feb 2025 set)—50%
FrontierMath Tier 4 (v1)—37.5%

Knowledge GPT-5.4 Pro leads

Claude 3 Sonnet: 21.1 (#271), GPT-5.4 Pro: 68.3 (#6)

BenchmarkClaude 3 SonnetGPT-5.4 Pro
GPQA Diamond40.6%94.6%
Humanity's Last Exam—44.3%
SimpleQA Verified—46.3%
Vectara Hallucination Rate—8.3%
LMArena Expert1173—
MMLU75.9%—

Multimodal Not comparable

Claude 3 Sonnet: 24.7 (#120), GPT-5.4 Pro: —

BenchmarkClaude 3 SonnetGPT-5.4 Pro
LMArena Vision984—

Multilingual Not comparable

Claude 3 Sonnet: 38.0 (#229), GPT-5.4 Pro: —

BenchmarkClaude 3 SonnetGPT-5.4 Pro
LMArena Non-English1205—
LMArena Chinese1188—
LMArena French1228—
LMArena German1204—
LMArena Japanese1131—
LMArena Korean1128—
LMArena Russian1227—
LMArena Spanish1204—

Instruction Following Not comparable

Claude 3 Sonnet: 63.1 (#230), GPT-5.4 Pro: —

BenchmarkClaude 3 SonnetGPT-5.4 Pro
LMArena Instruction Following1200—

Long Context Not comparable

Claude 3 Sonnet: 36.7 (#223), GPT-5.4 Pro: —

BenchmarkClaude 3 SonnetGPT-5.4 Pro
LMArena Longer Query1211—

Writing & Preference Not comparable

Claude 3 Sonnet: 42.3 (#233), GPT-5.4 Pro: —

BenchmarkClaude 3 SonnetGPT-5.4 Pro
LMArena Text1218—
LMArena Creative Writing1186—
LMArena Multi-Turn1227—

Frequently asked questions

Is Claude 3 Sonnet better than GPT-5.4 Pro?

GPT-5.4 Pro is the stronger model overall, scoring 58.8 to 28.8 on the Noometry Index.

Is Claude 3 Sonnet or GPT-5.4 Pro better for coding?

GPT-5.4 Pro scores higher on coding benchmarks: 42.6 versus 29.2 in the Noometry coding category.

How many benchmarks do Claude 3 Sonnet and GPT-5.4 Pro share?

3 benchmarks have published results for both models. Claude 3 Sonnet has 30 scored results on Noometry and GPT-5.4 Pro has 16.

Related comparisons

Go deeper