Noometry

Model comparison

Claude 3 Sonnet vs GPT-4.1 mini

GPT-4.1 mini is the stronger model overall, scoring 33.6 to 29.0 on the Noometry Index.

Last verified . 25 shared benchmarks.

Claude 3 Sonnet Anthropic

29.0

Rank #319 Confirmed

GPT-4.1 mini OpenAI

33.6

Rank #240 Confirmed

Summary

  • They share 25 benchmarks with published results for both. Claude 3 Sonnet scores higher in 2 categories and GPT-4.1 mini in 7 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GPT-4.1 mini leads 34.7 to 21.1.
  • The biggest single-benchmark swing is MATH Level 5: 18.2% for Claude 3 Sonnet and 87.3% for GPT-4.1 mini.

Side by side

Claude 3 SonnetGPT-4.1 mini
ProviderAnthropicOpenAI
Noometry Index29.033.6
Released2024-02-292025-04-14
WeightsProprietaryProprietary
Context window—1.05M
Max output—33K
Input $ / M tokens—$0.40
Output $ / M tokens—$1.60
Results tracked3047

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-4.1 mini leads

Claude 3 Sonnet: 29.6 (#302), GPT-4.1 mini: 30.6 (#293)

BenchmarkClaude 3 SonnetGPT-4.1 mini
WeirdML10.2%37.6%
BigCodeBench Instruct42.7%48.9%
LMArena Coding12231367
SWE-bench Verified (bash only)—23.9%
Aider Polyglot—32.4%
SciCode—40.4%
BigCodeBench Complete53.8%—
CadEval—16%
HumanEval+64%—
MBPP+69.3%—

Agentic & Tool Use Not comparable

Claude 3 Sonnet: —, GPT-4.1 mini: 33.3 (#55)

BenchmarkClaude 3 SonnetGPT-4.1 mini
Berkeley Function Calling Leaderboard—50.5%

Reasoning Claude 3 Sonnet leads

Claude 3 Sonnet: 20.5 (#237), GPT-4.1 mini: 10.8 (#340)

BenchmarkClaude 3 SonnetGPT-4.1 mini
LMArena Hard Prompts11971349
DTBench53.6%68.8%
Epoch Capabilities Index120.7135.01
ARC-AGI-2—0%
Kagi LLM Benchmark—48.6%
ARC-AGI-1—3.5%
CritPt—0%
Chess Puzzles—7%
Mystery Game Puzzles—7%
LMCA—21.1%
WinoGrande75.1%—

Math GPT-4.1 mini leads

Claude 3 Sonnet: 10.7 (#310), GPT-4.1 mini: 24.1 (#270)

BenchmarkClaude 3 SonnetGPT-4.1 mini
OTIS Mock AIME 2024-20252.5%44.7%
LMArena Math12131343
MATH Level 518.2%87.3%
FrontierMath (Tiers 1-3)—6.7%
Omni-MATH—49.1%
FrontierMath (Feb 2025 set)—4.5%

Knowledge GPT-4.1 mini leads

Claude 3 Sonnet: 21.1 (#276), GPT-4.1 mini: 34.7 (#194)

BenchmarkClaude 3 SonnetGPT-4.1 mini
GPQA Diamond40.6%65.8%
LMArena Expert11731338
SimpleQA Verified—12.7%
MMLU-Pro—78.3%
GPQA (HELM)—61.4%
MMLU75.9%—

Multimodal GPT-4.1 mini leads

Claude 3 Sonnet: 25.2 (#125), GPT-4.1 mini: 35.8 (#82)

BenchmarkClaude 3 SonnetGPT-4.1 mini
LMArena Vision9841181

Multilingual GPT-4.1 mini leads

Claude 3 Sonnet: 37.8 (#234), GPT-4.1 mini: 45.7 (#166)

BenchmarkClaude 3 SonnetGPT-4.1 mini
LMArena Non-English12051318
LMArena Chinese11891329
LMArena French12291358
LMArena German12041351
LMArena Japanese11311290
LMArena Korean11281298
LMArena Russian12271324
LMArena Spanish12041319

Instruction Following GPT-4.1 mini leads

Claude 3 Sonnet: 62.8 (#235), GPT-4.1 mini: 73.7 (#118)

BenchmarkClaude 3 SonnetGPT-4.1 mini
LMArena Instruction Following11991333
IFEval—90.4%

Long Context Claude 3 Sonnet leads

Claude 3 Sonnet: 36.7 (#228), GPT-4.1 mini: 31.8 (#275)

BenchmarkClaude 3 SonnetGPT-4.1 mini
LMArena Longer Query12111344
Fiction.LiveBench—44.4%

Writing & Preference GPT-4.1 mini leads

Claude 3 Sonnet: 42.1 (#238), GPT-4.1 mini: 48.6 (#199)

BenchmarkClaude 3 SonnetGPT-4.1 mini
LMArena Text12181340
LMArena Creative Writing11861300
LMArena Multi-Turn12271354
EQ-Bench Creative Writing—1147
WildBench—83.8%

Frequently asked questions

Is Claude 3 Sonnet better than GPT-4.1 mini?

GPT-4.1 mini is the stronger model overall, scoring 33.6 to 29.0 on the Noometry Index.

Is Claude 3 Sonnet or GPT-4.1 mini better for coding?

GPT-4.1 mini scores higher on coding benchmarks: 30.6 versus 29.6 in the Noometry coding category.

How many benchmarks do Claude 3 Sonnet and GPT-4.1 mini share?

25 benchmarks have published results for both models. Claude 3 Sonnet has 30 scored results on Noometry and GPT-4.1 mini has 47.

Related comparisons

Go deeper