Noometry

Model comparison

Claude Opus 4.1 vs GPT-4o

Claude Opus 4.1 is the stronger model overall, scoring 41.0 to 28.6 on the Noometry Index. GPT-4o costs 6.9× less per token, which makes it the better buy when Claude Opus 4.1's lead doesn't matter for your workload.

Last verified . 39 shared benchmarks.

Claude Opus 4.1 Anthropic

41.0

Rank #142 Confirmed

GPT-4o OpenAI

28.6

Rank #324 Confirmed

Summary

  • They share 39 benchmarks with published results for both. Claude Opus 4.1 scores higher in 9 categories and GPT-4o in 1 category; 10 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Claude Opus 4.1 leads 32.2 to 9.4.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 68.9% for Claude Opus 4.1 and 6.4% for GPT-4o.
  • GPT-4o is cheaper at $2.50 / $10 per million input/output tokens, against $15 / $75 for Claude Opus 4.1.
  • Claude Opus 4.1 accepts more context: 200K tokens versus 128K.

Side by side

Claude Opus 4.1GPT-4o
ProviderAnthropicOpenAI
Noometry Index41.028.6
Released2025-08-052024-05-13
WeightsProprietaryProprietary
Context window200K128K
Max output32K16K
Input $ / M tokens$15$2.50
Output $ / M tokens$75$10
Results tracked4872

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4.1 leads

Claude Opus 4.1: 44.4 (#73), GPT-4o: 24.8 (#328)

BenchmarkClaude Opus 4.1GPT-4o
SWE-bench Verified73.3%31%
WeirdML45.9%25.1%
LMArena Coding14791297
SWE-bench Verified (bash only)—21.6%
Aider Polyglot—45.3%
LMArena WebDev1390—
GSO—0%
BigCodeBench Instruct—51.1%
LiveBench Coding—51.4%
BigCodeBench Complete—61.1%
CadEval—26%
ALE-Bench674.77—
AlgoTune1.34—
HumanEval+—87.2%
MBPP+—72.2%

Agentic & Tool Use Claude Opus 4.1 leads

Claude Opus 4.1: 35.0 (#41), GPT-4o: 21.0 (#141)

BenchmarkClaude Opus 4.1GPT-4o
GDPval43.6%9.9%
Cybench42%12.5%
LMArena Search11481006
METR Time Horizons66.8%40.8%
Terminal-Bench38%—
TheAgentCompany—8.6%
DeepResearch Bench48.3%—
BALROG—32.3%

Reasoning Claude Opus 4.1 leads

Claude Opus 4.1: 32.2 (#76), GPT-4o: 9.4 (#343)

BenchmarkClaude Opus 4.1GPT-4o
SimpleBench60%17.8%
Chess Puzzles7%13%
EnigmaEval7.2%0.8%
LMArena Hard Prompts14431281
DTBench80%64.5%
LMCA37.1%16.6%
Epoch Capabilities Index144.12128.97
ForecastBench6257.7
ARC-AGI-2—0%
ARC-AGI-1—4.5%
CritPt—0%
EBR-Bench7.9%—
LiveBench Reasoning—55.8%
Mystery Game Puzzles21%—
LiveBench Data Analysis—60.9%
LiveBench—55.3%

Math Claude Opus 4.1 leads

Claude Opus 4.1: 22.3 (#277), GPT-4o: 10.6 (#312)

BenchmarkClaude Opus 4.1GPT-4o
FrontierMath (Tiers 1-3)12.6%0.4%
OTIS Mock AIME 2024-202568.9%6.4%
LMArena Math14311285
FrontierMath (Feb 2025 set)7.2%0.3%
FrontierMath Tier 42.4%—
Omni-MATH—29.3%
LiveBench Math—49.5%
MATH Level 5—53.3%
FrontierMath Tier 4 (v1)4.2%—

Knowledge Claude Opus 4.1 leads

Claude Opus 4.1: 42.0 (#101), GPT-4o: 28.8 (#242)

BenchmarkClaude Opus 4.1GPT-4o
GPQA Diamond77.3%49.2%
Humanity's Last Exam11.5%2.7%
Confabulations17.1%15.3%
Vectara Hallucination Rate11.8%9.6%
LMArena Expert14391250
SimpleQA Verified—26%
MMLU-Pro—71.3%
GPQA (HELM)—52%
MMLU—88.1%

Multimodal GPT-4o leads

Claude Opus 4.1: 26.8 (#119), GPT-4o: 34.5 (#91)

BenchmarkClaude Opus 4.1GPT-4o
VPCT35%40%
LMArena Vision—1137
Video-MME—71.9%
GeoBench—71%
ScienceQA—88.5%

Multilingual Claude Opus 4.1 leads

Claude Opus 4.1: 52.0 (#95), GPT-4o: 43.2 (#186)

BenchmarkClaude Opus 4.1GPT-4o
LMArena Non-English14051283
LMArena Chinese14271277
LMArena French14311304
LMArena German14131282
LMArena Japanese13781257
LMArena Korean13801234
LMArena Russian14221286
LMArena Spanish14481292

Instruction Following Claude Opus 4.1 leads

Claude Opus 4.1: 75.6 (#58), GPT-4o: 66.6 (#207)

BenchmarkClaude Opus 4.1GPT-4o
LMArena Instruction Following14351278
LiveBench Instruction Following—68.6%
IFEval—81.7%

Long Context Claude Opus 4.1 leads

Claude Opus 4.1: 44.5 (#63), GPT-4o: 39.4 (#179)

BenchmarkClaude Opus 4.1GPT-4o
LMArena Longer Query14551289
Fiction.LiveBench—66.7%

Writing & Preference Claude Opus 4.1 leads

Claude Opus 4.1: 62.4 (#74), GPT-4o: 52.6 (#166)

BenchmarkClaude Opus 4.1GPT-4o
LMArena Text14191300
LMArena Creative Writing14121292
Short-Story Creative Writing84.7%81.8%
LMArena Multi-Turn14441302
WildBench—82.8%
LiveBench Language—47.6%

Frequently asked questions

Is Claude Opus 4.1 better than GPT-4o?

Claude Opus 4.1 is the stronger model overall, scoring 41.0 to 28.6 on the Noometry Index. GPT-4o costs 6.9× less per token, which makes it the better buy when Claude Opus 4.1's lead doesn't matter for your workload.

Which is cheaper, Claude Opus 4.1 or GPT-4o?

GPT-4o is cheaper. It lists at $2.50 per million input tokens and $10 per million output tokens; Claude Opus 4.1 lists at $15 and $75.

Is Claude Opus 4.1 or GPT-4o better for coding?

Claude Opus 4.1 scores higher on coding benchmarks: 44.4 versus 24.8 in the Noometry coding category.

Which has the bigger context window?

Claude Opus 4.1 does, with 200K tokens against 128K.

How many benchmarks do Claude Opus 4.1 and GPT-4o share?

39 benchmarks have published results for both models. Claude Opus 4.1 has 48 scored results on Noometry and GPT-4o has 72.

Related comparisons

Go deeper