Noometry

Model comparison

Claude Opus 4.1 vs GPT-4

Claude Opus 4.1 is the stronger model overall, scoring 41.0 to 29.1 on the Noometry Index.

Last verified . 27 shared benchmarks.

Claude Opus 4.1 Anthropic

41.0

Rank #142 Confirmed

GPT-4 OpenAI

29.1

Rank #316 Confirmed

Summary

  • They share 27 benchmarks with published results for both. Claude Opus 4.1 scores higher in 8 categories and GPT-4 in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Claude Opus 4.1 leads 62.4 to 34.9.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 68.9% for Claude Opus 4.1 and 1.1% for GPT-4.
  • Claude Opus 4.1 is cheaper at $15 / $75 per million input/output tokens, against $30 / $60 for GPT-4.
  • Claude Opus 4.1 accepts more context: 200K tokens versus 8K.

Side by side

Claude Opus 4.1GPT-4
ProviderAnthropicOpenAI
Noometry Index41.029.1
Released2025-08-052023-03-14
WeightsProprietaryProprietary
Context window200K8K
Max output32K8K
Input $ / M tokens$15$30
Output $ / M tokens$75$60
Results tracked4838

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4.1 leads

Claude Opus 4.1: 44.4 (#73), GPT-4: 31.6 (#283)

BenchmarkClaude Opus 4.1GPT-4
WeirdML45.9%12.4%
LMArena Coding14791254
SWE-bench Verified73.3%—
LMArena WebDev1390—
BigCodeBench Instruct—46%
BigCodeBench Complete—57.2%
ALE-Bench674.77—
AlgoTune1.34—
HumanEval+—79.3%

Agentic & Tool Use Not comparable

Claude Opus 4.1: 35.0 (#41), GPT-4: —

BenchmarkClaude Opus 4.1GPT-4
METR Time Horizons66.8%36.1%
Terminal-Bench38%—
GDPval43.6%—
Cybench42%—
DeepResearch Bench48.3%—
LMArena Search1148—

Reasoning Claude Opus 4.1 leads

Claude Opus 4.1: 32.2 (#76), GPT-4: 17.8 (#289)

BenchmarkClaude Opus 4.1GPT-4
Chess Puzzles7%4%
LMArena Hard Prompts14431241
Mystery Game Puzzles21%12%
DTBench80%62.7%
LMCA37.1%17.1%
Epoch Capabilities Index144.12125.89
ForecastBench6257.8
SimpleBench60%—
EnigmaEval7.2%—
EBR-Bench7.9%—
BIG-Bench Hard—75.1%
HellaSwag—95.3%
WinoGrande—87.5%

Math Claude Opus 4.1 leads

Claude Opus 4.1: 22.3 (#277), GPT-4: 10.8 (#309)

BenchmarkClaude Opus 4.1GPT-4
OTIS Mock AIME 2024-202568.9%1.1%
LMArena Math14311269
FrontierMath (Tiers 1-3)12.6%—
FrontierMath Tier 42.4%—
MATH Level 5—23%
FrontierMath (Feb 2025 set)7.2%—
FrontierMath Tier 4 (v1)4.2%—
GSM8K—92%

Knowledge Claude Opus 4.1 leads

Claude Opus 4.1: 42.0 (#101), GPT-4: 18.4 (#282)

BenchmarkClaude Opus 4.1GPT-4
GPQA Diamond77.3%35.7%
LMArena Expert14391211
Humanity's Last Exam11.5%—
Confabulations17.1%—
Vectara Hallucination Rate11.8%—
MMLU—86.4%
TriviaQA—84.8%

Multimodal Not comparable

Claude Opus 4.1: 26.8 (#119), GPT-4: —

BenchmarkClaude Opus 4.1GPT-4
VPCT35%—

Multilingual Claude Opus 4.1 leads

Claude Opus 4.1: 52.0 (#95), GPT-4: 40.6 (#215)

BenchmarkClaude Opus 4.1GPT-4
LMArena Non-English14051246
LMArena Chinese14271242
LMArena French14311283
LMArena German14131251
LMArena Japanese13781209
LMArena Korean13801184
LMArena Russian14221251
LMArena Spanish14481261

Instruction Following Claude Opus 4.1 leads

Claude Opus 4.1: 75.6 (#58), GPT-4: 65.3 (#222)

BenchmarkClaude Opus 4.1GPT-4
LMArena Instruction Following14351241

Long Context Claude Opus 4.1 leads

Claude Opus 4.1: 44.5 (#63), GPT-4: 37.7 (#212)

BenchmarkClaude Opus 4.1GPT-4
LMArena Longer Query14551244

Writing & Preference Claude Opus 4.1 leads

Claude Opus 4.1: 62.4 (#74), GPT-4: 34.9 (#268)

BenchmarkClaude Opus 4.1GPT-4
LMArena Text14191263
LMArena Creative Writing14121244
LMArena Multi-Turn14441257
Short-Story Creative Writing84.7%—
EQ-Bench Creative Writing—752

Frequently asked questions

Is Claude Opus 4.1 better than GPT-4?

Claude Opus 4.1 is the stronger model overall, scoring 41.0 to 29.1 on the Noometry Index.

Which is cheaper, Claude Opus 4.1 or GPT-4?

Claude Opus 4.1 is cheaper. It lists at $15 per million input tokens and $75 per million output tokens; GPT-4 lists at $30 and $60.

Is Claude Opus 4.1 or GPT-4 better for coding?

Claude Opus 4.1 scores higher on coding benchmarks: 44.4 versus 31.6 in the Noometry coding category.

Which has the bigger context window?

Claude Opus 4.1 does, with 200K tokens against 8K.

How many benchmarks do Claude Opus 4.1 and GPT-4 share?

27 benchmarks have published results for both models. Claude Opus 4.1 has 48 scored results on Noometry and GPT-4 has 38.

Related comparisons

Go deeper