Model comparison

Chatgpt 4o Latest 20250326 vs Claude Opus 4.1

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.2 to 40.8 on the Noometry Index.

Last verified . 18 shared benchmarks.

Chatgpt 4o Latest 20250326 OpenAI

43.2

Rank #84 Confirmed

Claude Opus 4.1 Anthropic

40.8

Rank #136 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Chatgpt 4o Latest 20250326 scores higher in 5 categories and Claude Opus 4.1 in 4 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Chatgpt 4o Latest 20250326 leads 35.8 to 22.0.

Side by side

Chatgpt 4o Latest 20250326 and Claude Opus 4.1 specifications
Chatgpt 4o Latest 20250326Claude Opus 4.1
ProviderOpenAIAnthropic
Noometry Index43.240.8
Released—2025-08-05
WeightsProprietaryProprietary
Context window—200K
Max output—32K
Input $ / M tokens—$15
Output $ / M tokens—$75
Results tracked2148

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4.1 leads

Chatgpt 4o Latest 20250326: 41.0 (#122), Claude Opus 4.1: 44.3 (#69)

Coding benchmarks
BenchmarkChatgpt 4o Latest 20250326Claude Opus 4.1
LMArena Coding14131479
SWE-bench Verified—73.3%
LMArena WebDev—1390
WeirdML—45.9%
ALE-Bench—674.77
AlgoTune—1.34

Agentic & Tool Use Not comparable

Chatgpt 4o Latest 20250326: —, Claude Opus 4.1: 34.8 (#38)

Agentic & Tool Use benchmarks
BenchmarkChatgpt 4o Latest 20250326Claude Opus 4.1
Terminal-Bench—38%
GDPval—43.6%
Cybench—42%
DeepResearch Bench—48.3%
LMArena Search—1148
METR Time Horizons—66.8%

Reasoning Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 32.8 (#64), Claude Opus 4.1: 31.6 (#70)

Reasoning benchmarks
BenchmarkChatgpt 4o Latest 20250326Claude Opus 4.1
LMArena Hard Prompts14241443
SimpleBench—60%
Kagi LLM Benchmark75%—
Chess Puzzles—7%
EnigmaEval—7.2%
EBR-Bench—7.9%
Mystery Game Puzzles—21%
DTBench—80%
LMCA—37.1%
Epoch Capabilities Index—144.11
ForecastBench—62

Math Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 35.8 (#134), Claude Opus 4.1: 22.0 (#267)

Math benchmarks
BenchmarkChatgpt 4o Latest 20250326Claude Opus 4.1
LMArena Math14071430
FrontierMath (Tiers 1-3)—12.6%
FrontierMath Tier 4—2.4%
OTIS Mock AIME 2024-2025—68.9%
FrontierMath (Feb 2025 set)—7.2%
FrontierMath Tier 4 (v1)—4.2%

Knowledge Claude Opus 4.1 leads

Chatgpt 4o Latest 20250326: 38.7 (#131), Claude Opus 4.1: 41.9 (#93)

Knowledge benchmarks
BenchmarkChatgpt 4o Latest 20250326Claude Opus 4.1
Confabulations16.6%17.1%
LMArena Expert14001439
GPQA Diamond—77.3%
Humanity's Last Exam—11.5%
Vectara Hallucination Rate—11.8%

Multimodal Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 38.9 (#54), Claude Opus 4.1: 26.2 (#114)

Multimodal benchmarks
BenchmarkChatgpt 4o Latest 20250326Claude Opus 4.1
LMArena Vision1243—
VPCT—35%

Multilingual Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 53.1 (#72), Claude Opus 4.1: 52.1 (#90)

Multilingual benchmarks
BenchmarkChatgpt 4o Latest 20250326Claude Opus 4.1
LMArena Non-English14191405
LMArena Chinese14561427
LMArena French14471432
LMArena German14241412
LMArena Japanese14061378
LMArena Korean13971381
LMArena Russian14291421
LMArena Spanish14351448

Instruction Following Claude Opus 4.1 leads

Chatgpt 4o Latest 20250326: 74.2 (#102), Claude Opus 4.1: 75.8 (#53)

Instruction Following benchmarks
BenchmarkChatgpt 4o Latest 20250326Claude Opus 4.1
LMArena Instruction Following14031436

Long Context Claude Opus 4.1 leads

Chatgpt 4o Latest 20250326: 43.1 (#104), Claude Opus 4.1: 44.5 (#60)

Long Context benchmarks
BenchmarkChatgpt 4o Latest 20250326Claude Opus 4.1
LMArena Longer Query14131455

Writing & Preference Too close to call

Chatgpt 4o Latest 20250326: 62.8 (#68), Claude Opus 4.1: 62.6 (#70)

Writing & Preference benchmarks
BenchmarkChatgpt 4o Latest 20250326Claude Opus 4.1
LMArena Text14291419
LMArena Creative Writing14061412
LMArena Multi-Turn14541444
Short-Story Creative Writing—84.7%
EQ-Bench Creative Writing1501—

Frequently asked questions

Is Chatgpt 4o Latest 20250326 better than Claude Opus 4.1?

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.2 to 40.8 on the Noometry Index.

Is Chatgpt 4o Latest 20250326 or Claude Opus 4.1 better for coding?

Claude Opus 4.1 scores higher on coding benchmarks: 44.3 versus 41.0 in the Noometry coding category.

How many benchmarks do Chatgpt 4o Latest 20250326 and Claude Opus 4.1 share?

18 benchmarks have published results for both models. Chatgpt 4o Latest 20250326 has 21 scored results on Noometry and Claude Opus 4.1 has 48.

Related comparisons

Go deeper