Model comparison

Chatgpt 4o Latest 20250326 vs o1-pro

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.8 to 31.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

Chatgpt 4o Latest 20250326 OpenAI

43.8

Rank #82 Confirmed

o1-pro OpenAI

31.5

Rank #271 Reported

Summary

  • The widest gap is in reasoning, where Chatgpt 4o Latest 20250326 leads 33.8 to 20.4.

Side by side

Chatgpt 4o Latest 20250326 and o1-pro specifications
Chatgpt 4o Latest 20250326o1-pro
ProviderOpenAIOpenAI
Noometry Index43.831.5
Released—2025-03-19
WeightsProprietaryProprietary
Context window—200K
Max output—100K
Input $ / M tokens—$150
Output $ / M tokens—$600
Results tracked213

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Chatgpt 4o Latest 20250326: 41.6 (#122), o1-pro: —

Coding benchmarks
BenchmarkChatgpt 4o Latest 20250326o1-pro
LMArena Coding1413—

Reasoning Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 33.8 (#71), o1-pro: 20.4 (#239)

Reasoning benchmarks
BenchmarkChatgpt 4o Latest 20250326o1-pro
Kagi LLM Benchmark75%—
ARC-AGI-1—23.3%
EnigmaEval—6.1%
LMArena Hard Prompts1424—

Math Not comparable

Chatgpt 4o Latest 20250326: 38.6 (#134), o1-pro: —

Math benchmarks
BenchmarkChatgpt 4o Latest 20250326o1-pro
LMArena Math1407—

Knowledge Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 39.2 (#137), o1-pro: 29.7 (#234)

Knowledge benchmarks
BenchmarkChatgpt 4o Latest 20250326o1-pro
Humanity's Last Exam—8.1%
Confabulations16.6%—
LMArena Expert1401—

Multimodal Not comparable

Chatgpt 4o Latest 20250326: 39.6 (#58), o1-pro: —

Multimodal benchmarks
BenchmarkChatgpt 4o Latest 20250326o1-pro
LMArena Vision1243—

Multilingual Not comparable

Chatgpt 4o Latest 20250326: 52.9 (#76), o1-pro: —

Multilingual benchmarks
BenchmarkChatgpt 4o Latest 20250326o1-pro
LMArena Non-English1419—
LMArena Chinese1457—
LMArena French1446—
LMArena German1423—
LMArena Japanese1405—
LMArena Korean1396—
LMArena Russian1429—
LMArena Spanish1434—

Instruction Following Not comparable

Chatgpt 4o Latest 20250326: 74.0 (#107), o1-pro: —

Instruction Following benchmarks
BenchmarkChatgpt 4o Latest 20250326o1-pro
LMArena Instruction Following1403—

Long Context Not comparable

Chatgpt 4o Latest 20250326: 43.1 (#107), o1-pro: —

Long Context benchmarks
BenchmarkChatgpt 4o Latest 20250326o1-pro
LMArena Longer Query1413—

Writing & Preference Not comparable

Chatgpt 4o Latest 20250326: 62.6 (#72), o1-pro: —

Writing & Preference benchmarks
BenchmarkChatgpt 4o Latest 20250326o1-pro
LMArena Text1429—
LMArena Creative Writing1405—
EQ-Bench Creative Writing1501—
LMArena Multi-Turn1454—

Frequently asked questions

Is Chatgpt 4o Latest 20250326 better than o1-pro?

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.8 to 31.5 on the Noometry Index.

How many benchmarks do Chatgpt 4o Latest 20250326 and o1-pro share?

0 benchmarks have published results for both models. Chatgpt 4o Latest 20250326 has 21 scored results on Noometry and o1-pro has 3.

Related comparisons

Go deeper