Model comparison

GPT-4 Turbo vs o3-pro

o3-pro is the stronger model overall, scoring 42.9 to 30.5 on the Noometry Index. GPT-4 Turbo costs 2.3× less per token, which makes it the better buy when o3-pro's lead doesn't matter for your workload.

Last verified . 5 shared benchmarks.

GPT-4 Turbo OpenAI

30.5

Rank #292 Confirmed

o3-pro OpenAI

42.9

Rank #105 Confirmed

Summary

  • They share 5 benchmarks with published results for both. GPT-4 Turbo scores higher in 0 categories and o3-pro in 5 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in long context, where o3-pro leads 72.2 to 38.0.
  • The biggest single-benchmark swing is WeirdML: 18% for GPT-4 Turbo and 58.2% for o3-pro.
  • GPT-4 Turbo is cheaper at $10 / $30 per million input/output tokens, against $20 / $80 for o3-pro.
  • o3-pro accepts more context: 200K tokens versus 128K.

Side by side

GPT-4 Turbo and o3-pro specifications
GPT-4 Turboo3-pro
ProviderOpenAIOpenAI
Noometry Index30.542.9
Released2023-11-062025-06-10
WeightsProprietaryProprietary
Context window128K200K
Max output4K100K
Input $ / M tokens$10$20
Output $ / M tokens$30$80
Results tracked3612

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding o3-pro leads

GPT-4 Turbo: 33.8 (#249), o3-pro: 55.5 (#24)

Coding benchmarks
BenchmarkGPT-4 Turboo3-pro
WeirdML18%58.2%
Aider Polyglot—84.9%
BigCodeBench Instruct48.2%—
LMArena Coding1268—
BigCodeBench Complete58.2%—
HumanEval+86.6%—
MBPP+73.3%—

Agentic & Tool Use Not comparable

GPT-4 Turbo: —, o3-pro: —

Agentic & Tool Use benchmarks
BenchmarkGPT-4 Turboo3-pro
METR Time Horizons36.7%—

Reasoning o3-pro leads

GPT-4 Turbo: 15.3 (#317), o3-pro: 23.8 (#171)

Reasoning benchmarks
BenchmarkGPT-4 Turboo3-pro
DTBench61.6%86.9%
LMCA9.8%38.5%
Epoch Capabilities Index127.25147.42
ARC-AGI-2—4.9%
SimpleBench25.1%—
Kagi LLM Benchmark—72.1%
ARC-AGI-1—59.3%
Chess Puzzles6%—
LMArena Hard Prompts1251—
ForecastBench59.4—

Math Not comparable

GPT-4 Turbo: 9.0 (#322), o3-pro: —

Math benchmarks
BenchmarkGPT-4 Turboo3-pro
FrontierMath (Tiers 1-3)0.7%—
OTIS Mock AIME 2024-20256.7%—
LMArena Math1272—
MATH Level 546.7%—

Knowledge o3-pro leads

GPT-4 Turbo: 24.3 (#268), o3-pro: 29.5 (#238)

Knowledge benchmarks
BenchmarkGPT-4 Turboo3-pro
Confabulations28.4%14.2%
GPQA Diamond46.6%—
Vectara Hallucination Rate—23.3%
LMArena Expert1223—
MMLU81.3%—

Multimodal Not comparable

GPT-4 Turbo: 30.6 (#110), o3-pro: —

Multimodal benchmarks
BenchmarkGPT-4 Turboo3-pro
LMArena Vision1090—

Multilingual Not comparable

GPT-4 Turbo: 40.5 (#216), o3-pro: —

Multilingual benchmarks
BenchmarkGPT-4 Turboo3-pro
LMArena Non-English1245—
LMArena Chinese1242—
LMArena French1276—
LMArena German1259—
LMArena Japanese1194—
LMArena Korean1187—
LMArena Russian1259—
LMArena Spanish1260—

Instruction Following Not comparable

GPT-4 Turbo: 65.8 (#216), o3-pro: —

Instruction Following benchmarks
BenchmarkGPT-4 Turboo3-pro
LMArena Instruction Following1249—

Long Context o3-pro leads

GPT-4 Turbo: 38.0 (#206), o3-pro: 72.2 (#1)

Long Context benchmarks
BenchmarkGPT-4 Turboo3-pro
Fiction.LiveBench—97.2%
LMArena Longer Query1254—

Writing & Preference o3-pro leads

GPT-4 Turbo: 47.7 (#206), o3-pro: 57.1 (#133)

Writing & Preference benchmarks
BenchmarkGPT-4 Turboo3-pro
LMArena Text1272—
LMArena Creative Writing1269—
Short-Story Creative Writing—84.4%
LMArena Multi-Turn1267—

Frequently asked questions

Is GPT-4 Turbo better than o3-pro?

o3-pro is the stronger model overall, scoring 42.9 to 30.5 on the Noometry Index. GPT-4 Turbo costs 2.3× less per token, which makes it the better buy when o3-pro's lead doesn't matter for your workload.

Which is cheaper, GPT-4 Turbo or o3-pro?

GPT-4 Turbo is cheaper. It lists at $10 per million input tokens and $30 per million output tokens; o3-pro lists at $20 and $80.

Is GPT-4 Turbo or o3-pro better for coding?

o3-pro scores higher on coding benchmarks: 55.5 versus 33.8 in the Noometry coding category.

Which has the bigger context window?

o3-pro does, with 200K tokens against 128K.

How many benchmarks do GPT-4 Turbo and o3-pro share?

5 benchmarks have published results for both models. GPT-4 Turbo has 36 scored results on Noometry and o3-pro has 12.

Related comparisons

Go deeper