Model comparison

GPT-3.5-turbo vs o3-pro

o3-pro is the stronger model overall, scoring 42.7 to 23.1 on the Noometry Index. GPT-3.5-turbo costs 47× less per token, which makes it the better buy when o3-pro's lead doesn't matter for your workload.

Last verified . 4 shared benchmarks.

GPT-3.5-turbo OpenAI

23.1

Rank #345 Confirmed

o3-pro OpenAI

42.7

Rank #94 Confirmed

Summary

  • They share 4 benchmarks with published results for both. GPT-3.5-turbo scores higher in 0 categories and o3-pro in 5 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in long context, where o3-pro leads 72.1 to 34.0.
  • The biggest single-benchmark swing is WeirdML: 3.5% for GPT-3.5-turbo and 58.2% for o3-pro.
  • GPT-3.5-turbo is cheaper at $0.50 / $1.50 per million input/output tokens, against $20 / $80 for o3-pro.
  • o3-pro accepts more context: 200K tokens versus 16K.

Side by side

GPT-3.5-turbo and o3-pro specifications
GPT-3.5-turboo3-pro
ProviderOpenAIOpenAI
Noometry Index23.142.7
Released2023-03-012025-06-10
WeightsProprietaryProprietary
Context window16K200K
Max output4K100K
Input $ / M tokens$0.50$20
Output $ / M tokens$1.50$80
Results tracked4412

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding o3-pro leads

GPT-3.5-turbo: 23.5 (#326), o3-pro: 55.1 (#22)

Coding benchmarks
BenchmarkGPT-3.5-turboo3-pro
WeirdML3.5%58.2%
Aider Polyglot—84.9%
BigCodeBench Instruct39.1%—
LMArena Coding1137—
BigCodeBench Complete50.6%—
HumanEval+70.7%—
MBPP+69.7%—

Agentic & Tool Use Not comparable

GPT-3.5-turbo: —, o3-pro: —

Agentic & Tool Use benchmarks
BenchmarkGPT-3.5-turboo3-pro
METR Time Horizons21.5%—

Reasoning o3-pro leads

GPT-3.5-turbo: 13.3 (#328), o3-pro: 24.1 (#152)

Reasoning benchmarks
BenchmarkGPT-3.5-turboo3-pro
DTBench48.5%86.9%
LMCA9.7%38.5%
Epoch Capabilities Index118.48147.43
ARC-AGI-2—4.9%
Kagi LLM Benchmark—72.1%
ARC-AGI-1—59.3%
Chess Puzzles0%—
LMArena Hard Prompts1108—
Mystery Game Puzzles3%—
Adversarial NLI58.1%—
BIG-Bench Hard61.6%—
CommonsenseQA 2.057%—
ForecastBench50.4—
WinoGrande81.6%—

Math Not comparable

GPT-3.5-turbo: 6.0 (#321), o3-pro: —

Math benchmarks
BenchmarkGPT-3.5-turboo3-pro
FrontierMath (Tiers 1-3)0%—
OTIS Mock AIME 2024-20252.2%—
LMArena Math1142—
MATH Level 515.9%—
GSM8K57.8%—

Knowledge o3-pro leads

GPT-3.5-turbo: 10.0 (#298), o3-pro: 29.0 (#234)

Knowledge benchmarks
BenchmarkGPT-3.5-turboo3-pro
GPQA Diamond28%—
Confabulations—14.2%
Vectara Hallucination Rate—23.3%
LMArena Expert1070—
ARC (AI2) Challenge87.4%—
BoolQ87%—
MMLU71.4%—
OpenBookQA86%—
TriviaQA85.8%—

Multilingual Not comparable

GPT-3.5-turbo: 31.6 (#253), o3-pro: —

Multilingual benchmarks
BenchmarkGPT-3.5-turboo3-pro
LMArena Non-English1108—
LMArena Chinese1075—
LMArena French1117—
LMArena German1090—
LMArena Japanese1043—
LMArena Korean1019—
LMArena Russian1123—
LMArena Spanish1120—

Instruction Following Not comparable

GPT-3.5-turbo: 58.1 (#257), o3-pro: —

Instruction Following benchmarks
BenchmarkGPT-3.5-turboo3-pro
LMArena Instruction Following1119—

Long Context o3-pro leads

GPT-3.5-turbo: 34.0 (#249), o3-pro: 72.1 (#1)

Long Context benchmarks
BenchmarkGPT-3.5-turboo3-pro
Fiction.LiveBench—97.2%
LMArena Longer Query1121—

Writing & Preference o3-pro leads

GPT-3.5-turbo: 25.4 (#300), o3-pro: 57.1 (#128)

Writing & Preference benchmarks
BenchmarkGPT-3.5-turboo3-pro
LMArena Text1125—
LMArena Creative Writing1092—
Short-Story Creative Writing—84.4%
EQ-Bench Creative Writing451—
LMArena Multi-Turn1117—

Frequently asked questions

Is GPT-3.5-turbo better than o3-pro?

o3-pro is the stronger model overall, scoring 42.7 to 23.1 on the Noometry Index. GPT-3.5-turbo costs 47× less per token, which makes it the better buy when o3-pro's lead doesn't matter for your workload.

Which is cheaper, GPT-3.5-turbo or o3-pro?

GPT-3.5-turbo is cheaper. It lists at $0.50 per million input tokens and $1.50 per million output tokens; o3-pro lists at $20 and $80.

Is GPT-3.5-turbo or o3-pro better for coding?

o3-pro scores higher on coding benchmarks: 55.1 versus 23.5 in the Noometry coding category.

Which has the bigger context window?

o3-pro does, with 200K tokens against 16K.

How many benchmarks do GPT-3.5-turbo and o3-pro share?

4 benchmarks have published results for both models. GPT-3.5-turbo has 44 scored results on Noometry and o3-pro has 12.

Related comparisons

Go deeper