Model comparison

GPT-4o mini vs GPT-5 Pro

GPT-5 Pro is the stronger model overall, scoring 46.4 to 25.5 on the Noometry Index. GPT-4o mini costs 157× less per token, which makes it the better buy when GPT-5 Pro's lead doesn't matter for your workload.

Last verified . 6 shared benchmarks.

GPT-4o mini OpenAI

25.5

Rank #343 Confirmed

GPT-5 Pro OpenAI

46.4

Rank #64 Confirmed

Summary

  • They share 6 benchmarks with published results for both. GPT-4o mini scores higher in 0 categories and GPT-5 Pro in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GPT-5 Pro leads 56.7 to 17.7.
  • The biggest single-benchmark swing is FrontierMath (Tiers 1-3): 0.7% for GPT-4o mini and 55.8% for GPT-5 Pro.
  • GPT-4o mini is cheaper at $0.15 / $0.60 per million input/output tokens, against $15 / $120 for GPT-5 Pro.
  • GPT-5 Pro accepts more context: 400K tokens versus 128K.

Side by side

GPT-4o mini and GPT-5 Pro specifications
GPT-4o miniGPT-5 Pro
ProviderOpenAIOpenAI
Noometry Index25.546.4
Released2024-07-182025-10-06
WeightsProprietaryProprietary
Context window128K400K
Max output16K272K
Input $ / M tokens$0.15$15
Output $ / M tokens$0.60$120
Results tracked6012

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5 Pro leads

GPT-4o mini: 22.0 (#335), GPT-5 Pro: 44.0 (#80)

Coding benchmarks
BenchmarkGPT-4o miniGPT-5 Pro
WeirdML11.8%60.4%
Aider Polyglot3.6%—
BigCodeBench Instruct46.1%—
LiveBench Coding43.1%—
LMArena Coding1290—
BigCodeBench Complete57.4%—
AlgoTune—1.31
HumanEval+83.5%—
MBPP+72.2%—

Agentic & Tool Use Not comparable

GPT-4o mini: 27.5 (#101), GPT-5 Pro: —

Agentic & Tool Use benchmarks
BenchmarkGPT-4o miniGPT-5 Pro
BALROG17.4%—

Reasoning GPT-5 Pro leads

GPT-4o mini: 8.7 (#347), GPT-5 Pro: 38.9 (#62)

Reasoning benchmarks
BenchmarkGPT-4o miniGPT-5 Pro
ARC-AGI-20%18.3%
SimpleBench10.7%61.6%
Kagi LLM Benchmark28.8%76.8%
Epoch Capabilities Index126.56150.28
ARC-AGI-1—70.2%
Chess Puzzles0%—
EnigmaEval—18.8%
LiveBench Reasoning32.8%—
LMArena Hard Prompts1267—
Mystery Game Puzzles12%—
DTBench54.4%—
LiveBench Data Analysis50%—
LMCA10.4%—
LiveBench41.3%—
PIQA88.7%—

Math GPT-5 Pro leads

GPT-4o mini: 10.4 (#314), GPT-5 Pro: 48.5 (#63)

Math benchmarks
BenchmarkGPT-4o miniGPT-5 Pro
FrontierMath (Tiers 1-3)0.7%55.8%
FrontierMath Tier 4—19.5%
OTIS Mock AIME 2024-20256.9%—
Omni-MATH28%—
LiveBench Math36.3%—
LMArena Math1267—
MATH Level 552.6%—
FrontierMath Tier 4 (v1)—14.6%
GSM8K91.3%—

Knowledge GPT-5 Pro leads

GPT-4o mini: 17.7 (#284), GPT-5 Pro: 56.7 (#42)

Knowledge benchmarks
BenchmarkGPT-4o miniGPT-5 Pro
GPQA Diamond37.7%—
Humanity's Last Exam—31.6%
SimpleQA Verified8.3%—
MMLU-Pro60.3%—
Confabulations37.2%—
GPQA (HELM)36.8%—
LMArena Expert1235—
BoolQ88.7%—
MMLU81.8%—

Multimodal Not comparable

GPT-4o mini: 25.9 (#122), GPT-5 Pro: —

Multimodal benchmarks
BenchmarkGPT-4o miniGPT-5 Pro
LMArena Vision1066—
Video-MME64.8%—
GeoBench64%—
VPCT34%—

Multilingual Not comparable

GPT-4o mini: 42.0 (#199), GPT-5 Pro: —

Multilingual benchmarks
BenchmarkGPT-4o miniGPT-5 Pro
LMArena Non-English1266—
LMArena Chinese1265—
LMArena French1297—
LMArena German1272—
LMArena Japanese1216—
LMArena Korean1195—
LMArena Russian1275—
LMArena Spanish1276—

Instruction Following Not comparable

GPT-4o mini: 61.9 (#239), GPT-5 Pro: —

Instruction Following benchmarks
BenchmarkGPT-4o miniGPT-5 Pro
LiveBench Instruction Following56.8%—
IFEval78.2%—
LMArena Instruction Following1258—

Long Context Not comparable

GPT-4o mini: 39.1 (#186), GPT-5 Pro: —

Long Context benchmarks
BenchmarkGPT-4o miniGPT-5 Pro
LMArena Longer Query1289—

Writing & Preference Not comparable

GPT-4o mini: 39.5 (#248), GPT-5 Pro: —

Writing & Preference benchmarks
BenchmarkGPT-4o miniGPT-5 Pro
LMArena Text1286—
LMArena Creative Writing1268—
Short-Story Creative Writing67.2%—
EQ-Bench Creative Writing873—
WildBench79.1%—
LMArena Multi-Turn1285—
LiveBench Language28.6%—

Frequently asked questions

Is GPT-4o mini better than GPT-5 Pro?

GPT-5 Pro is the stronger model overall, scoring 46.4 to 25.5 on the Noometry Index. GPT-4o mini costs 157× less per token, which makes it the better buy when GPT-5 Pro's lead doesn't matter for your workload.

Which is cheaper, GPT-4o mini or GPT-5 Pro?

GPT-4o mini is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; GPT-5 Pro lists at $15 and $120.

Is GPT-4o mini or GPT-5 Pro better for coding?

GPT-5 Pro scores higher on coding benchmarks: 44.0 versus 22.0 in the Noometry coding category.

Which has the bigger context window?

GPT-5 Pro does, with 400K tokens against 128K.

How many benchmarks do GPT-4o mini and GPT-5 Pro share?

6 benchmarks have published results for both models. GPT-4o mini has 60 scored results on Noometry and GPT-5 Pro has 12.

Related comparisons

Go deeper