Model comparison

GPT-4o mini vs GPT-5 Nano

GPT-5 Nano is the stronger model overall, scoring 33.5 to 25.5 on the Noometry Index.

Last verified . 37 shared benchmarks.

GPT-4o mini OpenAI

25.5

Rank #343 Confirmed

GPT-5 Nano OpenAI

33.5

Rank #241 Confirmed

Summary

  • They share 37 benchmarks with published results for both. GPT-4o mini scores higher in 3 categories and GPT-5 Nano in 7 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5 Nano leads 29.4 to 10.4.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 6.9% for GPT-4o mini and 81.1% for GPT-5 Nano.
  • GPT-5 Nano is cheaper at $0.05 / $0.40 per million input/output tokens, against $0.15 / $0.60 for GPT-4o mini.
  • GPT-5 Nano accepts more context: 400K tokens versus 128K.

Side by side

GPT-4o mini and GPT-5 Nano specifications
GPT-4o miniGPT-5 Nano
ProviderOpenAIOpenAI
Noometry Index25.533.5
Released2024-07-182025-08-07
WeightsProprietaryProprietary
Context window128K400K
Max output16K128K
Input $ / M tokens$0.15$0.05
Output $ / M tokens$0.60$0.40
Results tracked6049

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5 Nano leads

GPT-4o mini: 22.0 (#335), GPT-5 Nano: 33.6 (#254)

Coding benchmarks
BenchmarkGPT-4o miniGPT-5 Nano
WeirdML11.8%38.1%
LMArena Coding12901351
SWE-bench Verified (bash only)—34.8%
Aider Polyglot3.6%—
BigCodeBench Instruct46.1%—
LiveBench Coding43.1%—
BigCodeBench Complete57.4%—
ALE-Bench—718.67
HumanEval+83.5%—
MBPP+72.2%—

Agentic & Tool Use GPT-4o mini leads

GPT-4o mini: 27.5 (#101), GPT-5 Nano: 25.8 (#106)

Agentic & Tool Use benchmarks
BenchmarkGPT-4o miniGPT-5 Nano
Terminal-Bench—21.8%
Berkeley Function Calling Leaderboard—51.5%
BALROG17.4%—

Reasoning GPT-5 Nano leads

GPT-4o mini: 8.7 (#347), GPT-5 Nano: 16.3 (#306)

Reasoning benchmarks
BenchmarkGPT-4o miniGPT-5 Nano
ARC-AGI-20%2.6%
Kagi LLM Benchmark28.8%62.2%
Chess Puzzles0%27%
LMArena Hard Prompts12671328
Mystery Game Puzzles12%9%
DTBench54.4%62.7%
LMCA10.4%7.9%
Epoch Capabilities Index126.56139.38
SimpleBench10.7%—
ARC-AGI-1—20.7%
LiveBench Reasoning32.8%—
LiveBench Data Analysis50%—
ForecastBench—59.1
LiveBench41.3%—
PIQA88.7%—

Math GPT-5 Nano leads

GPT-4o mini: 10.4 (#314), GPT-5 Nano: 29.4 (#241)

Math benchmarks
BenchmarkGPT-4o miniGPT-5 Nano
FrontierMath (Tiers 1-3)0.7%20%
OTIS Mock AIME 2024-20256.9%81.1%
Omni-MATH28%54.6%
LMArena Math12671317
MATH Level 552.6%95.2%
FrontierMath Tier 4—2.4%
ProofBench—12%
LiveBench Math36.3%—
FrontierMath (Feb 2025 set)—8.3%
FrontierMath Tier 4 (v1)—2.1%
GSM8K91.3%—

Knowledge GPT-5 Nano leads

GPT-4o mini: 17.7 (#284), GPT-5 Nano: 35.9 (#178)

Knowledge benchmarks
BenchmarkGPT-4o miniGPT-5 Nano
GPQA Diamond37.7%69.4%
SimpleQA Verified8.3%11.7%
MMLU-Pro60.3%77.8%
GPQA (HELM)36.8%67.9%
LMArena Expert12351321
Confabulations37.2%—
Vectara Hallucination Rate—10.5%
BoolQ88.7%—
MMLU81.8%—

Multimodal GPT-5 Nano leads

GPT-4o mini: 25.9 (#122), GPT-5 Nano: 31.3 (#108)

Multimodal benchmarks
BenchmarkGPT-4o miniGPT-5 Nano
LMArena Vision10661159
VPCT34%37.2%
Video-MME64.8%—
GeoBench64%—

Multilingual GPT-5 Nano leads

GPT-4o mini: 42.0 (#199), GPT-5 Nano: 45.3 (#172)

Multilingual benchmarks
BenchmarkGPT-4o miniGPT-5 Nano
LMArena Non-English12661313
LMArena Chinese12651356
LMArena German12721327
LMArena Japanese12161226
LMArena Korean11951269
LMArena Russian12751296
LMArena Spanish12761360
LMArena French1297—

Instruction Following GPT-5 Nano leads

GPT-4o mini: 61.9 (#239), GPT-5 Nano: 75.0 (#79)

Instruction Following benchmarks
BenchmarkGPT-4o miniGPT-5 Nano
IFEval78.2%93.2%
LMArena Instruction Following12581306
LiveBench Instruction Following56.8%—

Long Context GPT-4o mini leads

GPT-4o mini: 39.1 (#186), GPT-5 Nano: 31.3 (#281)

Long Context benchmarks
BenchmarkGPT-4o miniGPT-5 Nano
LMArena Longer Query12891312
Fiction.LiveBench—44.4%

Writing & Preference Too close to call

GPT-4o mini: 39.5 (#248), GPT-5 Nano: 39.1 (#249)

Writing & Preference benchmarks
BenchmarkGPT-4o miniGPT-5 Nano
LMArena Text12861320
LMArena Creative Writing12681249
EQ-Bench Creative Writing873705
WildBench79.1%80.6%
LMArena Multi-Turn12851311
Short-Story Creative Writing67.2%—
LiveBench Language28.6%—

Frequently asked questions

Is GPT-4o mini better than GPT-5 Nano?

GPT-5 Nano is the stronger model overall, scoring 33.5 to 25.5 on the Noometry Index.

Which is cheaper, GPT-4o mini or GPT-5 Nano?

GPT-5 Nano is cheaper. It lists at $0.05 per million input tokens and $0.40 per million output tokens; GPT-4o mini lists at $0.15 and $0.60.

Is GPT-4o mini or GPT-5 Nano better for coding?

GPT-5 Nano scores higher on coding benchmarks: 33.6 versus 22.0 in the Noometry coding category.

Which has the bigger context window?

GPT-5 Nano does, with 400K tokens against 128K.

How many benchmarks do GPT-4o mini and GPT-5 Nano share?

37 benchmarks have published results for both models. GPT-4o mini has 60 scored results on Noometry and GPT-5 Nano has 49.

Related comparisons

Go deeper