Noometry

Model comparison

GPT-4.1 nano vs GPT-4o mini

GPT-4.1 nano is the stronger model overall, scoring 27.7 to 25.4 on the Noometry Index.

Last verified . 32 shared benchmarks.

GPT-4.1 nano OpenAI

27.7

Rank #322 Confirmed

GPT-4o mini OpenAI

25.4

Rank #337 Confirmed

Summary

  • They share 32 benchmarks with published results for both. GPT-4.1 nano scores higher in 6 categories and GPT-4o mini in 4 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-4.1 nano leads 25.5 to 9.9.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 28.9% for GPT-4.1 nano and 6.9% for GPT-4o mini.
  • GPT-4.1 nano is cheaper at $0.10 / $0.40 per million input/output tokens, against $0.15 / $0.60 for GPT-4o mini.
  • GPT-4.1 nano accepts more context: 1.05M tokens versus 128K.

Side by side

GPT-4.1 nanoGPT-4o mini
ProviderOpenAIOpenAI
Noometry Index27.725.4
Released2025-04-142024-07-18
WeightsProprietaryProprietary
Context window1.05M128K
Max output33K16K
Input $ / M tokens$0.10$0.15
Output $ / M tokens$0.40$0.60
Results tracked3860

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-4.1 nano leads

GPT-4.1 nano: 23.8 (#325), GPT-4o mini: 21.6 (#330)

BenchmarkGPT-4.1 nanoGPT-4o mini
Aider Polyglot8.9%3.6%
WeirdML19%11.8%
LMArena Coding13061290
SciCode25.9%—
BigCodeBench Instruct—46.1%
LiveBench Coding—43.1%
BigCodeBench Complete—57.4%
HumanEval+—83.5%
MBPP+—72.2%

Agentic & Tool Use Too close to call

GPT-4.1 nano: 26.3 (#98), GPT-4o mini: 27.2 (#95)

BenchmarkGPT-4.1 nanoGPT-4o mini
Berkeley Function Calling Leaderboard33%—
BALROG—17.4%

Reasoning Too close to call

GPT-4.1 nano: 8.6 (#344), GPT-4o mini: 8.7 (#343)

BenchmarkGPT-4.1 nanoGPT-4o mini
ARC-AGI-20%0%
Kagi LLM Benchmark33.3%28.8%
LMArena Hard Prompts12861267
DTBench52.5%54.4%
LMCA5.5%10.4%
Epoch Capabilities Index129.62126.56
SimpleBench—10.7%
ARC-AGI-10%—
CritPt0%—
Chess Puzzles—0%
LiveBench Reasoning—32.8%
Mystery Game Puzzles—12%
LiveBench Data Analysis—50%
LiveBench—41.3%
PIQA—88.7%

Math GPT-4.1 nano leads

GPT-4.1 nano: 25.5 (#246), GPT-4o mini: 9.9 (#307)

BenchmarkGPT-4.1 nanoGPT-4o mini
OTIS Mock AIME 2024-202528.9%6.9%
Omni-MATH36.7%28%
LMArena Math12741267
MATH Level 570%52.6%
FrontierMath (Tiers 1-3)—0.7%
LiveBench Math—36.3%
FrontierMath (Feb 2025 set)1%—
GSM8K—91.3%

Knowledge GPT-4.1 nano leads

GPT-4.1 nano: 21.8 (#268), GPT-4o mini: 17.7 (#279)

BenchmarkGPT-4.1 nanoGPT-4o mini
GPQA Diamond48.9%37.7%
SimpleQA Verified6%8.3%
MMLU-Pro55%60.3%
GPQA (HELM)50.7%36.8%
LMArena Expert12721235
Confabulations—37.2%
BoolQ—88.7%
MMLU—81.8%

Multimodal GPT-4.1 nano leads

GPT-4.1 nano: 28.6 (#108), GPT-4o mini: 25.3 (#117)

BenchmarkGPT-4.1 nanoGPT-4o mini
LMArena Vision10631066
Video-MME—64.8%
GeoBench—64%
VPCT—34%

Multilingual Too close to call

GPT-4.1 nano: 41.8 (#200), GPT-4o mini: 42.2 (#194)

BenchmarkGPT-4.1 nanoGPT-4o mini
LMArena Non-English12601266
LMArena Chinese12701264
LMArena German12881272
LMArena Japanese11991216
LMArena Russian12611275
LMArena French—1296
LMArena Korean—1195
LMArena Spanish—1276

Instruction Following GPT-4.1 nano leads

GPT-4.1 nano: 68.0 (#188), GPT-4o mini: 62.1 (#234)

BenchmarkGPT-4.1 nanoGPT-4o mini
IFEval84.3%78.2%
LMArena Instruction Following12671259
LiveBench Instruction Following—56.8%

Long Context GPT-4o mini leads

GPT-4.1 nano: 23.7 (#291), GPT-4o mini: 39.1 (#181)

BenchmarkGPT-4.1 nanoGPT-4o mini
LMArena Longer Query12831289
Fiction.LiveBench25%—

Writing & Preference GPT-4.1 nano leads

GPT-4.1 nano: 40.7 (#238), GPT-4o mini: 39.7 (#243)

BenchmarkGPT-4.1 nanoGPT-4o mini
LMArena Text12851286
LMArena Creative Writing12601268
EQ-Bench Creative Writing946873
WildBench81.2%79.1%
LMArena Multi-Turn12771285
Short-Story Creative Writing—67.2%
LiveBench Language—28.6%

Frequently asked questions

Is GPT-4.1 nano better than GPT-4o mini?

GPT-4.1 nano is the stronger model overall, scoring 27.7 to 25.4 on the Noometry Index.

Which is cheaper, GPT-4.1 nano or GPT-4o mini?

GPT-4.1 nano is cheaper. It lists at $0.10 per million input tokens and $0.40 per million output tokens; GPT-4o mini lists at $0.15 and $0.60.

Is GPT-4.1 nano or GPT-4o mini better for coding?

GPT-4.1 nano scores higher on coding benchmarks: 23.8 versus 21.6 in the Noometry coding category.

Which has the bigger context window?

GPT-4.1 nano does, with 1.05M tokens against 128K.

How many benchmarks do GPT-4.1 nano and GPT-4o mini share?

32 benchmarks have published results for both models. GPT-4.1 nano has 38 scored results on Noometry and GPT-4o mini has 60.

Related comparisons

Go deeper