Noometry

Model comparison

GPT-4.1 nano vs o1-mini

o1-mini is the stronger model overall, scoring 34.0 to 27.9 on the Noometry Index.

Last verified . 23 shared benchmarks.

GPT-4.1 nano OpenAI

27.9

Rank #327 Confirmed

o1-mini OpenAI

34.0

Rank #235 Confirmed

Summary

  • They share 23 benchmarks with published results for both. GPT-4.1 nano scores higher in 2 categories and o1-mini in 7 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in long context, where o1-mini leads 40.1 to 23.7.
  • The biggest single-benchmark swing is Aider Polyglot: 8.9% for GPT-4.1 nano and 32.9% for o1-mini.

Side by side

GPT-4.1 nanoo1-mini
ProviderOpenAIOpenAI
Noometry Index27.934.0
Released2025-04-142024-09-12
WeightsProprietaryProprietary
Context window1.05M—
Max output33K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.40—
Results tracked3839

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding o1-mini leads

GPT-4.1 nano: 24.1 (#330), o1-mini: 35.5 (#224)

BenchmarkGPT-4.1 nanoo1-mini
Aider Polyglot8.9%32.9%
WeirdML19%36.3%
LMArena Coding13061362
SciCode25.9%—
LiveBench Coding—48%
HumanEval+—89%
MBPP+—78.8%

Agentic & Tool Use GPT-4.1 nano leads

GPT-4.1 nano: 26.5 (#104), o1-mini: 24.6 (#118)

BenchmarkGPT-4.1 nanoo1-mini
Berkeley Function Calling Leaderboard33%—
Cybench—10%

Reasoning Too close to call

GPT-4.1 nano: 8.5 (#349), o1-mini: 8.8 (#346)

BenchmarkGPT-4.1 nanoo1-mini
ARC-AGI-20%0.8%
ARC-AGI-10%14%
LMArena Hard Prompts12861333
Epoch Capabilities Index129.62135.82
SimpleBench—18.1%
Kagi LLM Benchmark33.3%—
CritPt0%—
LiveBench Reasoning—72.3%
DTBench52.5%—
LiveBench Data Analysis—57.9%
LMCA5.5%—
LiveBench—57.8%

Math o1-mini leads

GPT-4.1 nano: 26.9 (#252), o1-mini: 35.4 (#186)

BenchmarkGPT-4.1 nanoo1-mini
OTIS Mock AIME 2024-202528.9%46.9%
LMArena Math12741358
MATH Level 570%89.2%
FrontierMath (Feb 2025 set)1%1.7%
Omni-MATH36.7%—
LiveBench Math—62%

Knowledge o1-mini leads

GPT-4.1 nano: 21.8 (#273), o1-mini: 34.9 (#192)

BenchmarkGPT-4.1 nanoo1-mini
GPQA Diamond48.9%62.4%
LMArena Expert12721316
SimpleQA Verified6%—
MMLU-Pro55%—
Confabulations—18.6%
GPQA (HELM)50.7%—

Multimodal Not comparable

GPT-4.1 nano: 29.2 (#113), o1-mini: —

BenchmarkGPT-4.1 nanoo1-mini
LMArena Vision1063—

Multilingual o1-mini leads

GPT-4.1 nano: 41.6 (#205), o1-mini: 43.6 (#182)

BenchmarkGPT-4.1 nanoo1-mini
LMArena Non-English12601289
LMArena Chinese12701314
LMArena German12881278
LMArena Japanese11981245
LMArena Russian12611283
LMArena French—1293
LMArena Korean—1223
LMArena Spanish—1303

Instruction Following GPT-4.1 nano leads

GPT-4.1 nano: 67.8 (#193), o1-mini: 66.7 (#206)

BenchmarkGPT-4.1 nanoo1-mini
LMArena Instruction Following12671304
LiveBench Instruction Following—65.4%
IFEval84.3%—

Long Context o1-mini leads

GPT-4.1 nano: 23.7 (#296), o1-mini: 40.1 (#161)

BenchmarkGPT-4.1 nanoo1-mini
LMArena Longer Query12831320
Fiction.LiveBench25%—

Writing & Preference o1-mini leads

GPT-4.1 nano: 40.5 (#243), o1-mini: 48.4 (#202)

BenchmarkGPT-4.1 nanoo1-mini
LMArena Text12851317
LMArena Creative Writing12601244
LMArena Multi-Turn12771314
Short-Story Creative Writing—64.9%
EQ-Bench Creative Writing946—
WildBench81.2%—
LiveBench Language—40.9%

Frequently asked questions

Is GPT-4.1 nano better than o1-mini?

o1-mini is the stronger model overall, scoring 34.0 to 27.9 on the Noometry Index.

Is GPT-4.1 nano or o1-mini better for coding?

o1-mini scores higher on coding benchmarks: 35.5 versus 24.1 in the Noometry coding category.

How many benchmarks do GPT-4.1 nano and o1-mini share?

23 benchmarks have published results for both models. GPT-4.1 nano has 38 scored results on Noometry and o1-mini has 39.

Related comparisons

Go deeper