Noometry

Model comparison

GPT-4.1 mini vs GPT-4o

GPT-4.1 mini is the stronger model overall, scoring 33.6 to 28.6 on the Noometry Index.

Last verified . 42 shared benchmarks.

GPT-4.1 mini OpenAI

33.6

Rank #240 Confirmed

GPT-4o OpenAI

28.6

Rank #324 Confirmed

Summary

  • They share 42 benchmarks with published results for both. GPT-4.1 mini scores higher in 8 categories and GPT-4o in 2 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-4.1 mini leads 24.1 to 10.6.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 44.7% for GPT-4.1 mini and 6.4% for GPT-4o.
  • GPT-4.1 mini is cheaper at $0.40 / $1.60 per million input/output tokens, against $2.50 / $10 for GPT-4o.
  • GPT-4.1 mini accepts more context: 1.05M tokens versus 128K.

Side by side

GPT-4.1 miniGPT-4o
ProviderOpenAIOpenAI
Noometry Index33.628.6
Released2025-04-142024-05-13
WeightsProprietaryProprietary
Context window1.05M128K
Max output33K16K
Input $ / M tokens$0.40$2.50
Output $ / M tokens$1.60$10
Results tracked4772

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-4.1 mini leads

GPT-4.1 mini: 30.6 (#293), GPT-4o: 24.8 (#328)

BenchmarkGPT-4.1 miniGPT-4o
SWE-bench Verified (bash only)23.9%21.6%
Aider Polyglot32.4%45.3%
WeirdML37.6%25.1%
BigCodeBench Instruct48.9%51.1%
LMArena Coding13671297
CadEval16%26%
SWE-bench Verified—31%
SciCode40.4%—
GSO—0%
LiveBench Coding—51.4%
BigCodeBench Complete—61.1%
HumanEval+—87.2%
MBPP+—72.2%

Agentic & Tool Use GPT-4.1 mini leads

GPT-4.1 mini: 33.3 (#55), GPT-4o: 21.0 (#141)

BenchmarkGPT-4.1 miniGPT-4o
Berkeley Function Calling Leaderboard50.5%—
GDPval—9.9%
TheAgentCompany—8.6%
Cybench—12.5%
BALROG—32.3%
LMArena Search—1006
METR Time Horizons—40.8%

Reasoning GPT-4.1 mini leads

GPT-4.1 mini: 10.8 (#340), GPT-4o: 9.4 (#343)

BenchmarkGPT-4.1 miniGPT-4o
ARC-AGI-20%0%
ARC-AGI-13.5%4.5%
CritPt0%0%
Chess Puzzles7%13%
LMArena Hard Prompts13491281
DTBench68.8%64.5%
LMCA21.1%16.6%
Epoch Capabilities Index135.01128.97
SimpleBench—17.8%
Kagi LLM Benchmark48.6%—
EnigmaEval—0.8%
LiveBench Reasoning—55.8%
Mystery Game Puzzles7%—
LiveBench Data Analysis—60.9%
ForecastBench—57.7
LiveBench—55.3%

Math GPT-4.1 mini leads

GPT-4.1 mini: 24.1 (#270), GPT-4o: 10.6 (#312)

BenchmarkGPT-4.1 miniGPT-4o
FrontierMath (Tiers 1-3)6.7%0.4%
OTIS Mock AIME 2024-202544.7%6.4%
Omni-MATH49.1%29.3%
LMArena Math13431285
MATH Level 587.3%53.3%
FrontierMath (Feb 2025 set)4.5%0.3%
LiveBench Math—49.5%

Knowledge GPT-4.1 mini leads

GPT-4.1 mini: 34.7 (#194), GPT-4o: 28.8 (#242)

BenchmarkGPT-4.1 miniGPT-4o
GPQA Diamond65.8%49.2%
SimpleQA Verified12.7%26%
MMLU-Pro78.3%71.3%
GPQA (HELM)61.4%52%
LMArena Expert13381250
Humanity's Last Exam—2.7%
Confabulations—15.3%
Vectara Hallucination Rate—9.6%
MMLU—88.1%

Multimodal GPT-4.1 mini leads

GPT-4.1 mini: 35.8 (#82), GPT-4o: 34.5 (#91)

BenchmarkGPT-4.1 miniGPT-4o
LMArena Vision11811137
Video-MME—71.9%
GeoBench—71%
VPCT—40%
ScienceQA—88.5%

Multilingual GPT-4.1 mini leads

GPT-4.1 mini: 45.7 (#166), GPT-4o: 43.2 (#186)

BenchmarkGPT-4.1 miniGPT-4o
LMArena Non-English13181283
LMArena Chinese13291277
LMArena French13581304
LMArena German13511282
LMArena Japanese12901257
LMArena Korean12981234
LMArena Russian13241286
LMArena Spanish13191292

Instruction Following GPT-4.1 mini leads

GPT-4.1 mini: 73.7 (#118), GPT-4o: 66.6 (#207)

BenchmarkGPT-4.1 miniGPT-4o
IFEval90.4%81.7%
LMArena Instruction Following13331278
LiveBench Instruction Following—68.6%

Long Context GPT-4o leads

GPT-4.1 mini: 31.8 (#275), GPT-4o: 39.4 (#179)

BenchmarkGPT-4.1 miniGPT-4o
Fiction.LiveBench44.4%66.7%
LMArena Longer Query13441289

Writing & Preference GPT-4o leads

GPT-4.1 mini: 48.6 (#199), GPT-4o: 52.6 (#166)

BenchmarkGPT-4.1 miniGPT-4o
LMArena Text13401300
LMArena Creative Writing13001292
WildBench83.8%82.8%
LMArena Multi-Turn13541302
Short-Story Creative Writing—81.8%
EQ-Bench Creative Writing1147—
LiveBench Language—47.6%

Frequently asked questions

Is GPT-4.1 mini better than GPT-4o?

GPT-4.1 mini is the stronger model overall, scoring 33.6 to 28.6 on the Noometry Index.

Which is cheaper, GPT-4.1 mini or GPT-4o?

GPT-4.1 mini is cheaper. It lists at $0.40 per million input tokens and $1.60 per million output tokens; GPT-4o lists at $2.50 and $10.

Is GPT-4.1 mini or GPT-4o better for coding?

GPT-4.1 mini scores higher on coding benchmarks: 30.6 versus 24.8 in the Noometry coding category.

Which has the bigger context window?

GPT-4.1 mini does, with 1.05M tokens against 128K.

How many benchmarks do GPT-4.1 mini and GPT-4o share?

42 benchmarks have published results for both models. GPT-4.1 mini has 47 scored results on Noometry and GPT-4o has 72.

Related comparisons

Go deeper