Noometry

Model comparison

Gemini 2.5 Flash-Lite vs GPT-4.1 mini

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 37.0 to 33.6 on the Noometry Index.

Last verified . 30 shared benchmarks.

Gemini 2.5 Flash-Lite Google

37.0

Rank #211 Confirmed

GPT-4.1 mini OpenAI

33.6

Rank #240 Confirmed

Summary

  • They share 30 benchmarks with published results for both. Gemini 2.5 Flash-Lite scores higher in 6 categories and GPT-4.1 mini in 4 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 2.5 Flash-Lite leads 38.0 to 24.1.
  • The biggest single-benchmark swing is GPQA (HELM): 30.9% for Gemini 2.5 Flash-Lite and 61.4% for GPT-4.1 mini.
  • Gemini 2.5 Flash-Lite is cheaper at $0.10 / $0.40 per million input/output tokens, against $0.40 / $1.60 for GPT-4.1 mini.
  • Gemini 2.5 Flash-Lite accepts more context: 1.05M tokens versus 1.05M.

Side by side

Gemini 2.5 Flash-LiteGPT-4.1 mini
ProviderGoogleOpenAI
Noometry Index37.033.6
Released2025-06-172025-04-14
WeightsProprietaryProprietary
Context window1.05M1.05M
Max output66K33K
Input $ / M tokens$0.10$0.40
Output $ / M tokens$0.40$1.60
Results tracked3347

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 38.5 (#173), GPT-4.1 mini: 30.6 (#293)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
WeirdML35.2%37.6%
LMArena Coding13731367
SWE-bench Verified (bash only)—23.9%
Aider Polyglot—32.4%
SciCode—40.4%
BigCodeBench Instruct—48.9%
CadEval—16%
ALE-Bench325.9—

Agentic & Tool Use GPT-4.1 mini leads

Gemini 2.5 Flash-Lite: 28.0 (#96), GPT-4.1 mini: 33.3 (#55)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
Berkeley Function Calling Leaderboard36.9%50.5%

Reasoning Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 22.2 (#205), GPT-4.1 mini: 10.8 (#340)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
Kagi LLM Benchmark40.5%48.6%
LMArena Hard Prompts13771349
DTBench62.8%68.8%
LMCA18.1%21.1%
Epoch Capabilities Index133.94135.01
ARC-AGI-2—0%
ARC-AGI-1—3.5%
CritPt—0%
Chess Puzzles—7%
Mystery Game Puzzles—7%

Math Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 38.0 (#144), GPT-4.1 mini: 24.1 (#270)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
Omni-MATH48%49.1%
LMArena Math13731343
FrontierMath (Tiers 1-3)—6.7%
OTIS Mock AIME 2024-2025—44.7%
MATH Level 5—87.3%
FrontierMath (Feb 2025 set)—4.5%

Knowledge GPT-4.1 mini leads

Gemini 2.5 Flash-Lite: 32.5 (#210), GPT-4.1 mini: 34.7 (#194)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
MMLU-Pro53.7%78.3%
GPQA (HELM)30.9%61.4%
LMArena Expert13731338
GPQA Diamond—65.8%
SimpleQA Verified—12.7%
Vectara Hallucination Rate3.3%—

Multimodal GPT-4.1 mini leads

Gemini 2.5 Flash-Lite: 29.1 (#114), GPT-4.1 mini: 35.8 (#82)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
LMArena Vision11981181
VPCT30%—

Multilingual Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 49.3 (#134), GPT-4.1 mini: 45.7 (#166)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
LMArena Non-English13691318
LMArena Chinese14041329
LMArena French13881358
LMArena German13891351
LMArena Japanese13591290
LMArena Korean13601298
LMArena Russian13731324
LMArena Spanish13961319

Instruction Following GPT-4.1 mini leads

Gemini 2.5 Flash-Lite: 70.0 (#168), GPT-4.1 mini: 73.7 (#118)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
IFEval81%90.4%
LMArena Instruction Following13671333

Long Context Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 33.3 (#262), GPT-4.1 mini: 31.8 (#275)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
Fiction.LiveBench47.2%44.4%
LMArena Longer Query13731344

Writing & Preference Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 56.8 (#135), GPT-4.1 mini: 48.6 (#199)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
LMArena Text13791340
LMArena Creative Writing13671300
WildBench81.8%83.8%
LMArena Multi-Turn13661354
EQ-Bench Creative Writing—1147

Frequently asked questions

Is Gemini 2.5 Flash-Lite better than GPT-4.1 mini?

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 37.0 to 33.6 on the Noometry Index.

Which is cheaper, Gemini 2.5 Flash-Lite or GPT-4.1 mini?

Gemini 2.5 Flash-Lite is cheaper. It lists at $0.10 per million input tokens and $0.40 per million output tokens; GPT-4.1 mini lists at $0.40 and $1.60.

Is Gemini 2.5 Flash-Lite or GPT-4.1 mini better for coding?

Gemini 2.5 Flash-Lite scores higher on coding benchmarks: 38.5 versus 30.6 in the Noometry coding category.

Which has the bigger context window?

Gemini 2.5 Flash-Lite does, with 1.05M tokens against 1.05M.

How many benchmarks do Gemini 2.5 Flash-Lite and GPT-4.1 mini share?

30 benchmarks have published results for both models. Gemini 2.5 Flash-Lite has 33 scored results on Noometry and GPT-4.1 mini has 47.

Related comparisons

Go deeper