Noometry

Model comparison

Gemini 2.5 Flash-Lite vs GPT-4.1 nano

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 37.0 to 27.9 on the Noometry Index.

Last verified . 27 shared benchmarks.

Gemini 2.5 Flash-Lite Google

37.0

Rank #211 Confirmed

GPT-4.1 nano OpenAI

27.9

Rank #327 Confirmed

Summary

  • They share 27 benchmarks with published results for both. Gemini 2.5 Flash-Lite scores higher in 9 categories and GPT-4.1 nano in 1 category; 9 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemini 2.5 Flash-Lite leads 56.8 to 40.5.
  • The biggest single-benchmark swing is Fiction.LiveBench: 47.2% for Gemini 2.5 Flash-Lite and 25% for GPT-4.1 nano.
  • Both cost about the same: $0.10 input and $0.40 output per million tokens.
  • Gemini 2.5 Flash-Lite accepts more context: 1.05M tokens versus 1.05M.

Side by side

Gemini 2.5 Flash-LiteGPT-4.1 nano
ProviderGoogleOpenAI
Noometry Index37.027.9
Released2025-06-172025-04-14
WeightsProprietaryProprietary
Context window1.05M1.05M
Max output66K33K
Input $ / M tokens$0.10$0.10
Output $ / M tokens$0.40$0.40
Results tracked3338

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 38.5 (#173), GPT-4.1 nano: 24.1 (#330)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 nano
WeirdML35.2%19%
LMArena Coding13731306
Aider Polyglot—8.9%
SciCode—25.9%
ALE-Bench325.9—

Agentic & Tool Use Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 28.0 (#96), GPT-4.1 nano: 26.5 (#104)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 nano
Berkeley Function Calling Leaderboard36.9%33%

Reasoning Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 22.2 (#205), GPT-4.1 nano: 8.5 (#349)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 nano
Kagi LLM Benchmark40.5%33.3%
LMArena Hard Prompts13771286
DTBench62.8%52.5%
LMCA18.1%5.5%
Epoch Capabilities Index133.94129.62
ARC-AGI-2—0%
ARC-AGI-1—0%
CritPt—0%

Math Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 38.0 (#144), GPT-4.1 nano: 26.9 (#252)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 nano
Omni-MATH48%36.7%
LMArena Math13731274
OTIS Mock AIME 2024-2025—28.9%
MATH Level 5—70%
FrontierMath (Feb 2025 set)—1%

Knowledge Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 32.5 (#210), GPT-4.1 nano: 21.8 (#273)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 nano
MMLU-Pro53.7%55%
GPQA (HELM)30.9%50.7%
LMArena Expert13731272
GPQA Diamond—48.9%
SimpleQA Verified—6%
Vectara Hallucination Rate3.3%—

Multimodal Too close to call

Gemini 2.5 Flash-Lite: 29.1 (#114), GPT-4.1 nano: 29.2 (#113)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 nano
LMArena Vision11981063
VPCT30%—

Multilingual Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 49.3 (#134), GPT-4.1 nano: 41.6 (#205)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 nano
LMArena Non-English13691260
LMArena Chinese14041270
LMArena German13891288
LMArena Japanese13591198
LMArena Russian13731261
LMArena French1388—
LMArena Korean1360—
LMArena Spanish1396—

Instruction Following Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 70.0 (#168), GPT-4.1 nano: 67.8 (#193)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 nano
IFEval81%84.3%
LMArena Instruction Following13671267

Long Context Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 33.3 (#262), GPT-4.1 nano: 23.7 (#296)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 nano
Fiction.LiveBench47.2%25%
LMArena Longer Query13731283

Writing & Preference Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 56.8 (#135), GPT-4.1 nano: 40.5 (#243)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 nano
LMArena Text13791285
LMArena Creative Writing13671260
WildBench81.8%81.2%
LMArena Multi-Turn13661277
EQ-Bench Creative Writing—946

Frequently asked questions

Is Gemini 2.5 Flash-Lite better than GPT-4.1 nano?

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 37.0 to 27.9 on the Noometry Index.

Which is cheaper, Gemini 2.5 Flash-Lite or GPT-4.1 nano?

GPT-4.1 nano is cheaper. It lists at $0.10 per million input tokens and $0.40 per million output tokens; Gemini 2.5 Flash-Lite lists at $0.10 and $0.40.

Is Gemini 2.5 Flash-Lite or GPT-4.1 nano better for coding?

Gemini 2.5 Flash-Lite scores higher on coding benchmarks: 38.5 versus 24.1 in the Noometry coding category.

Which has the bigger context window?

Gemini 2.5 Flash-Lite does, with 1.05M tokens against 1.05M.

How many benchmarks do Gemini 2.5 Flash-Lite and GPT-4.1 nano share?

27 benchmarks have published results for both models. Gemini 2.5 Flash-Lite has 33 scored results on Noometry and GPT-4.1 nano has 38.

Related comparisons

Go deeper