Noometry

Model comparison

Gemini 2.0 Flash-Lite vs GPT-5.4 nano

GPT-5.4 nano is the stronger model overall, scoring 41.9 to 37.8 on the Noometry Index.

Last verified . 20 shared benchmarks.

Gemini 2.0 Flash-Lite Google

37.8

Rank #194 Confirmed

GPT-5.4 nano OpenAI

41.9

Rank #125 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Gemini 2.0 Flash-Lite scores higher in 0 categories and GPT-5.4 nano in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GPT-5.4 nano leads 41.9 to 35.0.
  • The biggest single-benchmark swing is DTBench: 52.5% for Gemini 2.0 Flash-Lite and 80.3% for GPT-5.4 nano.

Side by side

Gemini 2.0 Flash-LiteGPT-5.4 nano
ProviderGoogleOpenAI
Noometry Index37.841.9
Released2025-02-052026-03-17
WeightsProprietaryProprietary
Context window—400K
Max output—128K
Input $ / M tokens—$0.20
Output $ / M tokens—$1.25
Results tracked3240

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.4 nano leads

Gemini 2.0 Flash-Lite: 37.9 (#185), GPT-5.4 nano: 43.6 (#84)

BenchmarkGemini 2.0 Flash-LiteGPT-5.4 nano
LMArena Coding13221405
SciCode—46.9%
WeirdML—49.2%
LiveBench Coding47.1%—
ALE-Bench—1,005

Reasoning GPT-5.4 nano leads

Gemini 2.0 Flash-Lite: 22.0 (#210), GPT-5.4 nano: 23.7 (#173)

BenchmarkGemini 2.0 Flash-LiteGPT-5.4 nano
LMArena Hard Prompts13241381
DTBench52.5%80.3%
ForecastBench57.157.3
ARC-AGI-2—5.7%
Kagi LLM Benchmark—39.7%
ARC-AGI-1—51.5%
CritPt—9.3%
Chess Puzzles—30%
LiveBench Reasoning50.1%—
Mystery Game Puzzles—9%
LiveBench Data Analysis65.5%—
LMCA—36.9%
Epoch Capabilities Index—145.81
LiveBench54.3%—

Math GPT-5.4 nano leads

Gemini 2.0 Flash-Lite: 34.1 (#196), GPT-5.4 nano: 40.9 (#88)

BenchmarkGemini 2.0 Flash-LiteGPT-5.4 nano
LMArena Math13091406
FrontierMath (Tiers 1-3)—44.9%
FrontierMath Tier 4—12.2%
OTIS Mock AIME 2024-2025—87.8%
ProofBench—5%
Omni-MATH37.4%—
LiveBench Math58.1%—
FrontierMath (Feb 2025 set)—25.9%
FrontierMath Tier 4 (v1)—6.3%

Knowledge GPT-5.4 nano leads

Gemini 2.0 Flash-Lite: 35.0 (#189), GPT-5.4 nano: 41.9 (#103)

BenchmarkGemini 2.0 Flash-LiteGPT-5.4 nano
LMArena Expert13051396
GPQA Diamond—78.5%
SimpleQA Verified—11.7%
MMLU-Pro72%—
Vectara Hallucination Rate—3.1%
GPQA (HELM)50%—

Multimodal GPT-5.4 nano leads

Gemini 2.0 Flash-Lite: 31.2 (#109), GPT-5.4 nano: 36.7 (#78)

BenchmarkGemini 2.0 Flash-LiteGPT-5.4 nano
LMArena Vision11001196

Multilingual GPT-5.4 nano leads

Gemini 2.0 Flash-Lite: 46.0 (#161), GPT-5.4 nano: 48.6 (#140)

BenchmarkGemini 2.0 Flash-LiteGPT-5.4 nano
LMArena Non-English13231359
LMArena Chinese13391392
LMArena French13471396
LMArena German13061367
LMArena Japanese13011343
LMArena Korean13251320
LMArena Russian13281363
LMArena Spanish13131371

Instruction Following GPT-5.4 nano leads

Gemini 2.0 Flash-Lite: 70.4 (#163), GPT-5.4 nano: 71.9 (#144)

BenchmarkGemini 2.0 Flash-LiteGPT-5.4 nano
LMArena Instruction Following13051362
LiveBench Instruction Following78.3%—
IFEval82.4%—

Long Context GPT-5.4 nano leads

Gemini 2.0 Flash-Lite: 40.1 (#160), GPT-5.4 nano: 41.6 (#137)

BenchmarkGemini 2.0 Flash-LiteGPT-5.4 nano
LMArena Longer Query13201366

Writing & Preference GPT-5.4 nano leads

Gemini 2.0 Flash-Lite: 51.7 (#177), GPT-5.4 nano: 55.7 (#142)

BenchmarkGemini 2.0 Flash-LiteGPT-5.4 nano
LMArena Text13301372
LMArena Creative Writing13191314
LMArena Multi-Turn13071382
WildBench79%—
LiveBench Language34.3%—

Frequently asked questions

Is Gemini 2.0 Flash-Lite better than GPT-5.4 nano?

GPT-5.4 nano is the stronger model overall, scoring 41.9 to 37.8 on the Noometry Index.

Is Gemini 2.0 Flash-Lite or GPT-5.4 nano better for coding?

GPT-5.4 nano scores higher on coding benchmarks: 43.6 versus 37.9 in the Noometry coding category.

How many benchmarks do Gemini 2.0 Flash-Lite and GPT-5.4 nano share?

20 benchmarks have published results for both models. Gemini 2.0 Flash-Lite has 32 scored results on Noometry and GPT-5.4 nano has 40.

Related comparisons

Go deeper