Noometry

Model comparison

Gemini 1.5 Flash 8B vs Gemini 2.5 Flash-Lite

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 37.0 to 29.9 on the Noometry Index.

Last verified . 19 shared benchmarks.

Gemini 1.5 Flash 8B Google

29.9

Rank #301 Confirmed

Gemini 2.5 Flash-Lite Google

37.0

Rank #211 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 1 category and Gemini 2.5 Flash-Lite in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 2.5 Flash-Lite leads 38.0 to 14.2.
  • The biggest single-benchmark swing is DTBench: 50% for Gemini 1.5 Flash 8B and 62.8% for Gemini 2.5 Flash-Lite.

Side by side

Gemini 1.5 Flash 8BGemini 2.5 Flash-Lite
ProviderGoogleGoogle
Noometry Index29.937.0
Released2024-10-032025-06-17
WeightsProprietaryProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.40
Results tracked2133

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash-Lite leads

Gemini 1.5 Flash 8B: 35.5 (#225), Gemini 2.5 Flash-Lite: 38.5 (#173)

BenchmarkGemini 1.5 Flash 8BGemini 2.5 Flash-Lite
LMArena Coding12181373
WeirdML—35.2%
ALE-Bench—325.9

Agentic & Tool Use Not comparable

Gemini 1.5 Flash 8B: —, Gemini 2.5 Flash-Lite: 28.0 (#96)

BenchmarkGemini 1.5 Flash 8BGemini 2.5 Flash-Lite
Berkeley Function Calling Leaderboard—36.9%

Reasoning Gemini 2.5 Flash-Lite leads

Gemini 1.5 Flash 8B: 20.0 (#244), Gemini 2.5 Flash-Lite: 22.2 (#205)

BenchmarkGemini 1.5 Flash 8BGemini 2.5 Flash-Lite
LMArena Hard Prompts12091377
DTBench50%62.8%
Kagi LLM Benchmark—40.5%
LMCA—18.1%
Epoch Capabilities Index—133.94

Math Gemini 2.5 Flash-Lite leads

Gemini 1.5 Flash 8B: 14.2 (#302), Gemini 2.5 Flash-Lite: 38.0 (#144)

BenchmarkGemini 1.5 Flash 8BGemini 2.5 Flash-Lite
LMArena Math12071373
OTIS Mock AIME 2024-20254.6%—
Omni-MATH—48%

Knowledge Gemini 2.5 Flash-Lite leads

Gemini 1.5 Flash 8B: 16.0 (#289), Gemini 2.5 Flash-Lite: 32.5 (#210)

BenchmarkGemini 1.5 Flash 8BGemini 2.5 Flash-Lite
LMArena Expert11851373
GPQA Diamond33%—
MMLU-Pro—53.7%
Vectara Hallucination Rate—3.3%
GPQA (HELM)—30.9%

Multimodal Too close to call

Gemini 1.5 Flash 8B: 28.2 (#115), Gemini 2.5 Flash-Lite: 29.1 (#114)

BenchmarkGemini 1.5 Flash 8BGemini 2.5 Flash-Lite
LMArena Vision10441198
VPCT—30%

Multilingual Gemini 2.5 Flash-Lite leads

Gemini 1.5 Flash 8B: 38.5 (#229), Gemini 2.5 Flash-Lite: 49.3 (#134)

BenchmarkGemini 1.5 Flash 8BGemini 2.5 Flash-Lite
LMArena Non-English12151369
LMArena Chinese12311404
LMArena French12341388
LMArena German12061389
LMArena Japanese11501359
LMArena Korean11401360
LMArena Russian12361373
LMArena Spanish12121396

Instruction Following Gemini 2.5 Flash-Lite leads

Gemini 1.5 Flash 8B: 62.8 (#236), Gemini 2.5 Flash-Lite: 70.0 (#168)

BenchmarkGemini 1.5 Flash 8BGemini 2.5 Flash-Lite
LMArena Instruction Following11991367
IFEval—81%

Long Context Gemini 1.5 Flash 8B leads

Gemini 1.5 Flash 8B: 37.0 (#225), Gemini 2.5 Flash-Lite: 33.3 (#262)

BenchmarkGemini 1.5 Flash 8BGemini 2.5 Flash-Lite
LMArena Longer Query12191373
Fiction.LiveBench—47.2%

Writing & Preference Gemini 2.5 Flash-Lite leads

Gemini 1.5 Flash 8B: 42.8 (#232), Gemini 2.5 Flash-Lite: 56.8 (#135)

BenchmarkGemini 1.5 Flash 8BGemini 2.5 Flash-Lite
LMArena Text12261379
LMArena Creative Writing12181367
LMArena Multi-Turn11851366
WildBench—81.8%

Frequently asked questions

Is Gemini 1.5 Flash 8B better than Gemini 2.5 Flash-Lite?

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 37.0 to 29.9 on the Noometry Index.

Is Gemini 1.5 Flash 8B or Gemini 2.5 Flash-Lite better for coding?

Gemini 2.5 Flash-Lite scores higher on coding benchmarks: 38.5 versus 35.5 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash 8B and Gemini 2.5 Flash-Lite share?

19 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and Gemini 2.5 Flash-Lite has 33.

Related comparisons

Go deeper