Noometry

Model comparison

Gemini 1.5 Flash (May 2024) vs Gemini 2.0 Flash-Lite

Gemini 2.0 Flash-Lite is the stronger model overall, scoring 37.8 to 33.2 on the Noometry Index.

Last verified . 25 shared benchmarks.

Gemini 1.5 Flash (May 2024) Google

33.2

Rank #246 Confirmed

Gemini 2.0 Flash-Lite Google

37.8

Rank #194 Confirmed

Summary

  • They share 25 benchmarks with published results for both. Gemini 1.5 Flash (May 2024) scores higher in 1 category and Gemini 2.0 Flash-Lite in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 2.0 Flash-Lite leads 34.1 to 22.1.
  • The biggest single-benchmark swing is Omni-MATH: 30.4% for Gemini 1.5 Flash (May 2024) and 37.4% for Gemini 2.0 Flash-Lite.

Side by side

Gemini 1.5 Flash (May 2024)Gemini 2.0 Flash-Lite
ProviderGoogleGoogle
Noometry Index33.237.8
Released2024-05-142025-02-05
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked4232

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.0 Flash-Lite leads

Gemini 1.5 Flash (May 2024): 34.4 (#236), Gemini 2.0 Flash-Lite: 37.9 (#185)

BenchmarkGemini 1.5 Flash (May 2024)Gemini 2.0 Flash-Lite
LMArena Coding12611322
WeirdML24.9%—
BigCodeBench Instruct43.5%—
LiveBench Coding—47.1%
BigCodeBench Complete55.1%—
HumanEval+75.6%—
MBPP+67.5%—

Agentic & Tool Use Not comparable

Gemini 1.5 Flash (May 2024): 26.6 (#102), Gemini 2.0 Flash-Lite: —

BenchmarkGemini 1.5 Flash (May 2024)Gemini 2.0 Flash-Lite
BALROG14.6%—

Reasoning Too close to call

Gemini 1.5 Flash (May 2024): 21.7 (#215), Gemini 2.0 Flash-Lite: 22.0 (#210)

BenchmarkGemini 1.5 Flash (May 2024)Gemini 2.0 Flash-Lite
LMArena Hard Prompts12571324
DTBench53.8%52.5%
ForecastBench53.957.1
LiveBench Reasoning—50.1%
LiveBench Data Analysis—65.5%
Epoch Capabilities Index129.36—
LiveBench—54.3%
PIQA87.5%—

Math Gemini 2.0 Flash-Lite leads

Gemini 1.5 Flash (May 2024): 22.1 (#281), Gemini 2.0 Flash-Lite: 34.1 (#196)

BenchmarkGemini 1.5 Flash (May 2024)Gemini 2.0 Flash-Lite
Omni-MATH30.4%37.4%
LMArena Math12691309
OTIS Mock AIME 2024-202516.3%—
LiveBench Math—58.1%
MATH Level 561.9%—
FrontierMath (Feb 2025 set)0%—
GSM8K82.4%—

Knowledge Gemini 2.0 Flash-Lite leads

Gemini 1.5 Flash (May 2024): 26.2 (#260), Gemini 2.0 Flash-Lite: 35.0 (#189)

BenchmarkGemini 1.5 Flash (May 2024)Gemini 2.0 Flash-Lite
MMLU-Pro67.8%72%
GPQA (HELM)43.7%50%
LMArena Expert12331305
GPQA Diamond47.3%—
BoolQ85.8%—
MMLU77.9%—

Multimodal Gemini 1.5 Flash (May 2024) leads

Gemini 1.5 Flash (May 2024): 36.0 (#81), Gemini 2.0 Flash-Lite: 31.2 (#109)

BenchmarkGemini 1.5 Flash (May 2024)Gemini 2.0 Flash-Lite
LMArena Vision11411100
Video-MME70.3%—
GeoBench76%—

Multilingual Gemini 2.0 Flash-Lite leads

Gemini 1.5 Flash (May 2024): 42.9 (#189), Gemini 2.0 Flash-Lite: 46.0 (#161)

BenchmarkGemini 1.5 Flash (May 2024)Gemini 2.0 Flash-Lite
LMArena Non-English12781323
LMArena Chinese12951339
LMArena French12581347
LMArena German12621306
LMArena Japanese12521301
LMArena Korean12211325
LMArena Russian12881328
LMArena Spanish12431313

Instruction Following Gemini 2.0 Flash-Lite leads

Gemini 1.5 Flash (May 2024): 66.8 (#205), Gemini 2.0 Flash-Lite: 70.4 (#163)

BenchmarkGemini 1.5 Flash (May 2024)Gemini 2.0 Flash-Lite
IFEval83.1%82.4%
LMArena Instruction Following12581305
LiveBench Instruction Following—78.3%

Long Context Gemini 2.0 Flash-Lite leads

Gemini 1.5 Flash (May 2024): 39.0 (#187), Gemini 2.0 Flash-Lite: 40.1 (#160)

BenchmarkGemini 1.5 Flash (May 2024)Gemini 2.0 Flash-Lite
LMArena Longer Query12841320

Writing & Preference Gemini 2.0 Flash-Lite leads

Gemini 1.5 Flash (May 2024): 48.7 (#196), Gemini 2.0 Flash-Lite: 51.7 (#177)

BenchmarkGemini 1.5 Flash (May 2024)Gemini 2.0 Flash-Lite
LMArena Text12871330
LMArena Creative Writing12851319
WildBench79.2%79%
LMArena Multi-Turn12531307
LiveBench Language—34.3%

Frequently asked questions

Is Gemini 1.5 Flash (May 2024) better than Gemini 2.0 Flash-Lite?

Gemini 2.0 Flash-Lite is the stronger model overall, scoring 37.8 to 33.2 on the Noometry Index.

Is Gemini 1.5 Flash (May 2024) or Gemini 2.0 Flash-Lite better for coding?

Gemini 2.0 Flash-Lite scores higher on coding benchmarks: 37.9 versus 34.4 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash (May 2024) and Gemini 2.0 Flash-Lite share?

25 benchmarks have published results for both models. Gemini 1.5 Flash (May 2024) has 42 scored results on Noometry and Gemini 2.0 Flash-Lite has 32.

Related comparisons

Go deeper