Model comparison

Gemini 1.5 Flash 8B vs Gemini 3.7 Flash

Gemini 3.7 Flash is the stronger model overall, scoring 59.8 to 29.9 on the Noometry Index.

Last verified . 21 shared benchmarks.

Gemini 1.5 Flash 8B Google

29.9

Rank #301 Confirmed

Gemini 3.7 Flash Google

59.8

Rank #14 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 0 categories and Gemini 3.7 Flash in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 3.7 Flash leads 69.6 to 14.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.6% for Gemini 1.5 Flash 8B and 97.2% for Gemini 3.7 Flash.

Side by side

Gemini 1.5 Flash 8B and Gemini 3.7 Flash specifications
Gemini 1.5 Flash 8BGemini 3.7 Flash
ProviderGoogleGoogle
Noometry Index29.959.8
Released2024-10-032026-08-13
WeightsProprietaryProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$0.75
Output $ / M tokens—$3.75
Results tracked2144

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.7 Flash leads

Gemini 1.5 Flash 8B: 35.5 (#225), Gemini 3.7 Flash: 56.2 (#22)

Coding benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.7 Flash
LMArena Coding12181497
DeepSWE—65.5%
FrontierCode—43.6%
LMArena WebDev—1592
FrontierSWE—20.3%
SciCode—59.8%
ALE-Bench—904.3

Agentic & Tool Use Not comparable

Gemini 1.5 Flash 8B: —, Gemini 3.7 Flash: 42.1 (#19)

Agentic & Tool Use benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.7 Flash
APEX-Agents—67.8%
Remote Labor Index—5%
GDP.pdf—23.8%

Reasoning Gemini 3.7 Flash leads

Gemini 1.5 Flash 8B: 20.0 (#244), Gemini 3.7 Flash: 70.0 (#15)

Reasoning benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.7 Flash
LMArena Hard Prompts12091494
DTBench50%96.8%
ARC-AGI-2—84.6%
NYT Connections (extended)—94%
ARC-AGI-1—95.5%
CritPt—14.3%
Chess Puzzles—47%
Mystery Game Puzzles—37%
LMCA—50.4%
Epoch Capabilities Index—157.27

Math Gemini 3.7 Flash leads

Gemini 1.5 Flash 8B: 14.2 (#302), Gemini 3.7 Flash: 69.6 (#23)

Math benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.7 Flash
OTIS Mock AIME 2024-20254.6%97.2%
LMArena Math12071507
FrontierMath (Tiers 1-3)—71.6%
FrontierMath Tier 4—36.6%
ProofBench—58%

Knowledge Gemini 3.7 Flash leads

Gemini 1.5 Flash 8B: 16.0 (#289), Gemini 3.7 Flash: 69.7 (#5)

Knowledge benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.7 Flash
GPQA Diamond33%94.8%
LMArena Expert11851508
SimpleQA Verified—69.2%

Multimodal Gemini 3.7 Flash leads

Gemini 1.5 Flash 8B: 28.2 (#115), Gemini 3.7 Flash: 37.3 (#73)

Multimodal benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.7 Flash
LMArena Vision10441316
Furniture Assembly—26.7%

Multilingual Gemini 3.7 Flash leads

Gemini 1.5 Flash 8B: 38.5 (#229), Gemini 3.7 Flash: 57.6 (#7)

Multilingual benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.7 Flash
LMArena Non-English12151484
LMArena Chinese12311548
LMArena French12341505
LMArena German12061498
LMArena Japanese11501512
LMArena Korean11401483
LMArena Russian12361516
LMArena Spanish12121503

Instruction Following Gemini 3.7 Flash leads

Gemini 1.5 Flash 8B: 62.8 (#236), Gemini 3.7 Flash: 77.7 (#15)

Instruction Following benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.7 Flash
LMArena Instruction Following11991483

Long Context Gemini 3.7 Flash leads

Gemini 1.5 Flash 8B: 37.0 (#225), Gemini 3.7 Flash: 45.7 (#30)

Long Context benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.7 Flash
LMArena Longer Query12191492

Writing & Preference Gemini 3.7 Flash leads

Gemini 1.5 Flash 8B: 42.8 (#232), Gemini 3.7 Flash: 71.2 (#20)

Writing & Preference benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.7 Flash
LMArena Text12261486
LMArena Creative Writing12181490
LMArena Multi-Turn11851489
EQ-Bench Creative Writing—1723

Frequently asked questions

Is Gemini 1.5 Flash 8B better than Gemini 3.7 Flash?

Gemini 3.7 Flash is the stronger model overall, scoring 59.8 to 29.9 on the Noometry Index.

Is Gemini 1.5 Flash 8B or Gemini 3.7 Flash better for coding?

Gemini 3.7 Flash scores higher on coding benchmarks: 56.2 versus 35.5 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash 8B and Gemini 3.7 Flash share?

21 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and Gemini 3.7 Flash has 44.

Related comparisons

Go deeper