Model comparison

Gemini 1.5 Flash 8B vs Gemini 3.5 Flash

Gemini 3.5 Flash is the stronger model overall, scoring 54.2 to 29.9 on the Noometry Index.

Last verified . 21 shared benchmarks.

Gemini 1.5 Flash 8B Google

29.9

Rank #301 Confirmed

Gemini 3.5 Flash Google

54.2

Rank #32 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 0 categories and Gemini 3.5 Flash in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 3.5 Flash leads 66.3 to 16.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.6% for Gemini 1.5 Flash 8B and 95.6% for Gemini 3.5 Flash.

Side by side

Gemini 1.5 Flash 8B and Gemini 3.5 Flash specifications
Gemini 1.5 Flash 8BGemini 3.5 Flash
ProviderGoogleGoogle
Noometry Index29.954.2
Released2024-10-032026-05-19
WeightsProprietaryProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$1.50
Output $ / M tokens—$9
Results tracked2154

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.5 Flash leads

Gemini 1.5 Flash 8B: 35.5 (#225), Gemini 3.5 Flash: 49.4 (#49)

Coding benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.5 Flash
LMArena Coding12181492
SWE-bench Verified—79.3%
DeepSWE—37.4%
LMArena WebDev—1499
SciCode—53.1%
WeirdML—62.6%
ALE-Bench—911.02

Agentic & Tool Use Not comparable

Gemini 1.5 Flash 8B: —, Gemini 3.5 Flash: 24.7 (#114)

Agentic & Tool Use benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.5 Flash
APEX-Agents—27.5%
GBAEval—6.7%
GDP.pdf—14%
Vending-Bench 2—5,396

Reasoning Gemini 3.5 Flash leads

Gemini 1.5 Flash 8B: 20.0 (#244), Gemini 3.5 Flash: 62.8 (#18)

Reasoning benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.5 Flash
LMArena Hard Prompts12091488
DTBench50%94.7%
ARC-AGI-2—72.1%
SimpleBench—76.7%
NYT Connections (extended)—92.6%
ARC-AGI-1—92.5%
CritPt—13.1%
Chess Puzzles—50%
EnigmaEval—25.4%
EBR-Bench—4.8%
Mystery Game Puzzles—32%
LMCA—47.1%
Surface Evolver Bench—58.1%
Epoch Capabilities Index—154.46
ForecastBench—59

Math Gemini 3.5 Flash leads

Gemini 1.5 Flash 8B: 14.2 (#302), Gemini 3.5 Flash: 60.7 (#36)

Math benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.5 Flash
OTIS Mock AIME 2024-20254.6%95.6%
LMArena Math12071504
FrontierMath (Tiers 1-3)—62.8%
FrontierMath Tier 4—26.8%
MathArena Final-Answer Competitions—76.3%
ProofBench—31%
FrontierMath (Feb 2025 set)—39%
FrontierMath Tier 4 (v1)—14.6%

Knowledge Gemini 3.5 Flash leads

Gemini 1.5 Flash 8B: 16.0 (#289), Gemini 3.5 Flash: 66.3 (#11)

Knowledge benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.5 Flash
GPQA Diamond33%92.8%
LMArena Expert11851495
SimpleQA Verified—66.2%

Multimodal Gemini 3.5 Flash leads

Gemini 1.5 Flash 8B: 28.2 (#115), Gemini 3.5 Flash: 45.7 (#15)

Multimodal benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.5 Flash
LMArena Vision10441310
Blueprint-Bench 2—33.6%
LMArena Document—1463

Multilingual Gemini 3.5 Flash leads

Gemini 1.5 Flash 8B: 38.5 (#229), Gemini 3.5 Flash: 57.0 (#13)

Multilingual benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.5 Flash
LMArena Non-English12151476
LMArena Chinese12311526
LMArena French12341490
LMArena German12061492
LMArena Japanese11501486
LMArena Korean11401451
LMArena Russian12361493
LMArena Spanish12121480

Instruction Following Gemini 3.5 Flash leads

Gemini 1.5 Flash 8B: 62.8 (#236), Gemini 3.5 Flash: 77.0 (#30)

Instruction Following benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.5 Flash
LMArena Instruction Following11991467

Long Context Gemini 3.5 Flash leads

Gemini 1.5 Flash 8B: 37.0 (#225), Gemini 3.5 Flash: 45.4 (#38)

Long Context benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.5 Flash
LMArena Longer Query12191482

Writing & Preference Gemini 3.5 Flash leads

Gemini 1.5 Flash 8B: 42.8 (#232), Gemini 3.5 Flash: 65.5 (#47)

Writing & Preference benchmarks
BenchmarkGemini 1.5 Flash 8BGemini 3.5 Flash
LMArena Text12261482
LMArena Creative Writing12181470
LMArena Multi-Turn11851481
EQ-Bench 4—1087

Frequently asked questions

Is Gemini 1.5 Flash 8B better than Gemini 3.5 Flash?

Gemini 3.5 Flash is the stronger model overall, scoring 54.2 to 29.9 on the Noometry Index.

Is Gemini 1.5 Flash 8B or Gemini 3.5 Flash better for coding?

Gemini 3.5 Flash scores higher on coding benchmarks: 49.4 versus 35.5 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash 8B and Gemini 3.5 Flash share?

21 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and Gemini 3.5 Flash has 54.

Related comparisons

Go deeper