Model comparison

Gemini 3.5 Flash Lite vs Olmo 2 0325 32b Instruct

Gemini 3.5 Flash Lite is the stronger model overall, scoring 41.5 to 32.7 on the Noometry Index.

Last verified . 11 shared benchmarks.

Summary

  • They share 11 benchmarks with published results for both. Gemini 3.5 Flash Lite scores higher in 7 categories and Olmo 2 0325 32b Instruct in 1 category; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 3.5 Flash Lite leads 50.1 to 19.5.
  • Olmo 2 0325 32b Instruct has downloadable open weights; the other is API-only.

Side by side

Gemini 3.5 Flash Lite and Olmo 2 0325 32b Instruct specifications
Gemini 3.5 Flash LiteOlmo 2 0325 32b Instruct
ProviderGoogleAllen Institute for AI (Ai2)
Noometry Index41.532.7
Released2026-07-21—
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$0.30—
Output $ / M tokens$2.50—
Results tracked3916

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 42.4 (#104), Olmo 2 0325 32b Instruct: 35.2 (#227)

Coding benchmarks
BenchmarkGemini 3.5 Flash LiteOlmo 2 0325 32b Instruct
LMArena Coding14531210
LMArena WebDev1440—
SciCode41.3%—
WeirdML39%—
ALE-Bench765.27—

Agentic & Tool Use Not comparable

Gemini 3.5 Flash Lite: 25.7 (#107), Olmo 2 0325 32b Instruct: —

Agentic & Tool Use benchmarks
BenchmarkGemini 3.5 Flash LiteOlmo 2 0325 32b Instruct
APEX-Agents29.3%—
GDP.pdf10%—

Reasoning Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 27.8 (#114), Olmo 2 0325 32b Instruct: 23.6 (#175)

Reasoning benchmarks
BenchmarkGemini 3.5 Flash LiteOlmo 2 0325 32b Instruct
LMArena Hard Prompts14411208
ARC-AGI-210.3%—
NYT Connections (extended)60.4%—
ARC-AGI-153.5%—
CritPt0%—
Chess Puzzles22%—
Mystery Game Puzzles19%—
DTBench83.5%—
LMCA37.6%—
Epoch Capabilities Index145.13—

Math Too close to call

Gemini 3.5 Flash Lite: 25.9 (#264), Olmo 2 0325 32b Instruct: 26.8 (#255)

Math benchmarks
BenchmarkGemini 3.5 Flash LiteOlmo 2 0325 32b Instruct
LMArena Math14331208
FrontierMath (Tiers 1-3)26%—
FrontierMath Tier 40%—
OTIS Mock AIME 2024-202571.1%—
ProofBench13%—
Omni-MATH—16.1%

Knowledge Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 50.1 (#72), Olmo 2 0325 32b Instruct: 19.5 (#279)

Knowledge benchmarks
BenchmarkGemini 3.5 Flash LiteOlmo 2 0325 32b Instruct
GPQA Diamond83.3%—
MMLU-Pro—41.4%
GPQA (HELM)—28.7%
LMArena Expert1435—

Multimodal Not comparable

Gemini 3.5 Flash Lite: 41.1 (#40), Olmo 2 0325 32b Instruct: —

Multimodal benchmarks
BenchmarkGemini 3.5 Flash LiteOlmo 2 0325 32b Instruct
LMArena Vision1268—

Multilingual Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 53.5 (#63), Olmo 2 0325 32b Instruct: 34.8 (#248)

Multilingual benchmarks
BenchmarkGemini 3.5 Flash LiteOlmo 2 0325 32b Instruct
LMArena Non-English14271160
LMArena Chinese14691192
LMArena Russian14431187
LMArena French1451—
LMArena German1454—
LMArena Japanese1427—
LMArena Korean1407—
LMArena Spanish1442—

Instruction Following Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 74.8 (#85), Olmo 2 0325 32b Instruct: 61.5 (#244)

Instruction Following benchmarks
BenchmarkGemini 3.5 Flash LiteOlmo 2 0325 32b Instruct
LMArena Instruction Following14201186
IFEval—78%

Long Context Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 43.9 (#84), Olmo 2 0325 32b Instruct: 36.2 (#234)

Long Context benchmarks
BenchmarkGemini 3.5 Flash LiteOlmo 2 0325 32b Instruct
LMArena Longer Query14351194

Writing & Preference Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 64.2 (#57), Olmo 2 0325 32b Instruct: 42.1 (#236)

Writing & Preference benchmarks
BenchmarkGemini 3.5 Flash LiteOlmo 2 0325 32b Instruct
LMArena Text14351218
LMArena Creative Writing14201199
LMArena Multi-Turn14451221
EQ-Bench Creative Writing1559—
WildBench—73.4%

Frequently asked questions

Is Gemini 3.5 Flash Lite better than Olmo 2 0325 32b Instruct?

Gemini 3.5 Flash Lite is the stronger model overall, scoring 41.5 to 32.7 on the Noometry Index.

Is Gemini 3.5 Flash Lite or Olmo 2 0325 32b Instruct better for coding?

Gemini 3.5 Flash Lite scores higher on coding benchmarks: 42.4 versus 35.2 in the Noometry coding category.

How many benchmarks do Gemini 3.5 Flash Lite and Olmo 2 0325 32b Instruct share?

11 benchmarks have published results for both models. Gemini 3.5 Flash Lite has 39 scored results on Noometry and Olmo 2 0325 32b Instruct has 16.

Related comparisons

Go deeper