Noometry

Model comparison

Gemini 3.5 Flash Lite vs Olmo 7b Instruct

Gemini 3.5 Flash Lite is the stronger model overall, scoring 41.5 to 30.3 on the Noometry Index.

Last verified . 10 shared benchmarks.

Gemini 3.5 Flash Lite Google

41.5

Rank #133 Confirmed

Olmo 7b Instruct Allen Institute for AI (Ai2)

30.3

Rank #295 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Gemini 3.5 Flash Lite scores higher in 5 categories and Olmo 7b Instruct in 1 category; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemini 3.5 Flash Lite leads 64.2 to 25.8.
  • Olmo 7b Instruct has downloadable open weights; the other is API-only.

Side by side

Gemini 3.5 Flash LiteOlmo 7b Instruct
ProviderGoogleAllen Institute for AI (Ai2)
Noometry Index41.530.3
Released2026-07-21—
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$0.30—
Output $ / M tokens$2.50—
Results tracked3910

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 42.4 (#104), Olmo 7b Instruct: 29.6 (#303)

BenchmarkGemini 3.5 Flash LiteOlmo 7b Instruct
LMArena Coding14531016
LMArena WebDev1440—
SciCode41.3%—
WeirdML39%—
ALE-Bench765.27—

Agentic & Tool Use Not comparable

Gemini 3.5 Flash Lite: 25.7 (#107), Olmo 7b Instruct: —

BenchmarkGemini 3.5 Flash LiteOlmo 7b Instruct
APEX-Agents29.3%—
GDP.pdf10%—

Reasoning Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 27.8 (#114), Olmo 7b Instruct: 18.8 (#274)

BenchmarkGemini 3.5 Flash LiteOlmo 7b Instruct
LMArena Hard Prompts1441993
ARC-AGI-210.3%—
NYT Connections (extended)60.4%—
ARC-AGI-153.5%—
CritPt0%—
Chess Puzzles22%—
Mystery Game Puzzles19%—
DTBench83.5%—
LMCA37.6%—
Epoch Capabilities Index145.13—

Math Olmo 7b Instruct leads

Gemini 3.5 Flash Lite: 25.9 (#264), Olmo 7b Instruct: 30.2 (#237)

BenchmarkGemini 3.5 Flash LiteOlmo 7b Instruct
LMArena Math14331018
FrontierMath (Tiers 1-3)26%—
FrontierMath Tier 40%—
OTIS Mock AIME 2024-202571.1%—
ProofBench13%—

Knowledge Not comparable

Gemini 3.5 Flash Lite: 50.1 (#72), Olmo 7b Instruct: —

BenchmarkGemini 3.5 Flash LiteOlmo 7b Instruct
GPQA Diamond83.3%—
LMArena Expert1435—

Multimodal Not comparable

Gemini 3.5 Flash Lite: 41.1 (#40), Olmo 7b Instruct: —

BenchmarkGemini 3.5 Flash LiteOlmo 7b Instruct
LMArena Vision1268—

Multilingual Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 53.5 (#63), Olmo 7b Instruct: 24.0 (#291)

BenchmarkGemini 3.5 Flash LiteOlmo 7b Instruct
LMArena Non-English1427977
LMArena Chinese14691014
LMArena Russian1443947
LMArena French1451—
LMArena German1454—
LMArena Japanese1427—
LMArena Korean1407—
LMArena Spanish1442—

Instruction Following Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 74.8 (#85), Olmo 7b Instruct: 49.0 (#301)

BenchmarkGemini 3.5 Flash LiteOlmo 7b Instruct
LMArena Instruction Following1420978

Long Context Not comparable

Gemini 3.5 Flash Lite: 43.9 (#84), Olmo 7b Instruct: —

BenchmarkGemini 3.5 Flash LiteOlmo 7b Instruct
LMArena Longer Query1435—

Writing & Preference Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 64.2 (#57), Olmo 7b Instruct: 25.8 (#303)

BenchmarkGemini 3.5 Flash LiteOlmo 7b Instruct
LMArena Text14351032
LMArena Creative Writing1420990
LMArena Multi-Turn14451007
EQ-Bench Creative Writing1559—

Frequently asked questions

Is Gemini 3.5 Flash Lite better than Olmo 7b Instruct?

Gemini 3.5 Flash Lite is the stronger model overall, scoring 41.5 to 30.3 on the Noometry Index.

Is Gemini 3.5 Flash Lite or Olmo 7b Instruct better for coding?

Gemini 3.5 Flash Lite scores higher on coding benchmarks: 42.4 versus 29.6 in the Noometry coding category.

How many benchmarks do Gemini 3.5 Flash Lite and Olmo 7b Instruct share?

10 benchmarks have published results for both models. Gemini 3.5 Flash Lite has 39 scored results on Noometry and Olmo 7b Instruct has 10.

Related comparisons

Go deeper