Noometry

Model comparison

Gemini 2.5 Flash-Lite vs Olmo 3.1 32b Instruct

Olmo 3.1 32b Instruct is the stronger model overall, scoring 38.8 to 36.4 on the Noometry Index.

Last verified . 16 shared benchmarks.

Gemini 2.5 Flash-Lite Google

36.4

Rank #208 Confirmed

Olmo 3.1 32b Instruct Allen Institute for AI (Ai2)

38.8

Rank #168 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Gemini 2.5 Flash-Lite scores higher in 4 categories and Olmo 3.1 32b Instruct in 4 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where Gemini 2.5 Flash-Lite leads 49.5 to 42.8.
  • Olmo 3.1 32b Instruct has downloadable open weights; the other is API-only.

Side by side

Gemini 2.5 Flash-LiteOlmo 3.1 32b Instruct
ProviderGoogleAllen Institute for AI (Ai2)
Noometry Index36.438.8
Released2025-06-17—
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.40—
Results tracked3316

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Gemini 2.5 Flash-Lite: 38.0 (#167), Olmo 3.1 32b Instruct: 38.9 (#154)

BenchmarkGemini 2.5 Flash-LiteOlmo 3.1 32b Instruct
LMArena Coding13731346
WeirdML35.2%—
ALE-Bench325.9—

Agentic & Tool Use Not comparable

Gemini 2.5 Flash-Lite: 27.8 (#89), Olmo 3.1 32b Instruct: —

BenchmarkGemini 2.5 Flash-LiteOlmo 3.1 32b Instruct
Berkeley Function Calling Leaderboard36.9%—

Reasoning Olmo 3.1 32b Instruct leads

Gemini 2.5 Flash-Lite: 21.5 (#196), Olmo 3.1 32b Instruct: 25.4 (#131)

BenchmarkGemini 2.5 Flash-LiteOlmo 3.1 32b Instruct
LMArena Hard Prompts13771322
Kagi LLM Benchmark40.5%—
DTBench62.8%—
LMCA18.1%—
Epoch Capabilities Index133.93—

Math Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 35.5 (#144), Olmo 3.1 32b Instruct: 33.6 (#169)

BenchmarkGemini 2.5 Flash-LiteOlmo 3.1 32b Instruct
LMArena Math13731305
Omni-MATH48%—

Knowledge Olmo 3.1 32b Instruct leads

Gemini 2.5 Flash-Lite: 32.1 (#206), Olmo 3.1 32b Instruct: 35.4 (#175)

BenchmarkGemini 2.5 Flash-LiteOlmo 3.1 32b Instruct
LMArena Expert13731307
MMLU-Pro53.7%—
Vectara Hallucination Rate3.3%—
GPQA (HELM)30.9%—

Multimodal Not comparable

Gemini 2.5 Flash-Lite: 28.6 (#109), Olmo 3.1 32b Instruct: —

BenchmarkGemini 2.5 Flash-LiteOlmo 3.1 32b Instruct
LMArena Vision1198—
VPCT30%—

Multilingual Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 49.5 (#129), Olmo 3.1 32b Instruct: 42.8 (#185)

BenchmarkGemini 2.5 Flash-LiteOlmo 3.1 32b Instruct
LMArena Non-English13691275
LMArena Chinese14041304
LMArena French13881328
LMArena German13901283
LMArena Korean13581206
LMArena Russian13731268
LMArena Spanish13961337
LMArena Japanese1359—

Instruction Following Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 70.2 (#163), Olmo 3.1 32b Instruct: 68.8 (#182)

BenchmarkGemini 2.5 Flash-LiteOlmo 3.1 32b Instruct
LMArena Instruction Following13661298
IFEval81%—

Long Context Olmo 3.1 32b Instruct leads

Gemini 2.5 Flash-Lite: 33.3 (#257), Olmo 3.1 32b Instruct: 39.9 (#161)

BenchmarkGemini 2.5 Flash-LiteOlmo 3.1 32b Instruct
LMArena Longer Query13731312
Fiction.LiveBench47.2%—

Writing & Preference Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 57.0 (#130), Olmo 3.1 32b Instruct: 50.4 (#179)

BenchmarkGemini 2.5 Flash-LiteOlmo 3.1 32b Instruct
LMArena Text13791311
LMArena Creative Writing13661264
LMArena Multi-Turn13671309
WildBench81.8%—

Frequently asked questions

Is Gemini 2.5 Flash-Lite better than Olmo 3.1 32b Instruct?

Olmo 3.1 32b Instruct is the stronger model overall, scoring 38.8 to 36.4 on the Noometry Index.

Is Gemini 2.5 Flash-Lite or Olmo 3.1 32b Instruct better for coding?

They score almost the same on coding (38.0 vs 38.9); test both on your own repository before choosing.

How many benchmarks do Gemini 2.5 Flash-Lite and Olmo 3.1 32b Instruct share?

16 benchmarks have published results for both models. Gemini 2.5 Flash-Lite has 33 scored results on Noometry and Olmo 3.1 32b Instruct has 16.

Related comparisons

Go deeper