Noometry

Model comparison

Gemini 3.8 Flash vs Olmo 3.1 32b Think

Gemini 3.8 Flash is the stronger model overall, scoring 59.5 to 37.3 on the Noometry Index.

Last verified . 15 shared benchmarks.

Gemini 3.8 Flash Google

59.5

Rank #13 Confirmed

Olmo 3.1 32b Think Allen Institute for AI (Ai2)

37.3

Rank #191 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Gemini 3.8 Flash scores higher in 8 categories and Olmo 3.1 32b Think in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.8 Flash leads 64.7 to 24.1.
  • Olmo 3.1 32b Think has downloadable open weights; the other is API-only.

Side by side

Gemini 3.8 FlashOlmo 3.1 32b Think
ProviderGoogleAllen Institute for AI (Ai2)
Noometry Index59.537.3
Released2026-09-02—
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$0.75—
Output $ / M tokens$3.75—
Results tracked4615

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.8 Flash leads

Gemini 3.8 Flash: 56.4 (#17), Olmo 3.1 32b Think: 37.1 (#186)

BenchmarkGemini 3.8 FlashOlmo 3.1 32b Think
LMArena Coding15121292
DeepSWE73.8%—
FrontierCode41.2%—
CursorBench39.6%—
LMArena WebDev1581—
FrontierSWE19.6%—
SciCode56.6%—
ALE-Bench1,270—

Agentic & Tool Use Not comparable

Gemini 3.8 Flash: 40.3 (#22), Olmo 3.1 32b Think: —

BenchmarkGemini 3.8 FlashOlmo 3.1 32b Think
APEX-Agents64.3%—
GDP.pdf23.4%—
Vending-Bench 25,094—

Reasoning Gemini 3.8 Flash leads

Gemini 3.8 Flash: 64.7 (#13), Olmo 3.1 32b Think: 24.1 (#151)

BenchmarkGemini 3.8 FlashOlmo 3.1 32b Think
LMArena Hard Prompts15061272
NYT Connections (extended)97.4%—
CritPt18.3%—
Chess Puzzles61%—
Mystery Game Puzzles47%—
DTBench95.7%—
LMCA52.9%—
Surface Evolver Bench76.9%—
Epoch Capabilities Index157.13—

Math Gemini 3.8 Flash leads

Gemini 3.8 Flash: 65.2 (#22), Olmo 3.1 32b Think: 33.6 (#170)

BenchmarkGemini 3.8 FlashOlmo 3.1 32b Think
LMArena Math15281305
FrontierMath (Tiers 1-3)68.4%—
FrontierMath Tier 422%—
OTIS Mock AIME 2024-202598.9%—
ProofBench48%—

Knowledge Gemini 3.8 Flash leads

Gemini 3.8 Flash: 74.9 (#2), Olmo 3.1 32b Think: 35.0 (#178)

BenchmarkGemini 3.8 FlashOlmo 3.1 32b Think
LMArena Expert15291294
GPQA Diamond95.4%—
Humanity's Last Exam44.5%—
SimpleQA Verified69.7%—

Multimodal Not comparable

Gemini 3.8 Flash: 40.9 (#33), Olmo 3.1 32b Think: —

BenchmarkGemini 3.8 FlashOlmo 3.1 32b Think
LMArena Vision1312—
Blueprint-Bench 238.6%—
Furniture Assembly31.7%—

Multilingual Gemini 3.8 Flash leads

Gemini 3.8 Flash: 57.9 (#5), Olmo 3.1 32b Think: 38.3 (#226)

BenchmarkGemini 3.8 FlashOlmo 3.1 32b Think
LMArena Non-English14861210
LMArena Chinese15471241
LMArena French15021262
LMArena German14701260
LMArena Russian15071193
LMArena Spanish14921288
LMArena Japanese1505—
LMArena Korean1479—

Instruction Following Gemini 3.8 Flash leads

Gemini 3.8 Flash: 78.2 (#11), Olmo 3.1 32b Think: 65.8 (#213)

BenchmarkGemini 3.8 FlashOlmo 3.1 32b Think
LMArena Instruction Following14891246

Long Context Gemini 3.8 Flash leads

Gemini 3.8 Flash: 46.2 (#23), Olmo 3.1 32b Think: 38.6 (#190)

BenchmarkGemini 3.8 FlashOlmo 3.1 32b Think
LMArena Longer Query15061272

Writing & Preference Gemini 3.8 Flash leads

Gemini 3.8 Flash: 72.1 (#16), Olmo 3.1 32b Think: 46.4 (#215)

BenchmarkGemini 3.8 FlashOlmo 3.1 32b Think
LMArena Text14941271
LMArena Creative Writing14851226
LMArena Multi-Turn15031252
EQ-Bench Creative Writing1748—

Frequently asked questions

Is Gemini 3.8 Flash better than Olmo 3.1 32b Think?

Gemini 3.8 Flash is the stronger model overall, scoring 59.5 to 37.3 on the Noometry Index.

Is Gemini 3.8 Flash or Olmo 3.1 32b Think better for coding?

Gemini 3.8 Flash scores higher on coding benchmarks: 56.4 versus 37.1 in the Noometry coding category.

How many benchmarks do Gemini 3.8 Flash and Olmo 3.1 32b Think share?

15 benchmarks have published results for both models. Gemini 3.8 Flash has 46 scored results on Noometry and Olmo 3.1 32b Think has 15.

Related comparisons

Go deeper