Noometry

Model comparison

Gemini 3.8 Flash vs Gemma 1.1 7b IT

Gemini 3.8 Flash is the stronger model overall, scoring 61.8 to 31.3 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemini 3.8 Flash Google

61.8

Rank #11 Confirmed

Gemma 1.1 7b IT Google

31.3

Rank #277 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemini 3.8 Flash scores higher in 8 categories and Gemma 1.1 7b IT in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.8 Flash leads 76.9 to 20.5.
  • Gemma 1.1 7b IT has downloadable open weights; the other is API-only.

Side by side

Gemini 3.8 FlashGemma 1.1 7b IT
ProviderGoogleGoogle
Noometry Index61.831.3
Released2026-09-02—
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$0.75—
Output $ / M tokens$3.75—
Results tracked5019

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.8 Flash leads

Gemini 3.8 Flash: 59.2 (#15), Gemma 1.1 7b IT: 31.5 (#284)

BenchmarkGemini 3.8 FlashGemma 1.1 7b IT
LMArena Coding15101084
DeepSWE73.8%—
FrontierCode41.2%—
CursorBench39.6%—
LMArena WebDev1584—
FrontierSWE19.6%—
SciCode56.6%—
WeirdML84.8%—
ALE-Bench1,270—
HumanEval+—35.4%
MBPP+—45%

Agentic & Tool Use Not comparable

Gemini 3.8 Flash: 41.8 (#21), Gemma 1.1 7b IT: —

BenchmarkGemini 3.8 FlashGemma 1.1 7b IT
APEX-Agents64.3%—
Remote Labor Index5.8%—
GDP.pdf23.4%—
Vending-Bench 25,094—

Reasoning Gemini 3.8 Flash leads

Gemini 3.8 Flash: 76.9 (#5), Gemma 1.1 7b IT: 20.5 (#238)

BenchmarkGemini 3.8 FlashGemma 1.1 7b IT
LMArena Hard Prompts15081071
ARC-AGI-289.2%—
NYT Connections (extended)97.4%—
ARC-AGI-198.5%—
CritPt18.3%—
Chess Puzzles61%—
Mystery Game Puzzles47%—
DTBench95.7%—
LMCA52.9%—
Surface Evolver Bench76.9%—
Epoch Capabilities Index156.71—

Math Gemini 3.8 Flash leads

Gemini 3.8 Flash: 65.3 (#28), Gemma 1.1 7b IT: 32.0 (#220)

BenchmarkGemini 3.8 FlashGemma 1.1 7b IT
LMArena Math15281107
FrontierMath (Tiers 1-3)68.4%—
FrontierMath Tier 422%—
OTIS Mock AIME 2024-202598.9%—
ProofBench48%—

Knowledge Gemini 3.8 Flash leads

Gemini 3.8 Flash: 74.8 (#2), Gemma 1.1 7b IT: 28.3 (#247)

BenchmarkGemini 3.8 FlashGemma 1.1 7b IT
LMArena Expert15241039
GPQA Diamond95.4%—
Humanity's Last Exam44.5%—
SimpleQA Verified69.7%—

Multimodal Not comparable

Gemini 3.8 Flash: 40.7 (#45), Gemma 1.1 7b IT: —

BenchmarkGemini 3.8 FlashGemma 1.1 7b IT
LMArena Vision1314—
Blueprint-Bench 238.6%—
Furniture Assembly31.7%—

Multilingual Gemini 3.8 Flash leads

Gemini 3.8 Flash: 58.0 (#5), Gemma 1.1 7b IT: 28.1 (#273)

BenchmarkGemini 3.8 FlashGemma 1.1 7b IT
LMArena Non-English14911052
LMArena Chinese15541061
LMArena French14981065
LMArena German14931054
LMArena Japanese1502971
LMArena Korean1459988
LMArena Russian15151046
LMArena Spanish14851049

Instruction Following Gemini 3.8 Flash leads

Gemini 3.8 Flash: 78.0 (#13), Gemma 1.1 7b IT: 54.0 (#283)

BenchmarkGemini 3.8 FlashGemma 1.1 7b IT
LMArena Instruction Following14901057

Long Context Gemini 3.8 Flash leads

Gemini 3.8 Flash: 46.3 (#24), Gemma 1.1 7b IT: 32.1 (#272)

BenchmarkGemini 3.8 FlashGemma 1.1 7b IT
LMArena Longer Query15081056

Writing & Preference Gemini 3.8 Flash leads

Gemini 3.8 Flash: 72.2 (#15), Gemma 1.1 7b IT: 30.4 (#288)

BenchmarkGemini 3.8 FlashGemma 1.1 7b IT
LMArena Text14991094
LMArena Creative Writing14921060
LMArena Multi-Turn15011040
EQ-Bench Creative Writing1748—

Frequently asked questions

Is Gemini 3.8 Flash better than Gemma 1.1 7b IT?

Gemini 3.8 Flash is the stronger model overall, scoring 61.8 to 31.3 on the Noometry Index.

Is Gemini 3.8 Flash or Gemma 1.1 7b IT better for coding?

Gemini 3.8 Flash scores higher on coding benchmarks: 59.2 versus 31.5 in the Noometry coding category.

How many benchmarks do Gemini 3.8 Flash and Gemma 1.1 7b IT share?

17 benchmarks have published results for both models. Gemini 3.8 Flash has 50 scored results on Noometry and Gemma 1.1 7b IT has 19.

Related comparisons

Go deeper