Noometry

Model comparison

Gemma 1.1 7b IT vs Gemma 3 27B

Gemma 1.1 7b IT and Gemma 3 27B score almost the same on the Noometry Index (31.3 vs 30.8), so choose on price, context window or the category you care about most.

Last verified . 17 shared benchmarks.

Gemma 1.1 7b IT Google

31.3

Rank #277 Confirmed

Gemma 3 27B Google

30.8

Rank #284 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemma 1.1 7b IT scores higher in 5 categories and Gemma 3 27B in 3 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemma 3 27B leads 52.5 to 30.4.

Side by side

Gemma 1.1 7b ITGemma 3 27B
ProviderGoogleGoogle
Noometry Index31.330.8
Released—2025-03-11
WeightsOpenOpen
Context window—131K
Max output—8K
Input $ / M tokens—$0.08
Output $ / M tokens—$0.16
Results tracked1943

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemma 1.1 7b IT leads

Gemma 1.1 7b IT: 31.5 (#284), Gemma 3 27B: 22.5 (#334)

BenchmarkGemma 1.1 7b ITGemma 3 27B
LMArena Coding10841322
Aider Polyglot—4.9%
SciCode—21.2%
LiveBench Coding—39.9%
HumanEval+35.4%—
MBPP+45%—

Agentic & Tool Use Not comparable

Gemma 1.1 7b IT: —, Gemma 3 27B: 25.1 (#110)

BenchmarkGemma 1.1 7b ITGemma 3 27B
Berkeley Function Calling Leaderboard—29.5%

Reasoning Gemma 1.1 7b IT leads

Gemma 1.1 7b IT: 20.5 (#238), Gemma 3 27B: 16.7 (#301)

BenchmarkGemma 1.1 7b ITGemma 3 27B
LMArena Hard Prompts10711340
Kagi LLM Benchmark—40.4%
CritPt—0%
Chess Puzzles—0%
LiveBench Reasoning—43.8%
DTBench—52.5%
LiveBench Data Analysis—51.5%
LMCA—12.3%
Epoch Capabilities Index—130.04
LiveBench—50%

Math Gemma 1.1 7b IT leads

Gemma 1.1 7b IT: 32.0 (#220), Gemma 3 27B: 25.9 (#265)

BenchmarkGemma 1.1 7b ITGemma 3 27B
LMArena Math11071312
OTIS Mock AIME 2024-2025—22.5%
LiveBench Math—55.4%
MATH Level 5—74%

Knowledge Gemma 1.1 7b IT leads

Gemma 1.1 7b IT: 28.3 (#247), Gemma 3 27B: 25.5 (#261)

BenchmarkGemma 1.1 7b ITGemma 3 27B
LMArena Expert10391304
GPQA Diamond—47.7%
Confabulations—40.3%
Vectara Hallucination Rate—7.4%

Multimodal Not comparable

Gemma 1.1 7b IT: —, Gemma 3 27B: 32.6 (#100)

BenchmarkGemma 1.1 7b ITGemma 3 27B
LMArena Vision—1164
GeoBench—52%

Multilingual Gemma 3 27B leads

Gemma 1.1 7b IT: 28.1 (#273), Gemma 3 27B: 46.9 (#155)

BenchmarkGemma 1.1 7b ITGemma 3 27B
LMArena Non-English10521334
LMArena Chinese10611346
LMArena French10651368
LMArena German10541362
LMArena Japanese9711287
LMArena Korean9881308
LMArena Russian10461349
LMArena Spanish10491349

Instruction Following Gemma 3 27B leads

Gemma 1.1 7b IT: 54.0 (#283), Gemma 3 27B: 70.6 (#160)

BenchmarkGemma 1.1 7b ITGemma 3 27B
LMArena Instruction Following10571321
LiveBench Instruction Following—74.9%

Long Context Gemma 1.1 7b IT leads

Gemma 1.1 7b IT: 32.1 (#272), Gemma 3 27B: 27.6 (#293)

BenchmarkGemma 1.1 7b ITGemma 3 27B
LMArena Longer Query10561333
Fiction.LiveBench—33.3%

Writing & Preference Gemma 3 27B leads

Gemma 1.1 7b IT: 30.4 (#288), Gemma 3 27B: 52.5 (#168)

BenchmarkGemma 1.1 7b ITGemma 3 27B
LMArena Text10941358
LMArena Creative Writing10601346
LMArena Multi-Turn10401345
Short-Story Creative Writing—79.9%
EQ-Bench Creative Writing—1266
LiveBench Language—34.6%

Frequently asked questions

Is Gemma 1.1 7b IT better than Gemma 3 27B?

Gemma 1.1 7b IT and Gemma 3 27B score almost the same on the Noometry Index (31.3 vs 30.8), so choose on price, context window or the category you care about most.

Is Gemma 1.1 7b IT or Gemma 3 27B better for coding?

Gemma 1.1 7b IT scores higher on coding benchmarks: 31.5 versus 22.5 in the Noometry coding category.

How many benchmarks do Gemma 1.1 7b IT and Gemma 3 27B share?

17 benchmarks have published results for both models. Gemma 1.1 7b IT has 19 scored results on Noometry and Gemma 3 27B has 43.

Related comparisons

Go deeper