Noometry

Model comparison

Gemini 2.0 Pro vs Gemma 3 27B

Gemini 2.0 Pro is the stronger model overall, scoring 39.1 to 30.8 on the Noometry Index.

Last verified . 13 shared benchmarks.

Gemini 2.0 Pro Google

39.1

Rank #173 Confirmed

Gemma 3 27B Google

30.8

Rank #284 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Gemini 2.0 Pro scores higher in 7 categories and Gemma 3 27B in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Gemini 2.0 Pro leads 37.8 to 22.5.
  • The biggest single-benchmark swing is Aider Polyglot: 35.6% for Gemini 2.0 Pro and 4.9% for Gemma 3 27B.
  • Gemma 3 27B has downloadable open weights; the other is API-only.

Side by side

Gemini 2.0 ProGemma 3 27B
ProviderGoogleGoogle
Noometry Index39.130.8
Released2025-02-052025-03-11
WeightsProprietaryOpen
Context window—131K
Max output—8K
Input $ / M tokens—$0.08
Output $ / M tokens—$0.16
Results tracked1443

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.0 Pro leads

Gemini 2.0 Pro: 37.8 (#187), Gemma 3 27B: 22.5 (#334)

BenchmarkGemini 2.0 ProGemma 3 27B
Aider Polyglot35.6%4.9%
LiveBench Coding63.5%39.9%
SciCode—21.2%
LMArena Coding—1322

Agentic & Tool Use Not comparable

Gemini 2.0 Pro: —, Gemma 3 27B: 25.1 (#110)

BenchmarkGemini 2.0 ProGemma 3 27B
Berkeley Function Calling Leaderboard—29.5%

Reasoning Gemini 2.0 Pro leads

Gemini 2.0 Pro: 22.3 (#198), Gemma 3 27B: 16.7 (#301)

BenchmarkGemini 2.0 ProGemma 3 27B
LiveBench Reasoning60.1%43.8%
LiveBench Data Analysis68%51.5%
Epoch Capabilities Index135.06130.04
LiveBench65.1%50%
Kagi LLM Benchmark—40.4%
CritPt—0%
Chess Puzzles—0%
EnigmaEval0.7%—
LMArena Hard Prompts—1340
DTBench—52.5%
LMCA—12.3%

Math Gemini 2.0 Pro leads

Gemini 2.0 Pro: 39.7 (#100), Gemma 3 27B: 25.9 (#265)

BenchmarkGemini 2.0 ProGemma 3 27B
LiveBench Math71%55.4%
MATH Level 583.5%74%
OTIS Mock AIME 2024-2025—22.5%
LMArena Math—1312

Knowledge Gemini 2.0 Pro leads

Gemini 2.0 Pro: 36.5 (#167), Gemma 3 27B: 25.5 (#261)

BenchmarkGemini 2.0 ProGemma 3 27B
GPQA Diamond65.7%47.7%
Confabulations18.4%40.3%
Vectara Hallucination Rate—7.4%
LMArena Expert—1304

Multimodal Not comparable

Gemini 2.0 Pro: —, Gemma 3 27B: 32.6 (#100)

BenchmarkGemini 2.0 ProGemma 3 27B
LMArena Vision—1164
GeoBench—52%

Multilingual Not comparable

Gemini 2.0 Pro: —, Gemma 3 27B: 46.9 (#155)

BenchmarkGemini 2.0 ProGemma 3 27B
LMArena Non-English—1334
LMArena Chinese—1346
LMArena French—1368
LMArena German—1362
LMArena Japanese—1287
LMArena Korean—1308
LMArena Russian—1349
LMArena Spanish—1349

Instruction Following Gemini 2.0 Pro leads

Gemini 2.0 Pro: 75.5 (#59), Gemma 3 27B: 70.6 (#160)

BenchmarkGemini 2.0 ProGemma 3 27B
LiveBench Instruction Following83.4%74.9%
LMArena Instruction Following—1321

Long Context Gemini 2.0 Pro leads

Gemini 2.0 Pro: 29.2 (#292), Gemma 3 27B: 27.6 (#293)

BenchmarkGemini 2.0 ProGemma 3 27B
Fiction.LiveBench41.7%33.3%
LMArena Longer Query—1333

Writing & Preference Too close to call

Gemini 2.0 Pro: 52.7 (#165), Gemma 3 27B: 52.5 (#168)

BenchmarkGemini 2.0 ProGemma 3 27B
LiveBench Language44.9%34.6%
LMArena Text—1358
LMArena Creative Writing—1346
Short-Story Creative Writing—79.9%
EQ-Bench Creative Writing—1266
LMArena Multi-Turn—1345

Frequently asked questions

Is Gemini 2.0 Pro better than Gemma 3 27B?

Gemini 2.0 Pro is the stronger model overall, scoring 39.1 to 30.8 on the Noometry Index.

Is Gemini 2.0 Pro or Gemma 3 27B better for coding?

Gemini 2.0 Pro scores higher on coding benchmarks: 37.8 versus 22.5 in the Noometry coding category.

How many benchmarks do Gemini 2.0 Pro and Gemma 3 27B share?

13 benchmarks have published results for both models. Gemini 2.0 Pro has 14 scored results on Noometry and Gemma 3 27B has 43.

Related comparisons

Go deeper