Noometry

Model comparison

Gemini Advanced 0514 vs Gemma 1.1 2b IT

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 29.3 on the Noometry Index.

Last verified . 14 shared benchmarks.

Gemini Advanced 0514 Google

37.7

Rank #197 Confirmed

Gemma 1.1 2b IT Google

29.3

Rank #313 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Gemini Advanced 0514 scores higher in 8 categories and Gemma 1.1 2b IT in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemini Advanced 0514 leads 48.5 to 25.1.
  • Gemma 1.1 2b IT has downloadable open weights; the other is API-only.

Side by side

Gemini Advanced 0514Gemma 1.1 2b IT
ProviderGoogleGoogle
Noometry Index37.729.3
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1716

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini Advanced 0514 leads

Gemini Advanced 0514: 36.6 (#205), Gemma 1.1 2b IT: 30.1 (#299)

BenchmarkGemini Advanced 0514Gemma 1.1 2b IT
LMArena Coding12551034
HumanEval+—17.7%
MBPP+—23.3%

Reasoning Gemini Advanced 0514 leads

Gemini Advanced 0514: 24.6 (#160), Gemma 1.1 2b IT: 19.1 (#270)

BenchmarkGemini Advanced 0514Gemma 1.1 2b IT
LMArena Hard Prompts12481005

Math Gemini Advanced 0514 leads

Gemini Advanced 0514: 35.5 (#181), Gemma 1.1 2b IT: 30.8 (#232)

BenchmarkGemini Advanced 0514Gemma 1.1 2b IT
LMArena Math12721047

Knowledge Gemini Advanced 0514 leads

Gemini Advanced 0514: 33.3 (#205), Gemma 1.1 2b IT: 26.5 (#258)

BenchmarkGemini Advanced 0514Gemma 1.1 2b IT
LMArena Expert1215970

Multilingual Gemini Advanced 0514 leads

Gemini Advanced 0514: 42.6 (#192), Gemma 1.1 2b IT: 24.6 (#289)

BenchmarkGemini Advanced 0514Gemma 1.1 2b IT
LMArena Non-English1274988
LMArena Chinese12741012
LMArena German1275944
LMArena Korean1232899
LMArena Russian1283990
LMArena French1307—
LMArena Japanese1242—
LMArena Spanish1242—

Instruction Following Gemini Advanced 0514 leads

Gemini Advanced 0514: 66.0 (#212), Gemma 1.1 2b IT: 49.9 (#299)

BenchmarkGemini Advanced 0514Gemma 1.1 2b IT
LMArena Instruction Following1253992

Long Context Gemini Advanced 0514 leads

Gemini Advanced 0514: 38.0 (#207), Gemma 1.1 2b IT: 30.6 (#286)

BenchmarkGemini Advanced 0514Gemma 1.1 2b IT
LMArena Longer Query12531003

Writing & Preference Gemini Advanced 0514 leads

Gemini Advanced 0514: 48.5 (#200), Gemma 1.1 2b IT: 25.1 (#306)

BenchmarkGemini Advanced 0514Gemma 1.1 2b IT
LMArena Text12791022
LMArena Creative Writing1284998
LMArena Multi-Turn1269959

Frequently asked questions

Is Gemini Advanced 0514 better than Gemma 1.1 2b IT?

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 29.3 on the Noometry Index.

Is Gemini Advanced 0514 or Gemma 1.1 2b IT better for coding?

Gemini Advanced 0514 scores higher on coding benchmarks: 36.6 versus 30.1 in the Noometry coding category.

How many benchmarks do Gemini Advanced 0514 and Gemma 1.1 2b IT share?

14 benchmarks have published results for both models. Gemini Advanced 0514 has 17 scored results on Noometry and Gemma 1.1 2b IT has 16.

Related comparisons

Go deeper