Noometry

Model comparison

Gemini Advanced 0514 vs Gemma 1.1 7b IT

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 31.3 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemini Advanced 0514 Google

37.7

Rank #197 Confirmed

Gemma 1.1 7b IT Google

31.3

Rank #277 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemini Advanced 0514 scores higher in 8 categories and Gemma 1.1 7b IT in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemini Advanced 0514 leads 48.5 to 30.4.
  • Gemma 1.1 7b IT has downloadable open weights; the other is API-only.

Side by side

Gemini Advanced 0514Gemma 1.1 7b IT
ProviderGoogleGoogle
Noometry Index37.731.3
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1719

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini Advanced 0514 leads

Gemini Advanced 0514: 36.6 (#205), Gemma 1.1 7b IT: 31.5 (#284)

BenchmarkGemini Advanced 0514Gemma 1.1 7b IT
LMArena Coding12551084
HumanEval+—35.4%
MBPP+—45%

Reasoning Gemini Advanced 0514 leads

Gemini Advanced 0514: 24.6 (#160), Gemma 1.1 7b IT: 20.5 (#238)

BenchmarkGemini Advanced 0514Gemma 1.1 7b IT
LMArena Hard Prompts12481071

Math Gemini Advanced 0514 leads

Gemini Advanced 0514: 35.5 (#181), Gemma 1.1 7b IT: 32.0 (#220)

BenchmarkGemini Advanced 0514Gemma 1.1 7b IT
LMArena Math12721107

Knowledge Gemini Advanced 0514 leads

Gemini Advanced 0514: 33.3 (#205), Gemma 1.1 7b IT: 28.3 (#247)

BenchmarkGemini Advanced 0514Gemma 1.1 7b IT
LMArena Expert12151039

Multilingual Gemini Advanced 0514 leads

Gemini Advanced 0514: 42.6 (#192), Gemma 1.1 7b IT: 28.1 (#273)

BenchmarkGemini Advanced 0514Gemma 1.1 7b IT
LMArena Non-English12741052
LMArena Chinese12741061
LMArena French13071065
LMArena German12751054
LMArena Japanese1242971
LMArena Korean1232988
LMArena Russian12831046
LMArena Spanish12421049

Instruction Following Gemini Advanced 0514 leads

Gemini Advanced 0514: 66.0 (#212), Gemma 1.1 7b IT: 54.0 (#283)

BenchmarkGemini Advanced 0514Gemma 1.1 7b IT
LMArena Instruction Following12531057

Long Context Gemini Advanced 0514 leads

Gemini Advanced 0514: 38.0 (#207), Gemma 1.1 7b IT: 32.1 (#272)

BenchmarkGemini Advanced 0514Gemma 1.1 7b IT
LMArena Longer Query12531056

Writing & Preference Gemini Advanced 0514 leads

Gemini Advanced 0514: 48.5 (#200), Gemma 1.1 7b IT: 30.4 (#288)

BenchmarkGemini Advanced 0514Gemma 1.1 7b IT
LMArena Text12791094
LMArena Creative Writing12841060
LMArena Multi-Turn12691040

Frequently asked questions

Is Gemini Advanced 0514 better than Gemma 1.1 7b IT?

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 31.3 on the Noometry Index.

Is Gemini Advanced 0514 or Gemma 1.1 7b IT better for coding?

Gemini Advanced 0514 scores higher on coding benchmarks: 36.6 versus 31.5 in the Noometry coding category.

How many benchmarks do Gemini Advanced 0514 and Gemma 1.1 7b IT share?

17 benchmarks have published results for both models. Gemini Advanced 0514 has 17 scored results on Noometry and Gemma 1.1 7b IT has 19.

Related comparisons

Go deeper