Model comparison

Gemma 7B vs Nova 2.0 Pro Preview

Nova 2.0 Pro Preview is the stronger model overall, scoring 32.8 to 29.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 7B Google

29.5

Rank #295 Confirmed

Nova 2.0 Pro Preview Amazon

32.8

Rank #241 Reported

Summary

  • The widest gap is in coding, where Nova 2.0 Pro Preview leads 40.2 to 29.9.
  • Gemma 7B has downloadable open weights; the other is API-only.

Side by side

Gemma 7B and Nova 2.0 Pro Preview specifications
Gemma 7BNova 2.0 Pro Preview
ProviderGoogleAmazon
Noometry Index29.532.8
Released2024-02-212025-12-02
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked273

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nova 2.0 Pro Preview leads

Gemma 7B: 29.9 (#290), Nova 2.0 Pro Preview: 40.2 (#130)

Coding benchmarks
BenchmarkGemma 7BNova 2.0 Pro Preview
SciCode—42.7%
LMArena Coding1048—
HumanEval+28.7%—
MBPP+43.4%—

Agentic & Tool Use Not comparable

Gemma 7B: —, Nova 2.0 Pro Preview: 21.9 (#127)

Agentic & Tool Use benchmarks
BenchmarkGemma 7BNova 2.0 Pro Preview
GDP.pdf—2%

Reasoning Nova 2.0 Pro Preview leads

Gemma 7B: 19.0 (#247), Nova 2.0 Pro Preview: 21.7 (#189)

Reasoning benchmarks
BenchmarkGemma 7BNova 2.0 Pro Preview
CritPt—0%
LMArena Hard Prompts1042—
Adversarial NLI48.7%—
BIG-Bench Hard55.1%—
Epoch Capabilities Index111.74—
HellaSwag82.2%—
PIQA81.2%—
WinoGrande79%—

Math Not comparable

Gemma 7B: 28.7 (#225), Nova 2.0 Pro Preview: —

Math benchmarks
BenchmarkGemma 7BNova 2.0 Pro Preview
LMArena Math1066—
GSM8K46.4%—

Knowledge Not comparable

Gemma 7B: 26.8 (#248), Nova 2.0 Pro Preview: —

Knowledge benchmarks
BenchmarkGemma 7BNova 2.0 Pro Preview
LMArena Expert1002—
ARC (AI2) Challenge78.3%—
BoolQ83.2%—
MMLU66.1%—
OpenBookQA78.6%—
TriviaQA72.3%—

Multilingual Not comparable

Gemma 7B: 25.3 (#282), Nova 2.0 Pro Preview: —

Multilingual benchmarks
BenchmarkGemma 7BNova 2.0 Pro Preview
LMArena Non-English999—
LMArena Chinese1035—
LMArena French1024—
LMArena Russian993—

Instruction Following Not comparable

Gemma 7B: 51.7 (#290), Nova 2.0 Pro Preview: —

Instruction Following benchmarks
BenchmarkGemma 7BNova 2.0 Pro Preview
LMArena Instruction Following1017—

Long Context Not comparable

Gemma 7B: 31.1 (#277), Nova 2.0 Pro Preview: —

Long Context benchmarks
BenchmarkGemma 7BNova 2.0 Pro Preview
LMArena Longer Query1022—

Writing & Preference Not comparable

Gemma 7B: 27.2 (#297), Nova 2.0 Pro Preview: —

Writing & Preference benchmarks
BenchmarkGemma 7BNova 2.0 Pro Preview
LMArena Text1056—
LMArena Creative Writing1024—
LMArena Multi-Turn963—

Frequently asked questions

Is Gemma 7B better than Nova 2.0 Pro Preview?

Nova 2.0 Pro Preview is the stronger model overall, scoring 32.8 to 29.5 on the Noometry Index.

Is Gemma 7B or Nova 2.0 Pro Preview better for coding?

Nova 2.0 Pro Preview scores higher on coding benchmarks: 40.2 versus 29.9 in the Noometry coding category.

How many benchmarks do Gemma 7B and Nova 2.0 Pro Preview share?

0 benchmarks have published results for both models. Gemma 7B has 27 scored results on Noometry and Nova 2.0 Pro Preview has 3.

Related comparisons

Go deeper