Model comparison

Gemma 7B vs Nova 2 Lite

Nova 2 Lite is the stronger model overall, scoring 39.7 to 30.0 on the Noometry Index.

Last verified . 13 shared benchmarks.

Gemma 7B Google

30.0

Rank #299 Confirmed

Nova 2 Lite Amazon

39.7

Rank #161 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Gemma 7B scores higher in 0 categories and Nova 2 Lite in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Nova 2 Lite leads 53.9 to 27.1.
  • Gemma 7B has downloadable open weights; the other is API-only.

Side by side

Gemma 7B and Nova 2 Lite specifications
Gemma 7BNova 2 Lite
ProviderGoogleAmazon
Noometry Index30.039.7
Released2024-02-212025-12-01
WeightsOpenProprietary
Context window—1M
Max output—64K
Input $ / M tokens—$0.30
Output $ / M tokens—$2.50
Results tracked2719

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nova 2 Lite leads

Gemma 7B: 30.5 (#294), Nova 2 Lite: 40.7 (#134)

Coding benchmarks
BenchmarkGemma 7BNova 2 Lite
LMArena Coding10481385
HumanEval+28.7%—
MBPP+43.4%—

Agentic & Tool Use Not comparable

Gemma 7B: —, Nova 2 Lite: 24.1 (#121)

Agentic & Tool Use benchmarks
BenchmarkGemma 7BNova 2 Lite
Berkeley Function Calling Leaderboard—27.1%

Reasoning Nova 2 Lite leads

Gemma 7B: 19.9 (#249), Nova 2 Lite: 27.5 (#118)

Reasoning benchmarks
BenchmarkGemma 7BNova 2 Lite
LMArena Hard Prompts10421364
Adversarial NLI48.7%—
BIG-Bench Hard55.1%—
Epoch Capabilities Index111.99—
HellaSwag82.2%—
PIQA81.2%—
WinoGrande79%—

Math Nova 2 Lite leads

Gemma 7B: 31.2 (#228), Nova 2 Lite: 37.5 (#156)

Math benchmarks
BenchmarkGemma 7BNova 2 Lite
LMArena Math10661359
GSM8K46.4%—

Knowledge Nova 2 Lite leads

Gemma 7B: 27.3 (#252), Nova 2 Lite: 43.0 (#94)

Knowledge benchmarks
BenchmarkGemma 7BNova 2 Lite
LMArena Expert10011358
Vectara Hallucination Rate—5.1%
ARC (AI2) Challenge78.3%—
BoolQ83.2%—
MMLU66.1%—
OpenBookQA78.6%—
TriviaQA72.3%—

Multilingual Nova 2 Lite leads

Gemma 7B: 25.1 (#287), Nova 2 Lite: 47.1 (#153)

Multilingual benchmarks
BenchmarkGemma 7BNova 2 Lite
LMArena Non-English9991337
LMArena Chinese10351364
LMArena French10251381
LMArena Russian9931343
LMArena German—1343
LMArena Japanese—1271
LMArena Korean—1284
LMArena Spanish—1373

Instruction Following Nova 2 Lite leads

Gemma 7B: 51.5 (#295), Nova 2 Lite: 70.5 (#161)

Instruction Following benchmarks
BenchmarkGemma 7BNova 2 Lite
LMArena Instruction Following10171335

Long Context Nova 2 Lite leads

Gemma 7B: 31.1 (#282), Nova 2 Lite: 40.6 (#150)

Long Context benchmarks
BenchmarkGemma 7BNova 2 Lite
LMArena Longer Query10221335

Writing & Preference Nova 2 Lite leads

Gemma 7B: 27.1 (#302), Nova 2 Lite: 53.9 (#154)

Writing & Preference benchmarks
BenchmarkGemma 7BNova 2 Lite
LMArena Text10561362
LMArena Creative Writing10241291
LMArena Multi-Turn9631338

Frequently asked questions

Is Gemma 7B better than Nova 2 Lite?

Nova 2 Lite is the stronger model overall, scoring 39.7 to 30.0 on the Noometry Index.

Is Gemma 7B or Nova 2 Lite better for coding?

Nova 2 Lite scores higher on coding benchmarks: 40.7 versus 30.5 in the Noometry coding category.

How many benchmarks do Gemma 7B and Nova 2 Lite share?

13 benchmarks have published results for both models. Gemma 7B has 27 scored results on Noometry and Nova 2 Lite has 19.

Related comparisons

Go deeper