Noometry

Model comparison

Amazon Nova Lite vs Gemma 1.1 7b IT

Amazon Nova Lite and Gemma 1.1 7b IT score almost the same on the Noometry Index (31.9 vs 31.3), so choose on price, context window or the category you care about most.

Last verified . 17 shared benchmarks.

Amazon Nova Lite Amazon

31.9

Rank #265 Confirmed

Gemma 1.1 7b IT Google

31.3

Rank #277 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Lite scores higher in 5 categories and Gemma 1.1 7b IT in 3 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Lite leads 42.1 to 30.4.
  • Gemma 1.1 7b IT has downloadable open weights; the other is API-only.

Side by side

Amazon Nova LiteGemma 1.1 7b IT
ProviderAmazonGoogle
Noometry Index31.931.3
Released2024-12-03—
WeightsProprietaryOpen
Context window300K—
Max output10K—
Input $ / M tokens$0.06—
Output $ / M tokens$0.24—
Results tracked3419

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Amazon Nova Lite: 32.5 (#270), Gemma 1.1 7b IT: 31.5 (#284)

BenchmarkAmazon Nova LiteGemma 1.1 7b IT
LMArena Coding12391084
LiveBench Coding27.5%—
ALE-Bench236.25—
HumanEval+—35.4%
MBPP+—45%

Reasoning Gemma 1.1 7b IT leads

Amazon Nova Lite: 19.3 (#260), Gemma 1.1 7b IT: 20.5 (#238)

BenchmarkAmazon Nova LiteGemma 1.1 7b IT
LMArena Hard Prompts12201071
LiveBench Reasoning36.7%—
LiveBench Data Analysis37.2%—
LiveBench36.4%—

Math Gemma 1.1 7b IT leads

Amazon Nova Lite: 27.8 (#247), Gemma 1.1 7b IT: 32.0 (#220)

BenchmarkAmazon Nova LiteGemma 1.1 7b IT
LMArena Math12271107
Omni-MATH23.3%—
LiveBench Math36.7%—

Knowledge Gemma 1.1 7b IT leads

Amazon Nova Lite: 26.3 (#259), Gemma 1.1 7b IT: 28.3 (#247)

BenchmarkAmazon Nova LiteGemma 1.1 7b IT
LMArena Expert12011039
Humanity's Last Exam3.6%—
MMLU-Pro60%—
Vectara Hallucination Rate6.1%—
GPQA (HELM)39.7%—
MMLU77%—

Multimodal Not comparable

Amazon Nova Lite: 25.5 (#123), Gemma 1.1 7b IT: —

BenchmarkAmazon Nova LiteGemma 1.1 7b IT
LMArena Vision990—

Multilingual Amazon Nova Lite leads

Amazon Nova Lite: 38.0 (#232), Gemma 1.1 7b IT: 28.1 (#273)

BenchmarkAmazon Nova LiteGemma 1.1 7b IT
LMArena Non-English12081052
LMArena Chinese12251061
LMArena French12371065
LMArena German12291054
LMArena Japanese1153971
LMArena Korean1153988
LMArena Russian12161046
LMArena Spanish12261049

Instruction Following Amazon Nova Lite leads

Amazon Nova Lite: 59.3 (#255), Gemma 1.1 7b IT: 54.0 (#283)

BenchmarkAmazon Nova LiteGemma 1.1 7b IT
LMArena Instruction Following12051057
LiveBench Instruction Following54.1%—
IFEval77.6%—

Long Context Amazon Nova Lite leads

Amazon Nova Lite: 37.4 (#217), Gemma 1.1 7b IT: 32.1 (#272)

BenchmarkAmazon Nova LiteGemma 1.1 7b IT
LMArena Longer Query12341056

Writing & Preference Amazon Nova Lite leads

Amazon Nova Lite: 42.1 (#237), Gemma 1.1 7b IT: 30.4 (#288)

BenchmarkAmazon Nova LiteGemma 1.1 7b IT
LMArena Text12291094
LMArena Creative Writing11971060
LMArena Multi-Turn11991040
WildBench75%—
LiveBench Language25.9%—

Frequently asked questions

Is Amazon Nova Lite better than Gemma 1.1 7b IT?

Amazon Nova Lite and Gemma 1.1 7b IT score almost the same on the Noometry Index (31.9 vs 31.3), so choose on price, context window or the category you care about most.

Is Amazon Nova Lite or Gemma 1.1 7b IT better for coding?

They score almost the same on coding (32.5 vs 31.5); test both on your own repository before choosing.

How many benchmarks do Amazon Nova Lite and Gemma 1.1 7b IT share?

17 benchmarks have published results for both models. Amazon Nova Lite has 34 scored results on Noometry and Gemma 1.1 7b IT has 19.

Related comparisons

Go deeper