Noometry

Model comparison

Amazon Nova Lite vs Gemma 1.1 2b IT

Amazon Nova Lite is the stronger model overall, scoring 31.9 to 29.3 on the Noometry Index.

Last verified . 14 shared benchmarks.

Amazon Nova Lite Amazon

31.9

Rank #265 Confirmed

Gemma 1.1 2b IT Google

29.3

Rank #313 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Amazon Nova Lite scores higher in 6 categories and Gemma 1.1 2b IT in 2 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Lite leads 42.1 to 25.1.
  • Gemma 1.1 2b IT has downloadable open weights; the other is API-only.

Side by side

Amazon Nova LiteGemma 1.1 2b IT
ProviderAmazonGoogle
Noometry Index31.929.3
Released2024-12-03—
WeightsProprietaryOpen
Context window300K—
Max output10K—
Input $ / M tokens$0.06—
Output $ / M tokens$0.24—
Results tracked3416

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Lite leads

Amazon Nova Lite: 32.5 (#270), Gemma 1.1 2b IT: 30.1 (#299)

BenchmarkAmazon Nova LiteGemma 1.1 2b IT
LMArena Coding12391034
LiveBench Coding27.5%—
ALE-Bench236.25—
HumanEval+—17.7%
MBPP+—23.3%

Reasoning Too close to call

Amazon Nova Lite: 19.3 (#260), Gemma 1.1 2b IT: 19.1 (#270)

BenchmarkAmazon Nova LiteGemma 1.1 2b IT
LMArena Hard Prompts12201005
LiveBench Reasoning36.7%—
LiveBench Data Analysis37.2%—
LiveBench36.4%—

Math Gemma 1.1 2b IT leads

Amazon Nova Lite: 27.8 (#247), Gemma 1.1 2b IT: 30.8 (#232)

BenchmarkAmazon Nova LiteGemma 1.1 2b IT
LMArena Math12271047
Omni-MATH23.3%—
LiveBench Math36.7%—

Knowledge Too close to call

Amazon Nova Lite: 26.3 (#259), Gemma 1.1 2b IT: 26.5 (#258)

BenchmarkAmazon Nova LiteGemma 1.1 2b IT
LMArena Expert1201970
Humanity's Last Exam3.6%—
MMLU-Pro60%—
Vectara Hallucination Rate6.1%—
GPQA (HELM)39.7%—
MMLU77%—

Multimodal Not comparable

Amazon Nova Lite: 25.5 (#123), Gemma 1.1 2b IT: —

BenchmarkAmazon Nova LiteGemma 1.1 2b IT
LMArena Vision990—

Multilingual Amazon Nova Lite leads

Amazon Nova Lite: 38.0 (#232), Gemma 1.1 2b IT: 24.6 (#289)

BenchmarkAmazon Nova LiteGemma 1.1 2b IT
LMArena Non-English1208988
LMArena Chinese12251012
LMArena German1229944
LMArena Korean1153899
LMArena Russian1216990
LMArena French1237—
LMArena Japanese1153—
LMArena Spanish1226—

Instruction Following Amazon Nova Lite leads

Amazon Nova Lite: 59.3 (#255), Gemma 1.1 2b IT: 49.9 (#299)

BenchmarkAmazon Nova LiteGemma 1.1 2b IT
LMArena Instruction Following1205992
LiveBench Instruction Following54.1%—
IFEval77.6%—

Long Context Amazon Nova Lite leads

Amazon Nova Lite: 37.4 (#217), Gemma 1.1 2b IT: 30.6 (#286)

BenchmarkAmazon Nova LiteGemma 1.1 2b IT
LMArena Longer Query12341003

Writing & Preference Amazon Nova Lite leads

Amazon Nova Lite: 42.1 (#237), Gemma 1.1 2b IT: 25.1 (#306)

BenchmarkAmazon Nova LiteGemma 1.1 2b IT
LMArena Text12291022
LMArena Creative Writing1197998
LMArena Multi-Turn1199959
WildBench75%—
LiveBench Language25.9%—

Frequently asked questions

Is Amazon Nova Lite better than Gemma 1.1 2b IT?

Amazon Nova Lite is the stronger model overall, scoring 31.9 to 29.3 on the Noometry Index.

Is Amazon Nova Lite or Gemma 1.1 2b IT better for coding?

Amazon Nova Lite scores higher on coding benchmarks: 32.5 versus 30.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Lite and Gemma 1.1 2b IT share?

14 benchmarks have published results for both models. Amazon Nova Lite has 34 scored results on Noometry and Gemma 1.1 2b IT has 16.

Related comparisons

Go deeper