Noometry

Model comparison

Amazon Nova Micro vs Gemma 1.1 2b IT

Amazon Nova Micro is the stronger model overall, scoring 30.4 to 29.3 on the Noometry Index.

Last verified . 14 shared benchmarks.

Amazon Nova Micro Amazon

30.4

Rank #294 Confirmed

Gemma 1.1 2b IT Google

29.3

Rank #313 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Amazon Nova Micro scores higher in 6 categories and Gemma 1.1 2b IT in 2 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Micro leads 39.5 to 25.1.
  • Gemma 1.1 2b IT has downloadable open weights; the other is API-only.

Side by side

Amazon Nova MicroGemma 1.1 2b IT
ProviderAmazonGoogle
Noometry Index30.429.3
Released2024-12-03—
WeightsProprietaryOpen
Context window128K—
Max output10K—
Input $ / M tokens$0.035—
Output $ / M tokens$0.14—
Results tracked3216

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Amazon Nova Micro: 30.5 (#295), Gemma 1.1 2b IT: 30.1 (#299)

BenchmarkAmazon Nova MicroGemma 1.1 2b IT
LMArena Coding12181034
LiveBench Coding20.2%—
HumanEval+—17.7%
MBPP+—23.3%

Agentic & Tool Use Not comparable

Amazon Nova Micro: 22.1 (#132), Gemma 1.1 2b IT: —

BenchmarkAmazon Nova MicroGemma 1.1 2b IT
Berkeley Function Calling Leaderboard22.3%—

Reasoning Gemma 1.1 2b IT leads

Amazon Nova Micro: 17.4 (#294), Gemma 1.1 2b IT: 19.1 (#270)

BenchmarkAmazon Nova MicroGemma 1.1 2b IT
LMArena Hard Prompts11911005
LiveBench Reasoning25.1%—
LiveBench Data Analysis34%—
LiveBench29.6%—

Math Gemma 1.1 2b IT leads

Amazon Nova Micro: 26.9 (#254), Gemma 1.1 2b IT: 30.8 (#232)

BenchmarkAmazon Nova MicroGemma 1.1 2b IT
LMArena Math12061047
Omni-MATH21.4%—
LiveBench Math34.5%—

Knowledge Amazon Nova Micro leads

Amazon Nova Micro: 29.6 (#237), Gemma 1.1 2b IT: 26.5 (#258)

BenchmarkAmazon Nova MicroGemma 1.1 2b IT
LMArena Expert1184970
MMLU-Pro51.1%—
Vectara Hallucination Rate5.5%—
GPQA (HELM)38.3%—
MMLU70.8%—

Multilingual Amazon Nova Micro leads

Amazon Nova Micro: 36.5 (#239), Gemma 1.1 2b IT: 24.6 (#289)

BenchmarkAmazon Nova MicroGemma 1.1 2b IT
LMArena Non-English1186988
LMArena Chinese12091012
LMArena German1192944
LMArena Korean1150899
LMArena Russian1185990
LMArena French1238—
LMArena Japanese1154—
LMArena Spanish1225—

Instruction Following Amazon Nova Micro leads

Amazon Nova Micro: 56.3 (#272), Gemma 1.1 2b IT: 49.9 (#299)

BenchmarkAmazon Nova MicroGemma 1.1 2b IT
LMArena Instruction Following1174992
LiveBench Instruction Following48%—
IFEval76%—

Long Context Amazon Nova Micro leads

Amazon Nova Micro: 36.5 (#229), Gemma 1.1 2b IT: 30.6 (#286)

BenchmarkAmazon Nova MicroGemma 1.1 2b IT
LMArena Longer Query12051003

Writing & Preference Amazon Nova Micro leads

Amazon Nova Micro: 39.5 (#247), Gemma 1.1 2b IT: 25.1 (#306)

BenchmarkAmazon Nova MicroGemma 1.1 2b IT
LMArena Text12081022
LMArena Creative Writing1172998
LMArena Multi-Turn1178959
WildBench74.3%—
LiveBench Language15.8%—

Frequently asked questions

Is Amazon Nova Micro better than Gemma 1.1 2b IT?

Amazon Nova Micro is the stronger model overall, scoring 30.4 to 29.3 on the Noometry Index.

Is Amazon Nova Micro or Gemma 1.1 2b IT better for coding?

They score almost the same on coding (30.5 vs 30.1); test both on your own repository before choosing.

How many benchmarks do Amazon Nova Micro and Gemma 1.1 2b IT share?

14 benchmarks have published results for both models. Amazon Nova Micro has 32 scored results on Noometry and Gemma 1.1 2b IT has 16.

Related comparisons

Go deeper