Noometry

Model comparison

Amazon Nova Micro vs Gemma 1.1 7b IT

Amazon Nova Micro and Gemma 1.1 7b IT score almost the same on the Noometry Index (30.4 vs 31.3), so choose on price, context window or the category you care about most.

Last verified . 17 shared benchmarks.

Amazon Nova Micro Amazon

30.4

Rank #294 Confirmed

Gemma 1.1 7b IT Google

31.3

Rank #277 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Micro scores higher in 5 categories and Gemma 1.1 7b IT in 3 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Micro leads 39.5 to 30.4.
  • Gemma 1.1 7b IT has downloadable open weights; the other is API-only.

Side by side

Amazon Nova MicroGemma 1.1 7b IT
ProviderAmazonGoogle
Noometry Index30.431.3
Released2024-12-03—
WeightsProprietaryOpen
Context window128K—
Max output10K—
Input $ / M tokens$0.035—
Output $ / M tokens$0.14—
Results tracked3219

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemma 1.1 7b IT leads

Amazon Nova Micro: 30.5 (#295), Gemma 1.1 7b IT: 31.5 (#284)

BenchmarkAmazon Nova MicroGemma 1.1 7b IT
LMArena Coding12181084
LiveBench Coding20.2%—
HumanEval+—35.4%
MBPP+—45%

Agentic & Tool Use Not comparable

Amazon Nova Micro: 22.1 (#132), Gemma 1.1 7b IT: —

BenchmarkAmazon Nova MicroGemma 1.1 7b IT
Berkeley Function Calling Leaderboard22.3%—

Reasoning Gemma 1.1 7b IT leads

Amazon Nova Micro: 17.4 (#294), Gemma 1.1 7b IT: 20.5 (#238)

BenchmarkAmazon Nova MicroGemma 1.1 7b IT
LMArena Hard Prompts11911071
LiveBench Reasoning25.1%—
LiveBench Data Analysis34%—
LiveBench29.6%—

Math Gemma 1.1 7b IT leads

Amazon Nova Micro: 26.9 (#254), Gemma 1.1 7b IT: 32.0 (#220)

BenchmarkAmazon Nova MicroGemma 1.1 7b IT
LMArena Math12061107
Omni-MATH21.4%—
LiveBench Math34.5%—

Knowledge Amazon Nova Micro leads

Amazon Nova Micro: 29.6 (#237), Gemma 1.1 7b IT: 28.3 (#247)

BenchmarkAmazon Nova MicroGemma 1.1 7b IT
LMArena Expert11841039
MMLU-Pro51.1%—
Vectara Hallucination Rate5.5%—
GPQA (HELM)38.3%—
MMLU70.8%—

Multilingual Amazon Nova Micro leads

Amazon Nova Micro: 36.5 (#239), Gemma 1.1 7b IT: 28.1 (#273)

BenchmarkAmazon Nova MicroGemma 1.1 7b IT
LMArena Non-English11861052
LMArena Chinese12091061
LMArena French12381065
LMArena German11921054
LMArena Japanese1154971
LMArena Korean1150988
LMArena Russian11851046
LMArena Spanish12251049

Instruction Following Amazon Nova Micro leads

Amazon Nova Micro: 56.3 (#272), Gemma 1.1 7b IT: 54.0 (#283)

BenchmarkAmazon Nova MicroGemma 1.1 7b IT
LMArena Instruction Following11741057
LiveBench Instruction Following48%—
IFEval76%—

Long Context Amazon Nova Micro leads

Amazon Nova Micro: 36.5 (#229), Gemma 1.1 7b IT: 32.1 (#272)

BenchmarkAmazon Nova MicroGemma 1.1 7b IT
LMArena Longer Query12051056

Writing & Preference Amazon Nova Micro leads

Amazon Nova Micro: 39.5 (#247), Gemma 1.1 7b IT: 30.4 (#288)

BenchmarkAmazon Nova MicroGemma 1.1 7b IT
LMArena Text12081094
LMArena Creative Writing11721060
LMArena Multi-Turn11781040
WildBench74.3%—
LiveBench Language15.8%—

Frequently asked questions

Is Amazon Nova Micro better than Gemma 1.1 7b IT?

Amazon Nova Micro and Gemma 1.1 7b IT score almost the same on the Noometry Index (30.4 vs 31.3), so choose on price, context window or the category you care about most.

Is Amazon Nova Micro or Gemma 1.1 7b IT better for coding?

Gemma 1.1 7b IT scores higher on coding benchmarks: 31.5 versus 30.5 in the Noometry coding category.

How many benchmarks do Amazon Nova Micro and Gemma 1.1 7b IT share?

17 benchmarks have published results for both models. Amazon Nova Micro has 32 scored results on Noometry and Gemma 1.1 7b IT has 19.

Related comparisons

Go deeper