Model comparison

Amazon Nova Pro vs Gemma 3 1B

Amazon Nova Pro is the stronger model overall, scoring 31.0 to 21.1 on the Noometry Index.

Last verified . 1 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

Gemma 3 1B Google

21.1

Rank #353 Reported

Summary

  • They share 1 benchmark with published results for both. Amazon Nova Pro scores higher in 4 categories and Gemma 3 1B in 0 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Amazon Nova Pro leads 27.4 to 7.0.
  • The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 25% for Amazon Nova Pro and 7.2% for Gemma 3 1B.
  • Gemma 3 1B has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Pro and Gemma 3 1B specifications
Amazon Nova ProGemma 3 1B
ProviderAmazonGoogle
Noometry Index31.021.1
Released2024-12-032025-03-12
WeightsProprietaryOpen
Context window300K—
Max output10K—
Input $ / M tokens$0.80—
Output $ / M tokens$3.20—
Results tracked384

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Amazon Nova Pro: 35.1 (#229), Gemma 3 1B: —

Coding benchmarks
BenchmarkAmazon Nova ProGemma 3 1B
LiveBench Coding38.1%—
LMArena Coding1270—

Agentic & Tool Use Amazon Nova Pro leads

Amazon Nova Pro: 16.7 (#147), Gemma 3 1B: 13.7 (#152)

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova ProGemma 3 1B
Berkeley Function Calling Leaderboard25%7.2%
TheAgentCompany1.7%—

Reasoning Too close to call

Amazon Nova Pro: 20.0 (#243), Gemma 3 1B: 19.2 (#264)

Reasoning benchmarks
BenchmarkAmazon Nova ProGemma 3 1B
Chess Puzzles—0%
LiveBench Reasoning32.6%—
LMArena Hard Prompts1246—
LiveBench Data Analysis48.3%—
Epoch Capabilities Index123.8—
LiveBench43.5%—

Math Amazon Nova Pro leads

Amazon Nova Pro: 28.5 (#243), Gemma 3 1B: 10.2 (#316)

Math benchmarks
BenchmarkAmazon Nova ProGemma 3 1B
OTIS Mock AIME 2024-2025—1.1%
Omni-MATH24.2%—
LiveBench Math38%—
LMArena Math1252—

Knowledge Amazon Nova Pro leads

Amazon Nova Pro: 27.4 (#250), Gemma 3 1B: 7.0 (#314)

Knowledge benchmarks
BenchmarkAmazon Nova ProGemma 3 1B
GPQA Diamond—19.9%
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Confabulations30.1%—
Vectara Hallucination Rate5.1%—
GPQA (HELM)44.6%—
LMArena Expert1211—
MMLU82%—

Multimodal Not comparable

Amazon Nova Pro: 25.0 (#126), Gemma 3 1B: —

Multimodal benchmarks
BenchmarkAmazon Nova ProGemma 3 1B
LMArena Vision980—

Multilingual Not comparable

Amazon Nova Pro: 39.7 (#223), Gemma 3 1B: —

Multilingual benchmarks
BenchmarkAmazon Nova ProGemma 3 1B
LMArena Non-English1234—
LMArena Chinese1244—
LMArena French1271—
LMArena German1243—
LMArena Japanese1200—
LMArena Korean1203—
LMArena Russian1240—
LMArena Spanish1182—

Instruction Following Not comparable

Amazon Nova Pro: 64.9 (#226), Gemma 3 1B: —

Instruction Following benchmarks
BenchmarkAmazon Nova ProGemma 3 1B
LiveBench Instruction Following67.1%—
IFEval81.5%—
LMArena Instruction Following1235—

Long Context Not comparable

Amazon Nova Pro: 38.1 (#205), Gemma 3 1B: —

Long Context benchmarks
BenchmarkAmazon Nova ProGemma 3 1B
LMArena Longer Query1255—

Writing & Preference Not comparable

Amazon Nova Pro: 43.9 (#226), Gemma 3 1B: —

Writing & Preference benchmarks
BenchmarkAmazon Nova ProGemma 3 1B
LMArena Text1259—
LMArena Creative Writing1212—
Short-Story Creative Writing60.5%—
WildBench77.7%—
LMArena Multi-Turn1246—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than Gemma 3 1B?

Amazon Nova Pro is the stronger model overall, scoring 31.0 to 21.1 on the Noometry Index.

How many benchmarks do Amazon Nova Pro and Gemma 3 1B share?

1 benchmark has published results for both models. Amazon Nova Pro has 38 scored results on Noometry and Gemma 3 1B has 4.

Related comparisons

Go deeper