Model comparison

Gemma 3n E4b IT vs Nova Premier 1.0

Nova Premier 1.0 is the stronger model overall, scoring 38.3 to 37.3 on the Noometry Index.

Last verified . 1 shared benchmarks.

Gemma 3n E4b IT Google

37.3

Rank #206 Confirmed

Nova Premier 1.0 Amazon

38.3

Rank #189 Confirmed

Summary

  • They share 1 benchmark with published results for both. Gemma 3n E4b IT scores higher in 1 category and Nova Premier 1.0 in 4 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Nova Premier 1.0 leads 23.0 to 19.9.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 31.5% for Gemma 3n E4b IT and 44.8% for Nova Premier 1.0.
  • Gemma 3n E4b IT has downloadable open weights; the other is API-only.

Side by side

Gemma 3n E4b IT and Nova Premier 1.0 specifications
Gemma 3n E4b ITNova Premier 1.0
ProviderGoogleAmazon
Noometry Index37.338.3
Released—2025-04-30
WeightsOpenProprietary
Context window—1M
Max output—10K
Input $ / M tokens—$2.50
Output $ / M tokens—$12.50
Results tracked186

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3n E4b IT: 37.0 (#198), Nova Premier 1.0: —

Coding benchmarks
BenchmarkGemma 3n E4b ITNova Premier 1.0
LMArena Coding1268—

Reasoning Nova Premier 1.0 leads

Gemma 3n E4b IT: 19.9 (#247), Nova Premier 1.0: 23.0 (#185)

Reasoning benchmarks
BenchmarkGemma 3n E4b ITNova Premier 1.0
Kagi LLM Benchmark31.5%44.8%
LMArena Hard Prompts1284—

Math Gemma 3n E4b IT leads

Gemma 3n E4b IT: 35.1 (#188), Nova Premier 1.0: 33.8 (#199)

Math benchmarks
BenchmarkGemma 3n E4b ITNova Premier 1.0
Omni-MATH—35%
LMArena Math1251—

Knowledge Nova Premier 1.0 leads

Gemma 3n E4b IT: 34.2 (#198), Nova Premier 1.0: 35.8 (#180)

Knowledge benchmarks
BenchmarkGemma 3n E4b ITNova Premier 1.0
MMLU-Pro—72.6%
GPQA (HELM)—51.8%
LMArena Expert1246—

Multilingual Not comparable

Gemma 3n E4b IT: 43.4 (#183), Nova Premier 1.0: —

Multilingual benchmarks
BenchmarkGemma 3n E4b ITNova Premier 1.0
LMArena Non-English1285—
LMArena Chinese1309—
LMArena French1330—
LMArena German1311—
LMArena Japanese1272—
LMArena Korean1259—
LMArena Russian1288—
LMArena Spanish1305—

Instruction Following Too close to call

Gemma 3n E4b IT: 66.1 (#210), Nova Premier 1.0: 66.8 (#204)

Instruction Following benchmarks
BenchmarkGemma 3n E4b ITNova Premier 1.0
IFEval—80.3%
LMArena Instruction Following1255—

Long Context Not comparable

Gemma 3n E4b IT: 38.7 (#191), Nova Premier 1.0: —

Long Context benchmarks
BenchmarkGemma 3n E4b ITNova Premier 1.0
LMArena Longer Query1276—

Writing & Preference Too close to call

Gemma 3n E4b IT: 50.1 (#186), Nova Premier 1.0: 51.0 (#178)

Writing & Preference benchmarks
BenchmarkGemma 3n E4b ITNova Premier 1.0
LMArena Text1306—
LMArena Creative Writing1287—
WildBench—78.8%
LMArena Multi-Turn1276—

Frequently asked questions

Is Gemma 3n E4b IT better than Nova Premier 1.0?

Nova Premier 1.0 is the stronger model overall, scoring 38.3 to 37.3 on the Noometry Index.

How many benchmarks do Gemma 3n E4b IT and Nova Premier 1.0 share?

1 benchmark has published results for both models. Gemma 3n E4b IT has 18 scored results on Noometry and Nova Premier 1.0 has 6.

Related comparisons

Go deeper