Model comparison

Gemma 3n E4b IT vs Palm 2

Gemma 3n E4b IT is the stronger model overall, scoring 37.3 to 30.0 on the Noometry Index.

Last verified . 10 shared benchmarks.

Gemma 3n E4b IT Google

37.3

Rank #206 Confirmed

Palm 2 Google

30.0

Rank #298 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Gemma 3n E4b IT scores higher in 7 categories and Palm 2 in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemma 3n E4b IT leads 50.1 to 25.6.
  • Gemma 3n E4b IT has downloadable open weights; the other is API-only.

Side by side

Gemma 3n E4b IT and Palm 2 specifications
Gemma 3n E4b ITPalm 2
ProviderGoogleGoogle
Noometry Index37.330.0
Released——
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1810

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemma 3n E4b IT leads

Gemma 3n E4b IT: 37.0 (#198), Palm 2: 29.0 (#311)

Coding benchmarks
BenchmarkGemma 3n E4b ITPalm 2
LMArena Coding1268994

Reasoning Too close to call

Gemma 3n E4b IT: 19.9 (#247), Palm 2: 19.1 (#271)

Reasoning benchmarks
BenchmarkGemma 3n E4b ITPalm 2
LMArena Hard Prompts12841005
Kagi LLM Benchmark31.5%—

Math Gemma 3n E4b IT leads

Gemma 3n E4b IT: 35.1 (#188), Palm 2: 30.8 (#231)

Math benchmarks
BenchmarkGemma 3n E4b ITPalm 2
LMArena Math12511049

Knowledge Not comparable

Gemma 3n E4b IT: 34.2 (#198), Palm 2: —

Knowledge benchmarks
BenchmarkGemma 3n E4b ITPalm 2
LMArena Expert1246—

Multilingual Gemma 3n E4b IT leads

Gemma 3n E4b IT: 43.4 (#183), Palm 2: 20.9 (#295)

Multilingual benchmarks
BenchmarkGemma 3n E4b ITPalm 2
LMArena Non-English1285916
LMArena Chinese1309887
LMArena French1330—
LMArena German1311—
LMArena Japanese1272—
LMArena Korean1259—
LMArena Russian1288—
LMArena Spanish1305—

Instruction Following Gemma 3n E4b IT leads

Gemma 3n E4b IT: 66.1 (#210), Palm 2: 51.0 (#296)

Instruction Following benchmarks
BenchmarkGemma 3n E4b ITPalm 2
LMArena Instruction Following12551010

Long Context Gemma 3n E4b IT leads

Gemma 3n E4b IT: 38.7 (#191), Palm 2: 30.8 (#285)

Long Context benchmarks
BenchmarkGemma 3n E4b ITPalm 2
LMArena Longer Query12761010

Writing & Preference Gemma 3n E4b IT leads

Gemma 3n E4b IT: 50.1 (#186), Palm 2: 25.6 (#304)

Writing & Preference benchmarks
BenchmarkGemma 3n E4b ITPalm 2
LMArena Text13061027
LMArena Creative Writing1287991
LMArena Multi-Turn1276994

Frequently asked questions

Is Gemma 3n E4b IT better than Palm 2?

Gemma 3n E4b IT is the stronger model overall, scoring 37.3 to 30.0 on the Noometry Index.

Is Gemma 3n E4b IT or Palm 2 better for coding?

Gemma 3n E4b IT scores higher on coding benchmarks: 37.0 versus 29.0 in the Noometry coding category.

How many benchmarks do Gemma 3n E4b IT and Palm 2 share?

10 benchmarks have published results for both models. Gemma 3n E4b IT has 18 scored results on Noometry and Palm 2 has 10.

Related comparisons

Go deeper