Noometry

Model comparison

Gemma 2 2b IT vs Palm 2

Gemma 2 2b IT is the stronger model overall, scoring 33.1 to 30.0 on the Noometry Index.

Last verified . 10 shared benchmarks.

Gemma 2 2b IT Google

33.1

Rank #248 Confirmed

Palm 2 Google

30.0

Rank #298 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Gemma 2 2b IT scores higher in 7 categories and Palm 2 in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where Gemma 2 2b IT leads 32.3 to 20.9.
  • Gemma 2 2b IT has downloadable open weights; the other is API-only.

Side by side

Gemma 2 2b ITPalm 2
ProviderGoogleGoogle
Noometry Index33.130.0
Released——
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1710

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemma 2 2b IT leads

Gemma 2 2b IT: 32.3 (#273), Palm 2: 29.0 (#311)

BenchmarkGemma 2 2b ITPalm 2
LMArena Coding1112994

Reasoning Gemma 2 2b IT leads

Gemma 2 2b IT: 21.4 (#224), Palm 2: 19.1 (#271)

BenchmarkGemma 2 2b ITPalm 2
LMArena Hard Prompts11131005

Math Gemma 2 2b IT leads

Gemma 2 2b IT: 32.6 (#212), Palm 2: 30.8 (#231)

BenchmarkGemma 2 2b ITPalm 2
LMArena Math11351049

Knowledge Not comparable

Gemma 2 2b IT: 29.9 (#231), Palm 2: —

BenchmarkGemma 2 2b ITPalm 2
LMArena Expert1096—

Multilingual Gemma 2 2b IT leads

Gemma 2 2b IT: 32.3 (#257), Palm 2: 20.9 (#295)

BenchmarkGemma 2 2b ITPalm 2
LMArena Non-English1121916
LMArena Chinese1132887
LMArena French1157—
LMArena German1114—
LMArena Japanese1083—
LMArena Korean1055—
LMArena Russian1118—
LMArena Spanish1140—

Instruction Following Gemma 2 2b IT leads

Gemma 2 2b IT: 57.8 (#263), Palm 2: 51.0 (#296)

BenchmarkGemma 2 2b ITPalm 2
LMArena Instruction Following11181010

Long Context Gemma 2 2b IT leads

Gemma 2 2b IT: 34.3 (#250), Palm 2: 30.8 (#285)

BenchmarkGemma 2 2b ITPalm 2
LMArena Longer Query11301010

Writing & Preference Gemma 2 2b IT leads

Gemma 2 2b IT: 36.5 (#263), Palm 2: 25.6 (#304)

BenchmarkGemma 2 2b ITPalm 2
LMArena Text11561027
LMArena Creative Writing1147991
LMArena Multi-Turn1118994

Frequently asked questions

Is Gemma 2 2b IT better than Palm 2?

Gemma 2 2b IT is the stronger model overall, scoring 33.1 to 30.0 on the Noometry Index.

Is Gemma 2 2b IT or Palm 2 better for coding?

Gemma 2 2b IT scores higher on coding benchmarks: 32.3 versus 29.0 in the Noometry coding category.

How many benchmarks do Gemma 2 2b IT and Palm 2 share?

10 benchmarks have published results for both models. Gemma 2 2b IT has 17 scored results on Noometry and Palm 2 has 10.

Related comparisons

Go deeper