Model comparison

Granite 4.1 8b vs Palm 2

Granite 4.1 8b is the stronger model overall, scoring 37.4 to 30.0 on the Noometry Index.

Last verified . 10 shared benchmarks.

Granite 4.1 8b IBM

37.4

Rank #205 Confirmed

Palm 2 Google

30.0

Rank #298 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Granite 4.1 8b scores higher in 7 categories and Palm 2 in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Granite 4.1 8b leads 48.1 to 25.6.
  • Granite 4.1 8b has downloadable open weights; the other is API-only.

Side by side

Granite 4.1 8b and Palm 2 specifications
Granite 4.1 8bPalm 2
ProviderIBMGoogle
Noometry Index37.430.0
Released——
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1310

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.1 8b leads

Granite 4.1 8b: 30.1 (#297), Palm 2: 29.0 (#311)

Coding benchmarks
BenchmarkGranite 4.1 8bPalm 2
LMArena Coding1312994
LMArena WebDev1192—

Reasoning Granite 4.1 8b leads

Granite 4.1 8b: 25.7 (#143), Palm 2: 19.1 (#271)

Reasoning benchmarks
BenchmarkGranite 4.1 8bPalm 2
LMArena Hard Prompts12931005

Math Granite 4.1 8b leads

Granite 4.1 8b: 36.4 (#166), Palm 2: 30.8 (#231)

Math benchmarks
BenchmarkGranite 4.1 8bPalm 2
LMArena Math13121049

Knowledge Not comparable

Granite 4.1 8b: 36.1 (#174), Palm 2: —

Knowledge benchmarks
BenchmarkGranite 4.1 8bPalm 2
LMArena Expert1309—

Multilingual Granite 4.1 8b leads

Granite 4.1 8b: 41.7 (#204), Palm 2: 20.9 (#295)

Multilingual benchmarks
BenchmarkGranite 4.1 8bPalm 2
LMArena Non-English1261916
LMArena Chinese1337887
LMArena Russian1240—

Instruction Following Granite 4.1 8b leads

Granite 4.1 8b: 66.9 (#203), Palm 2: 51.0 (#296)

Instruction Following benchmarks
BenchmarkGranite 4.1 8bPalm 2
LMArena Instruction Following12691010

Long Context Granite 4.1 8b leads

Granite 4.1 8b: 38.7 (#193), Palm 2: 30.8 (#285)

Long Context benchmarks
BenchmarkGranite 4.1 8bPalm 2
LMArena Longer Query12751010

Writing & Preference Granite 4.1 8b leads

Granite 4.1 8b: 48.1 (#204), Palm 2: 25.6 (#304)

Writing & Preference benchmarks
BenchmarkGranite 4.1 8bPalm 2
LMArena Text12901027
LMArena Creative Writing1251991
LMArena Multi-Turn1268994

Frequently asked questions

Is Granite 4.1 8b better than Palm 2?

Granite 4.1 8b is the stronger model overall, scoring 37.4 to 30.0 on the Noometry Index.

Is Granite 4.1 8b or Palm 2 better for coding?

Granite 4.1 8b scores higher on coding benchmarks: 30.1 versus 29.0 in the Noometry coding category.

How many benchmarks do Granite 4.1 8b and Palm 2 share?

10 benchmarks have published results for both models. Granite 4.1 8b has 13 scored results on Noometry and Palm 2 has 10.

Related comparisons

Go deeper