Model comparison

Codellama 34b Instruct vs Granite 4.1 8b

Granite 4.1 8b is the stronger model overall, scoring 37.4 to 30.8 on the Noometry Index.

Last verified . 10 shared benchmarks.

Codellama 34b Instruct Meta

30.8

Rank #287 Confirmed

Granite 4.1 8b IBM

37.4

Rank #205 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Codellama 34b Instruct scores higher in 0 categories and Granite 4.1 8b in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Granite 4.1 8b leads 48.1 to 28.2.

Side by side

Codellama 34b Instruct and Granite 4.1 8b specifications
Codellama 34b InstructGranite 4.1 8b
ProviderMetaIBM
Noometry Index30.837.4
Released——
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1413

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.1 8b leads

Codellama 34b Instruct: 28.5 (#314), Granite 4.1 8b: 30.1 (#297)

Coding benchmarks
BenchmarkCodellama 34b InstructGranite 4.1 8b
LMArena Coding10461312
LMArena WebDev—1192
BigCodeBench Instruct29%—
BigCodeBench Complete37.1%—
HumanEval+43.9%—
MBPP+56.3%—

Reasoning Granite 4.1 8b leads

Codellama 34b Instruct: 19.6 (#255), Granite 4.1 8b: 25.7 (#143)

Reasoning benchmarks
BenchmarkCodellama 34b InstructGranite 4.1 8b
LMArena Hard Prompts10321293

Math Granite 4.1 8b leads

Codellama 34b Instruct: 31.0 (#230), Granite 4.1 8b: 36.4 (#166)

Math benchmarks
BenchmarkCodellama 34b InstructGranite 4.1 8b
LMArena Math10561312

Knowledge Not comparable

Codellama 34b Instruct: —, Granite 4.1 8b: 36.1 (#174)

Knowledge benchmarks
BenchmarkCodellama 34b InstructGranite 4.1 8b
LMArena Expert—1309

Multilingual Granite 4.1 8b leads

Codellama 34b Instruct: 25.8 (#284), Granite 4.1 8b: 41.7 (#204)

Multilingual benchmarks
BenchmarkCodellama 34b InstructGranite 4.1 8b
LMArena Non-English10111261
LMArena Chinese9761337
LMArena Russian—1240

Instruction Following Granite 4.1 8b leads

Codellama 34b Instruct: 52.2 (#291), Granite 4.1 8b: 66.9 (#203)

Instruction Following benchmarks
BenchmarkCodellama 34b InstructGranite 4.1 8b
LMArena Instruction Following10281269

Long Context Granite 4.1 8b leads

Codellama 34b Instruct: 30.9 (#284), Granite 4.1 8b: 38.7 (#193)

Long Context benchmarks
BenchmarkCodellama 34b InstructGranite 4.1 8b
LMArena Longer Query10131275

Writing & Preference Granite 4.1 8b leads

Codellama 34b Instruct: 28.2 (#297), Granite 4.1 8b: 48.1 (#204)

Writing & Preference benchmarks
BenchmarkCodellama 34b InstructGranite 4.1 8b
LMArena Text10661290
LMArena Creative Writing10321251
LMArena Multi-Turn10151268

Frequently asked questions

Is Codellama 34b Instruct better than Granite 4.1 8b?

Granite 4.1 8b is the stronger model overall, scoring 37.4 to 30.8 on the Noometry Index.

Is Codellama 34b Instruct or Granite 4.1 8b better for coding?

Granite 4.1 8b scores higher on coding benchmarks: 30.1 versus 28.5 in the Noometry coding category.

How many benchmarks do Codellama 34b Instruct and Granite 4.1 8b share?

10 benchmarks have published results for both models. Codellama 34b Instruct has 14 scored results on Noometry and Granite 4.1 8b has 13.

Related comparisons

Go deeper