Model comparison

Codellama 70b Instruct vs Granite 4.0 H Small

Granite 4.0 H Small is the stronger model overall, scoring 36.5 to 33.7 on the Noometry Index.

Last verified . 4 shared benchmarks.

Codellama 70b Instruct Meta

33.7

Rank #237 Confirmed

Granite 4.0 H Small IBM

36.5

Rank #214 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Codellama 70b Instruct scores higher in 1 category and Granite 4.0 H Small in 4 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in instruction following, where Granite 4.0 H Small leads 68.7 to 51.9.

Side by side

Codellama 70b Instruct and Granite 4.0 H Small specifications
Codellama 70b InstructGranite 4.0 H Small
ProviderMetaIBM
Noometry Index33.736.5
Released——
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked719

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Codellama 70b Instruct leads

Codellama 70b Instruct: 37.6 (#193), Granite 4.0 H Small: 36.4 (#209)

Coding benchmarks
BenchmarkCodellama 70b InstructGranite 4.0 H Small
BigCodeBench Instruct40.7%—
LMArena Coding—1249
BigCodeBench Complete49.6%—
HumanEval+65.9%—

Reasoning Granite 4.0 H Small leads

Codellama 70b Instruct: 20.1 (#242), Granite 4.0 H Small: 24.4 (#163)

Reasoning benchmarks
BenchmarkCodellama 70b InstructGranite 4.0 H Small
LMArena Hard Prompts10521240

Math Not comparable

Codellama 70b Instruct: —, Granite 4.0 H Small: 31.4 (#223)

Math benchmarks
BenchmarkCodellama 70b InstructGranite 4.0 H Small
Omni-MATH—29.6%
LMArena Math—1247

Knowledge Not comparable

Codellama 70b Instruct: —, Granite 4.0 H Small: 32.0 (#215)

Knowledge benchmarks
BenchmarkCodellama 70b InstructGranite 4.0 H Small
MMLU-Pro—56.9%
Vectara Hallucination Rate—5.2%
GPQA (HELM)—38.3%
LMArena Expert—1251

Multilingual Granite 4.0 H Small leads

Codellama 70b Instruct: 24.8 (#288), Granite 4.0 H Small: 38.6 (#228)

Multilingual benchmarks
BenchmarkCodellama 70b InstructGranite 4.0 H Small
LMArena Non-English9921216
LMArena Chinese—1249
LMArena Russian—1201
LMArena Spanish—1258

Instruction Following Granite 4.0 H Small leads

Codellama 70b Instruct: 51.9 (#293), Granite 4.0 H Small: 68.7 (#183)

Instruction Following benchmarks
BenchmarkCodellama 70b InstructGranite 4.0 H Small
LMArena Instruction Following10241222
IFEval—89%

Long Context Not comparable

Codellama 70b Instruct: —, Granite 4.0 H Small: 37.7 (#213)

Long Context benchmarks
BenchmarkCodellama 70b InstructGranite 4.0 H Small
LMArena Longer Query—1242

Writing & Preference Granite 4.0 H Small leads

Codellama 70b Instruct: 33.4 (#277), Granite 4.0 H Small: 43.8 (#227)

Writing & Preference benchmarks
BenchmarkCodellama 70b InstructGranite 4.0 H Small
LMArena Text10571241
LMArena Creative Writing—1211
WildBench—73.9%
LMArena Multi-Turn—1242

Frequently asked questions

Is Codellama 70b Instruct better than Granite 4.0 H Small?

Granite 4.0 H Small is the stronger model overall, scoring 36.5 to 33.7 on the Noometry Index.

Is Codellama 70b Instruct or Granite 4.0 H Small better for coding?

Codellama 70b Instruct scores higher on coding benchmarks: 37.6 versus 36.4 in the Noometry coding category.

How many benchmarks do Codellama 70b Instruct and Granite 4.0 H Small share?

4 benchmarks have published results for both models. Codellama 70b Instruct has 7 scored results on Noometry and Granite 4.0 H Small has 19.

Related comparisons

Go deeper