Model comparison

Granite 4.2 30b vs Llama 2-13B

Granite 4.2 30b is the stronger model overall, scoring 41.8 to 29.6 on the Noometry Index.

Last verified . 11 shared benchmarks.

Granite 4.2 30b IBM

41.8

Rank #130 Confirmed

Llama 2-13B Meta

29.6

Rank #309 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Granite 4.2 30b scores higher in 7 categories and Llama 2-13B in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Granite 4.2 30b leads 53.8 to 29.8.

Side by side

Granite 4.2 30b and Llama 2-13B specifications
Granite 4.2 30bLlama 2-13B
ProviderIBMMeta
Noometry Index41.829.6
Released—2023-07-18
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1132

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.2 30b leads

Granite 4.2 30b: 41.0 (#126), Llama 2-13B: 30.9 (#291)

Coding benchmarks
BenchmarkGranite 4.2 30bLlama 2-13B
LMArena Coding13961062

Reasoning Granite 4.2 30b leads

Granite 4.2 30b: 27.8 (#112), Llama 2-13B: 12.8 (#337)

Reasoning benchmarks
BenchmarkGranite 4.2 30bLlama 2-13B
LMArena Hard Prompts13741051
Chess Puzzles—0%
DTBench—42.2%
BIG-Bench Hard—58.2%
Epoch Capabilities Index—106.17
HellaSwag—80.7%
LAMBADA—76.5%
PIQA—80.8%
WinoGrande—72.8%

Math Not comparable

Granite 4.2 30b: —, Llama 2-13B: 31.1 (#229)

Math benchmarks
BenchmarkGranite 4.2 30bLlama 2-13B
LMArena Math—1065
GSM8K—36.9%

Knowledge Granite 4.2 30b leads

Granite 4.2 30b: 39.1 (#138), Llama 2-13B: 28.1 (#249)

Knowledge benchmarks
BenchmarkGranite 4.2 30bLlama 2-13B
LMArena Expert14061030
ARC (AI2) Challenge—60.3%
BoolQ—82.4%
MMLU—55.6%
OpenBookQA—57%
TriviaQA—79.6%

Multimodal Not comparable

Granite 4.2 30b: —, Llama 2-13B: —

Multimodal benchmarks
BenchmarkGranite 4.2 30bLlama 2-13B
ScienceQA—55.8%

Multilingual Granite 4.2 30b leads

Granite 4.2 30b: 47.3 (#151), Llama 2-13B: 26.5 (#279)

Multilingual benchmarks
BenchmarkGranite 4.2 30bLlama 2-13B
LMArena Non-English13401024
LMArena Chinese14141001
LMArena Russian13431055
LMArena French—1044
LMArena German—1009
LMArena Japanese—894
LMArena Korean—953
LMArena Spanish—1087

Instruction Following Granite 4.2 30b leads

Granite 4.2 30b: 71.2 (#155), Llama 2-13B: 53.3 (#287)

Instruction Following benchmarks
BenchmarkGranite 4.2 30bLlama 2-13B
LMArena Instruction Following13471045

Long Context Granite 4.2 30b leads

Granite 4.2 30b: 41.4 (#140), Llama 2-13B: 32.3 (#269)

Long Context benchmarks
BenchmarkGranite 4.2 30bLlama 2-13B
LMArena Longer Query13591064

Writing & Preference Granite 4.2 30b leads

Granite 4.2 30b: 53.8 (#156), Llama 2-13B: 29.8 (#289)

Writing & Preference benchmarks
BenchmarkGranite 4.2 30bLlama 2-13B
LMArena Text13611084
LMArena Creative Writing12881047
LMArena Multi-Turn13391050

Frequently asked questions

Is Granite 4.2 30b better than Llama 2-13B?

Granite 4.2 30b is the stronger model overall, scoring 41.8 to 29.6 on the Noometry Index.

Is Granite 4.2 30b or Llama 2-13B better for coding?

Granite 4.2 30b scores higher on coding benchmarks: 41.0 versus 30.9 in the Noometry coding category.

How many benchmarks do Granite 4.2 30b and Llama 2-13B share?

11 benchmarks have published results for both models. Granite 4.2 30b has 11 scored results on Noometry and Llama 2-13B has 32.

Related comparisons

Go deeper