Model comparison

Falcon-180B vs Granite 4.2 30b

Granite 4.2 30b is the stronger model overall, scoring 41.8 to 32.2 on the Noometry Index.

Last verified . 6 shared benchmarks.

Granite 4.2 30b IBM

41.8

Rank #130 Confirmed

Summary

  • They share 6 benchmarks with published results for both. Falcon-180B scores higher in 0 categories and Granite 4.2 30b in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Granite 4.2 30b leads 53.8 to 29.1.

Side by side

Falcon-180B and Granite 4.2 30b specifications
Falcon-180BGranite 4.2 30b
ProviderTechnology Innovation InstituteIBM
Noometry Index32.241.8
Released2023-09-06—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1611

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, Granite 4.2 30b: 41.0 (#126)

Coding benchmarks
BenchmarkFalcon-180BGranite 4.2 30b
LMArena Coding—1396

Reasoning Granite 4.2 30b leads

Falcon-180B: 19.1 (#269), Granite 4.2 30b: 27.8 (#112)

Reasoning benchmarks
BenchmarkFalcon-180BGranite 4.2 30b
LMArena Hard Prompts10071374
Epoch Capabilities Index112.13—
HellaSwag89%—
LAMBADA79.8%—
PIQA84.9%—
WinoGrande87.1%—

Math Not comparable

Falcon-180B: —, Granite 4.2 30b: —

Math benchmarks
BenchmarkFalcon-180BGranite 4.2 30b
GSM8K54.4%—

Knowledge Not comparable

Falcon-180B: —, Granite 4.2 30b: 39.1 (#138)

Knowledge benchmarks
BenchmarkFalcon-180BGranite 4.2 30b
LMArena Expert—1406
ARC (AI2) Challenge67.8%—
BoolQ89%—
MMLU70.6%—
OpenBookQA64.2%—

Multilingual Granite 4.2 30b leads

Falcon-180B: 25.2 (#286), Granite 4.2 30b: 47.3 (#151)

Multilingual benchmarks
BenchmarkFalcon-180BGranite 4.2 30b
LMArena Non-English10001340
LMArena Chinese—1414
LMArena Russian—1343

Instruction Following Granite 4.2 30b leads

Falcon-180B: 53.4 (#286), Granite 4.2 30b: 71.2 (#155)

Instruction Following benchmarks
BenchmarkFalcon-180BGranite 4.2 30b
LMArena Instruction Following10471347

Long Context Not comparable

Falcon-180B: —, Granite 4.2 30b: 41.4 (#140)

Long Context benchmarks
BenchmarkFalcon-180BGranite 4.2 30b
LMArena Longer Query—1359

Writing & Preference Granite 4.2 30b leads

Falcon-180B: 29.1 (#295), Granite 4.2 30b: 53.8 (#156)

Writing & Preference benchmarks
BenchmarkFalcon-180BGranite 4.2 30b
LMArena Text10541361
LMArena Creative Writing10891288
LMArena Multi-Turn10131339

Frequently asked questions

Is Falcon-180B better than Granite 4.2 30b?

Granite 4.2 30b is the stronger model overall, scoring 41.8 to 32.2 on the Noometry Index.

How many benchmarks do Falcon-180B and Granite 4.2 30b share?

6 benchmarks have published results for both models. Falcon-180B has 16 scored results on Noometry and Granite 4.2 30b has 11.

Related comparisons

Go deeper