Model comparison

Granite 4.2 3b vs Yi-1.5-34B

Granite 4.2 3b is the stronger model overall, scoring 39.4 to 30.6 on the Noometry Index.

Last verified . 11 shared benchmarks.

Granite 4.2 3b IBM

39.4

Rank #169 Confirmed

Yi-1.5-34B 01.AI

30.6

Rank #289 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Granite 4.2 3b scores higher in 7 categories and Yi-1.5-34B in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Granite 4.2 3b leads 36.3 to 14.8.

Side by side

Granite 4.2 3b and Yi-1.5-34B specifications
Granite 4.2 3bYi-1.5-34B
ProviderIBM01.AI
Noometry Index39.430.6
Released—2024-05-13
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1121

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.2 3b leads

Granite 4.2 3b: 40.0 (#151), Yi-1.5-34B: 32.4 (#272)

Coding benchmarks
BenchmarkGranite 4.2 3bYi-1.5-34B
LMArena Coding13611169
BigCodeBench Instruct—33.9%
BigCodeBench Complete—43.8%

Reasoning Granite 4.2 3b leads

Granite 4.2 3b: 26.0 (#138), Yi-1.5-34B: 22.5 (#191)

Reasoning benchmarks
BenchmarkGranite 4.2 3bYi-1.5-34B
LMArena Hard Prompts13061160

Math Not comparable

Granite 4.2 3b: —, Yi-1.5-34B: 27.5 (#249)

Math benchmarks
BenchmarkGranite 4.2 3bYi-1.5-34B
LMArena Math—1182
MATH Level 5—25.5%

Knowledge Granite 4.2 3b leads

Granite 4.2 3b: 36.3 (#171), Yi-1.5-34B: 14.8 (#295)

Knowledge benchmarks
BenchmarkGranite 4.2 3bYi-1.5-34B
LMArena Expert13151144
GPQA Diamond—32%

Multilingual Granite 4.2 3b leads

Granite 4.2 3b: 42.1 (#198), Yi-1.5-34B: 32.3 (#256)

Multilingual benchmarks
BenchmarkGranite 4.2 3bYi-1.5-34B
LMArena Non-English12681121
LMArena Chinese12691213
LMArena Russian12491091
LMArena French—1156
LMArena German—1111
LMArena Japanese—1021
LMArena Korean—1005
LMArena Spanish—1121

Instruction Following Granite 4.2 3b leads

Granite 4.2 3b: 67.1 (#200), Yi-1.5-34B: 59.2 (#257)

Instruction Following benchmarks
BenchmarkGranite 4.2 3bYi-1.5-34B
LMArena Instruction Following12731139

Long Context Granite 4.2 3b leads

Granite 4.2 3b: 39.2 (#185), Yi-1.5-34B: 34.6 (#248)

Long Context benchmarks
BenchmarkGranite 4.2 3bYi-1.5-34B
LMArena Longer Query12911143

Writing & Preference Granite 4.2 3b leads

Granite 4.2 3b: 47.2 (#212), Yi-1.5-34B: 37.4 (#257)

Writing & Preference benchmarks
BenchmarkGranite 4.2 3bYi-1.5-34B
LMArena Text12931173
LMArena Creative Writing12051135
LMArena Multi-Turn12901153

Frequently asked questions

Is Granite 4.2 3b better than Yi-1.5-34B?

Granite 4.2 3b is the stronger model overall, scoring 39.4 to 30.6 on the Noometry Index.

Is Granite 4.2 3b or Yi-1.5-34B better for coding?

Granite 4.2 3b scores higher on coding benchmarks: 40.0 versus 32.4 in the Noometry coding category.

How many benchmarks do Granite 4.2 3b and Yi-1.5-34B share?

11 benchmarks have published results for both models. Granite 4.2 3b has 11 scored results on Noometry and Yi-1.5-34B has 21.

Related comparisons

Go deeper