Model comparison

Granite 4.2 8B vs Yi-1.5-34B

Granite 4.2 8B is the stronger model overall, scoring 40.0 to 30.2 on the Noometry Index.

Last verified . 11 shared benchmarks.

Granite 4.2 8B IBM

40.0

Rank #143 Confirmed

Yi-1.5-34B 01.AI

30.2

Rank #286 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Granite 4.2 8B scores higher in 7 categories and Yi-1.5-34B in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Granite 4.2 8B leads 37.7 to 14.8.

Side by side

Granite 4.2 8B and Yi-1.5-34B specifications
Granite 4.2 8BYi-1.5-34B
ProviderIBM01.AI
Noometry Index40.030.2
Released—2024-05-13
WeightsOpenOpen
Context window131K—
Max output118K—
Input $ / M tokens$0.06—
Output $ / M tokens$0.25—
Results tracked1121

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.2 8B leads

Granite 4.2 8B: 39.9 (#138), Yi-1.5-34B: 31.9 (#267)

Coding benchmarks
BenchmarkGranite 4.2 8BYi-1.5-34B
LMArena Coding13791169
BigCodeBench Instruct—33.9%
BigCodeBench Complete—43.8%

Reasoning Granite 4.2 8B leads

Granite 4.2 8B: 25.5 (#130), Yi-1.5-34B: 21.5 (#195)

Reasoning benchmarks
BenchmarkGranite 4.2 8BYi-1.5-34B
LMArena Hard Prompts13271160

Math Not comparable

Granite 4.2 8B: —, Yi-1.5-34B: 25.3 (#248)

Math benchmarks
BenchmarkGranite 4.2 8BYi-1.5-34B
LMArena Math—1182
MATH Level 5—25.5%

Knowledge Granite 4.2 8B leads

Granite 4.2 8B: 37.7 (#144), Yi-1.5-34B: 14.8 (#290)

Knowledge benchmarks
BenchmarkGranite 4.2 8BYi-1.5-34B
LMArena Expert13801144
GPQA Diamond—32%

Multilingual Granite 4.2 8B leads

Granite 4.2 8B: 44.5 (#173), Yi-1.5-34B: 32.5 (#251)

Multilingual benchmarks
BenchmarkGranite 4.2 8BYi-1.5-34B
LMArena Non-English12991121
LMArena Chinese13611213
LMArena Russian12831091
LMArena French—1155
LMArena German—1111
LMArena Japanese—1021
LMArena Korean—1005
LMArena Spanish—1120

Instruction Following Granite 4.2 8B leads

Granite 4.2 8B: 68.7 (#183), Yi-1.5-34B: 59.4 (#252)

Instruction Following benchmarks
BenchmarkGranite 4.2 8BYi-1.5-34B
LMArena Instruction Following12981139

Long Context Granite 4.2 8B leads

Granite 4.2 8B: 40.2 (#154), Yi-1.5-34B: 34.6 (#243)

Long Context benchmarks
BenchmarkGranite 4.2 8BYi-1.5-34B
LMArena Longer Query13231144

Writing & Preference Granite 4.2 8B leads

Granite 4.2 8B: 49.8 (#183), Yi-1.5-34B: 37.6 (#252)

Writing & Preference benchmarks
BenchmarkGranite 4.2 8BYi-1.5-34B
LMArena Text13191173
LMArena Creative Writing12381135
LMArena Multi-Turn12991153

Frequently asked questions

Is Granite 4.2 8B better than Yi-1.5-34B?

Granite 4.2 8B is the stronger model overall, scoring 40.0 to 30.2 on the Noometry Index.

Is Granite 4.2 8B or Yi-1.5-34B better for coding?

Granite 4.2 8B scores higher on coding benchmarks: 39.9 versus 31.9 in the Noometry coding category.

How many benchmarks do Granite 4.2 8B and Yi-1.5-34B share?

11 benchmarks have published results for both models. Granite 4.2 8B has 11 scored results on Noometry and Yi-1.5-34B has 21.

Related comparisons

Go deeper