Model comparison

Granite 3.0 2b Instruct vs Yi 6B

Granite 3.0 2b Instruct has enough public results to be ranked (#284); Yi 6B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Granite 3.0 2b Instruct IBM

30.2

Rank #284 Confirmed

Yi 6B 01.AI

—

Unranked

Side by side

Granite 3.0 2b Instruct and Yi 6B specifications
Granite 3.0 2b InstructYi 6B
ProviderIBM01.AI
Noometry Index30.2—
Released—2023-11-02
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked137

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Granite 3.0 2b Instruct: 27.8 (#311), Yi 6B: —

Coding benchmarks
BenchmarkGranite 3.0 2b InstructYi 6B
BigCodeBench Instruct20.5%—
LMArena Coding1090—

Reasoning Not comparable

Granite 3.0 2b Instruct: 19.6 (#234), Yi 6B: —

Reasoning benchmarks
BenchmarkGranite 3.0 2b InstructYi 6B
LMArena Hard Prompts1073—
BIG-Bench Hard—47.2%
Epoch Capabilities Index—104.37
HellaSwag—74.4%
WinoGrande—71.3%

Math Not comparable

Granite 3.0 2b Instruct: 29.7 (#215), Yi 6B: —

Math benchmarks
BenchmarkGranite 3.0 2b InstructYi 6B
LMArena Math1117—
GSM8K—44.9%

Knowledge Not comparable

Granite 3.0 2b Instruct: 28.4 (#238), Yi 6B: —

Knowledge benchmarks
BenchmarkGranite 3.0 2b InstructYi 6B
LMArena Expert1064—
ARC (AI2) Challenge—50.3%
MMLU—64%

Multilingual Not comparable

Granite 3.0 2b Instruct: 27.1 (#273), Yi 6B: —

Multilingual benchmarks
BenchmarkGranite 3.0 2b InstructYi 6B
LMArena Non-English1033—
LMArena Chinese1070—
LMArena Russian1045—

Instruction Following Not comparable

Granite 3.0 2b Instruct: 54.2 (#279), Yi 6B: —

Instruction Following benchmarks
BenchmarkGranite 3.0 2b InstructYi 6B
LMArena Instruction Following1056—

Long Context Not comparable

Granite 3.0 2b Instruct: 32.5 (#263), Yi 6B: —

Long Context benchmarks
BenchmarkGranite 3.0 2b InstructYi 6B
LMArena Longer Query1071—

Writing & Preference Not comparable

Granite 3.0 2b Instruct: 29.8 (#287), Yi 6B: —

Writing & Preference benchmarks
BenchmarkGranite 3.0 2b InstructYi 6B
LMArena Text1080—
LMArena Creative Writing1046—
LMArena Multi-Turn1053—

Frequently asked questions

Is Granite 3.0 2b Instruct better than Yi 6B?

Granite 3.0 2b Instruct has enough public results to be ranked (#284); Yi 6B does not yet, so treat this comparison as directional.

How many benchmarks do Granite 3.0 2b Instruct and Yi 6B share?

0 benchmarks have published results for both models. Granite 3.0 2b Instruct has 13 scored results on Noometry and Yi 6B has 7.

Related comparisons

Go deeper