Model comparison

Yi-1.5-34B vs Yi 6B

Yi-1.5-34B has enough public results to be ranked (#289); Yi 6B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Yi-1.5-34B 01.AI

30.6

Rank #289 Confirmed

Yi 6B 01.AI

—

Unranked

Side by side

Yi-1.5-34B and Yi 6B specifications
Yi-1.5-34BYi 6B
Provider01.AI01.AI
Noometry Index30.6—
Released2024-05-132023-11-02
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked217

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Yi-1.5-34B: 32.4 (#272), Yi 6B: —

Coding benchmarks
BenchmarkYi-1.5-34BYi 6B
BigCodeBench Instruct33.9%—
LMArena Coding1169—
BigCodeBench Complete43.8%—

Reasoning Not comparable

Yi-1.5-34B: 22.5 (#191), Yi 6B: —

Reasoning benchmarks
BenchmarkYi-1.5-34BYi 6B
LMArena Hard Prompts1160—
BIG-Bench Hard—47.2%
Epoch Capabilities Index—104.77
HellaSwag—74.4%
WinoGrande—71.3%

Math Not comparable

Yi-1.5-34B: 27.5 (#249), Yi 6B: —

Math benchmarks
BenchmarkYi-1.5-34BYi 6B
LMArena Math1182—
MATH Level 525.5%—
GSM8K—44.9%

Knowledge Not comparable

Yi-1.5-34B: 14.8 (#295), Yi 6B: —

Knowledge benchmarks
BenchmarkYi-1.5-34BYi 6B
GPQA Diamond32%—
LMArena Expert1144—
ARC (AI2) Challenge—50.3%
MMLU—64%

Multilingual Not comparable

Yi-1.5-34B: 32.3 (#256), Yi 6B: —

Multilingual benchmarks
BenchmarkYi-1.5-34BYi 6B
LMArena Non-English1121—
LMArena Chinese1213—
LMArena French1156—
LMArena German1111—
LMArena Japanese1021—
LMArena Korean1005—
LMArena Russian1091—
LMArena Spanish1121—

Instruction Following Not comparable

Yi-1.5-34B: 59.2 (#257), Yi 6B: —

Instruction Following benchmarks
BenchmarkYi-1.5-34BYi 6B
LMArena Instruction Following1139—

Long Context Not comparable

Yi-1.5-34B: 34.6 (#248), Yi 6B: —

Long Context benchmarks
BenchmarkYi-1.5-34BYi 6B
LMArena Longer Query1143—

Writing & Preference Not comparable

Yi-1.5-34B: 37.4 (#257), Yi 6B: —

Writing & Preference benchmarks
BenchmarkYi-1.5-34BYi 6B
LMArena Text1173—
LMArena Creative Writing1135—
LMArena Multi-Turn1153—

Frequently asked questions

Is Yi-1.5-34B better than Yi 6B?

Yi-1.5-34B has enough public results to be ranked (#289); Yi 6B does not yet, so treat this comparison as directional.

How many benchmarks do Yi-1.5-34B and Yi 6B share?

0 benchmarks have published results for both models. Yi-1.5-34B has 21 scored results on Noometry and Yi 6B has 7.

Related comparisons

Go deeper