Model comparison

Qwen1.5-72B vs Yi 6B

Qwen1.5-72B has enough public results to be ranked (#282); Yi 6B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Qwen1.5-72B Alibaba (Qwen)

30.3

Rank #282 Confirmed

Yi 6B 01.AI

—

Unranked

Side by side

Qwen1.5-72B and Yi 6B specifications
Qwen1.5-72BYi 6B
ProviderAlibaba (Qwen)01.AI
Noometry Index30.3—
Released2024-02-042023-11-02
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked227

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Qwen1.5-72B: 31.4 (#272), Yi 6B: —

Coding benchmarks
BenchmarkQwen1.5-72BYi 6B
BigCodeBench Instruct33.2%—
LMArena Coding1166—
BigCodeBench Complete40.3%—
HumanEval+59.1%—
MBPP+61.6%—

Reasoning Not comparable

Qwen1.5-72B: 21.2 (#201), Yi 6B: —

Reasoning benchmarks
BenchmarkQwen1.5-72BYi 6B
LMArena Hard Prompts1148—
BIG-Bench Hard—47.2%
Epoch Capabilities Index—104.37
HellaSwag—74.4%
WinoGrande—71.3%

Math Not comparable

Qwen1.5-72B: 30.7 (#205), Yi 6B: —

Math benchmarks
BenchmarkQwen1.5-72BYi 6B
LMArena Math1164—
GSM8K—44.9%

Knowledge Not comparable

Qwen1.5-72B: 11.5 (#295), Yi 6B: —

Knowledge benchmarks
BenchmarkQwen1.5-72BYi 6B
GPQA Diamond28.8%—
LMArena Expert1136—
ARC (AI2) Challenge—50.3%
MMLU—64%

Multilingual Not comparable

Qwen1.5-72B: 33.4 (#248), Yi 6B: —

Multilingual benchmarks
BenchmarkQwen1.5-72BYi 6B
LMArena Non-English1135—
LMArena Chinese1186—
LMArena French1158—
LMArena German1084—
LMArena Japanese1061—
LMArena Korean1049—
LMArena Russian1104—
LMArena Spanish1110—

Instruction Following Not comparable

Qwen1.5-72B: 59.6 (#251), Yi 6B: —

Instruction Following benchmarks
BenchmarkQwen1.5-72BYi 6B
LMArena Instruction Following1142—

Long Context Not comparable

Qwen1.5-72B: 35.0 (#238), Yi 6B: —

Long Context benchmarks
BenchmarkQwen1.5-72BYi 6B
LMArena Longer Query1157—

Writing & Preference Not comparable

Qwen1.5-72B: 37.4 (#253), Yi 6B: —

Writing & Preference benchmarks
BenchmarkQwen1.5-72BYi 6B
LMArena Text1166—
LMArena Creative Writing1137—
LMArena Multi-Turn1160—

Frequently asked questions

Is Qwen1.5-72B better than Yi 6B?

Qwen1.5-72B has enough public results to be ranked (#282); Yi 6B does not yet, so treat this comparison as directional.

How many benchmarks do Qwen1.5-72B and Yi 6B share?

0 benchmarks have published results for both models. Qwen1.5-72B has 22 scored results on Noometry and Yi 6B has 7.

Related comparisons

Go deeper