Model comparison

Qwen1.5 4b Chat vs Yi 6B

Qwen1.5 4b Chat has enough public results to be ranked (#322); Yi 6B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Qwen1.5 4b Chat Alibaba (Qwen)

28.8

Rank #322 Confirmed

Yi 6B 01.AI

—

Unranked

Side by side

Qwen1.5 4b Chat and Yi 6B specifications
Qwen1.5 4b ChatYi 6B
ProviderAlibaba (Qwen)01.AI
Noometry Index28.8—
Released—2023-11-02
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked137

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Qwen1.5 4b Chat: 29.1 (#308), Yi 6B: —

Coding benchmarks
BenchmarkQwen1.5 4b ChatYi 6B
LMArena Coding999—

Reasoning Not comparable

Qwen1.5 4b Chat: 18.5 (#279), Yi 6B: —

Reasoning benchmarks
BenchmarkQwen1.5 4b ChatYi 6B
LMArena Hard Prompts976—
BIG-Bench Hard—47.2%
Epoch Capabilities Index—104.77
HellaSwag—74.4%
WinoGrande—71.3%

Math Not comparable

Qwen1.5 4b Chat: 30.4 (#234), Yi 6B: —

Math benchmarks
BenchmarkQwen1.5 4b ChatYi 6B
LMArena Math1026—
GSM8K—44.9%

Knowledge Not comparable

Qwen1.5 4b Chat: 26.7 (#255), Yi 6B: —

Knowledge benchmarks
BenchmarkQwen1.5 4b ChatYi 6B
LMArena Expert980—
ARC (AI2) Challenge—50.3%
MMLU—64%

Multilingual Not comparable

Qwen1.5 4b Chat: 24.1 (#290), Yi 6B: —

Multilingual benchmarks
BenchmarkQwen1.5 4b ChatYi 6B
LMArena Non-English979—
LMArena Chinese1024—
LMArena German902—
LMArena Russian952—

Instruction Following Not comparable

Qwen1.5 4b Chat: 49.0 (#300), Yi 6B: —

Instruction Following benchmarks
BenchmarkQwen1.5 4b ChatYi 6B
LMArena Instruction Following978—

Long Context Not comparable

Qwen1.5 4b Chat: 30.1 (#290), Yi 6B: —

Long Context benchmarks
BenchmarkQwen1.5 4b ChatYi 6B
LMArena Longer Query988—

Writing & Preference Not comparable

Qwen1.5 4b Chat: 23.8 (#309), Yi 6B: —

Writing & Preference benchmarks
BenchmarkQwen1.5 4b ChatYi 6B
LMArena Text997—
LMArena Creative Writing969—
LMArena Multi-Turn977—

Frequently asked questions

Is Qwen1.5 4b Chat better than Yi 6B?

Qwen1.5 4b Chat has enough public results to be ranked (#322); Yi 6B does not yet, so treat this comparison as directional.

How many benchmarks do Qwen1.5 4b Chat and Yi 6B share?

0 benchmarks have published results for both models. Qwen1.5 4b Chat has 13 scored results on Noometry and Yi 6B has 7.

Related comparisons

Go deeper