Model comparison

Qwen2.5-Coder (1.5B) vs Yi 6B

Neither Qwen2.5-Coder (1.5B) nor Yi 6B has enough public benchmark results to be ranked yet; the rows below show what has been published.

Last verified . 6 shared benchmarks.

Summary

  • They share 6 benchmarks with published results for both.

Side by side

Qwen2.5-Coder (1.5B) and Yi 6B specifications
Qwen2.5-Coder (1.5B)Yi 6B
ProviderAlibaba (Qwen)01.AI
Noometry Index——
Released2024-09-182023-11-02
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked67

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Reasoning Not comparable

Qwen2.5-Coder (1.5B): —, Yi 6B: —

Reasoning benchmarks
BenchmarkQwen2.5-Coder (1.5B)Yi 6B
Epoch Capabilities Index113.14104.77
HellaSwag76.8%74.4%
WinoGrande72.9%71.3%
BIG-Bench Hard—47.2%

Math Not comparable

Qwen2.5-Coder (1.5B): —, Yi 6B: —

Math benchmarks
BenchmarkQwen2.5-Coder (1.5B)Yi 6B
GSM8K86.7%44.9%

Knowledge Not comparable

Qwen2.5-Coder (1.5B): —, Yi 6B: —

Knowledge benchmarks
BenchmarkQwen2.5-Coder (1.5B)Yi 6B
ARC (AI2) Challenge60.9%50.3%
MMLU68%64%

Frequently asked questions

Is Qwen2.5-Coder (1.5B) better than Yi 6B?

Neither Qwen2.5-Coder (1.5B) nor Yi 6B has enough public benchmark results to be ranked yet; the rows below show what has been published.

How many benchmarks do Qwen2.5-Coder (1.5B) and Yi 6B share?

6 benchmarks have published results for both models. Qwen2.5-Coder (1.5B) has 6 scored results on Noometry and Yi 6B has 7.

Related comparisons

Go deeper