Alibaba (Qwen), open weights

Qwen2.5-Coder (1.5B)

Qwen2.5-Coder (1.5B) by Alibaba (Qwen) has 6 published benchmark results on Noometry, not yet enough to be ranked.

Last verified

Specifications

Noometry rank
Unranked
Index score
Not ranked
Evidence
6 results
Released
September 18, 2024
Weights
Open weights
Reasoning
Unknown
Context window
—
Max output
—
Input price
Not listed
Output price
Not listed
Blended price
Not listed
Output speed
Not measured
Value
Not ranked
Knowledge cutoff
Unknown

Sponsored placements are available on pages like this one. Advertise on Noometry

Benchmark results

Every published result we track, with its source. Bold rows are the ones used for ranking; where several exist we prefer independent runs over self-reported numbers.

Reasoning

Qwen2.5-Coder (1.5B) Reasoning benchmark results
BenchmarkScorePositionSettingSourceDate
Epoch Capabilities Index113.14#186 of 213, top 88%Epoch AI2024-09-18
Epoch Capabilities Index102.99Epoch AI2024-09-18
HellaSwag76.8%#22 of 29, top 76%Epoch AI
HellaSwag61.8%Epoch AI
WinoGrande60.7%Epoch AI
WinoGrande72.9%#28 of 43, top 66%Epoch AI

Math

Qwen2.5-Coder (1.5B) Math benchmark results
BenchmarkScorePositionSettingSourceDate
GSM8K83.9%Epoch AI
GSM8K86.7%#7 of 38, top 19%Epoch AI
GSM8K65.8%Epoch AI

Knowledge

Qwen2.5-Coder (1.5B) Knowledge benchmark results
BenchmarkScorePositionSettingSourceDate
ARC (AI2) Challenge60.9%#22 of 39, top 57%Epoch AI
ARC (AI2) Challenge45.2%Epoch AI
MMLU68%#52 of 81, top 65%Epoch AI
MMLU53.6%Epoch AI

Compare Qwen2.5-Coder (1.5B)

Other Alibaba (Qwen) models

Frequently asked questions

How good is Qwen2.5-Coder (1.5B)?

Qwen2.5-Coder (1.5B) by Alibaba (Qwen) has 6 published benchmark results on Noometry, not yet enough to be ranked.

Is Qwen2.5-Coder (1.5B) open source?

Yes. Qwen2.5-Coder (1.5B)'s weights are downloadable; check the license for commercial terms.