Model comparison

Qwen2.5 32B Instruct vs Qwen2.5-Coder (1.5B)

Qwen2.5 32B Instruct has enough public results to be ranked (#291); Qwen2.5-Coder (1.5B) does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Summary

  • They share 1 benchmark with published results for both.

Side by side

Qwen2.5 32B Instruct and Qwen2.5-Coder (1.5B) specifications
Qwen2.5 32B InstructQwen2.5-Coder (1.5B)
ProviderAlibaba (Qwen)Alibaba (Qwen)
Noometry Index29.7—
Released2024-092024-09-18
WeightsOpenOpen
Context window131K—
Max output8K—
Input $ / M tokens$0.70—
Output $ / M tokens$2.80—
Results tracked76

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Qwen2.5 32B Instruct: 38.1 (#165), Qwen2.5-Coder (1.5B): —

Coding benchmarks
BenchmarkQwen2.5 32B InstructQwen2.5-Coder (1.5B)
BigCodeBench Instruct45%—
BigCodeBench Complete52.3%—

Reasoning Not comparable

Qwen2.5 32B Instruct: 18.5 (#262), Qwen2.5-Coder (1.5B): —

Reasoning benchmarks
BenchmarkQwen2.5 32B InstructQwen2.5-Coder (1.5B)
Epoch Capabilities Index128.52112.93
Chess Puzzles0%—
HellaSwag—76.8%
WinoGrande—72.9%

Math Not comparable

Qwen2.5 32B Instruct: 15.3 (#289), Qwen2.5-Coder (1.5B): —

Math benchmarks
BenchmarkQwen2.5 32B InstructQwen2.5-Coder (1.5B)
OTIS Mock AIME 2024-20257.4%—
MATH Level 556.1%—
GSM8K—86.7%

Knowledge Not comparable

Qwen2.5 32B Instruct: 24.9 (#259), Qwen2.5-Coder (1.5B): —

Knowledge benchmarks
BenchmarkQwen2.5 32B InstructQwen2.5-Coder (1.5B)
GPQA Diamond46.1%—
ARC (AI2) Challenge—60.9%
MMLU—68%

Frequently asked questions

Is Qwen2.5 32B Instruct better than Qwen2.5-Coder (1.5B)?

Qwen2.5 32B Instruct has enough public results to be ranked (#291); Qwen2.5-Coder (1.5B) does not yet, so treat this comparison as directional.

How many benchmarks do Qwen2.5 32B Instruct and Qwen2.5-Coder (1.5B) share?

1 benchmark has published results for both models. Qwen2.5 32B Instruct has 7 scored results on Noometry and Qwen2.5-Coder (1.5B) has 6.

Related comparisons

Go deeper