Model comparison

Qwen Turbo vs Qwen2.5-Coder (1.5B)

Qwen Turbo has enough public results to be ranked (#335); Qwen2.5-Coder (1.5B) does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Summary

  • Qwen2.5-Coder (1.5B) has downloadable open weights; the other is API-only.

Side by side

Qwen Turbo and Qwen2.5-Coder (1.5B) specifications
Qwen TurboQwen2.5-Coder (1.5B)
ProviderAlibaba (Qwen)Alibaba (Qwen)
Noometry Index27.1—
Released2024-11-012024-09-18
WeightsProprietaryOpen
Context window1M—
Max output16K—
Input $ / M tokens$0.05—
Output $ / M tokens$0.20—
Results tracked36

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Reasoning Not comparable

Qwen Turbo: —, Qwen2.5-Coder (1.5B): —

Reasoning benchmarks
BenchmarkQwen TurboQwen2.5-Coder (1.5B)
Epoch Capabilities Index—113.14
HellaSwag—76.8%
WinoGrande—72.9%

Math Not comparable

Qwen Turbo: 15.3 (#297), Qwen2.5-Coder (1.5B): —

Math benchmarks
BenchmarkQwen TurboQwen2.5-Coder (1.5B)
OTIS Mock AIME 2024-20256.1%—
MATH Level 556.2%—
GSM8K—86.7%

Knowledge Not comparable

Qwen Turbo: 22.2 (#272), Qwen2.5-Coder (1.5B): —

Knowledge benchmarks
BenchmarkQwen TurboQwen2.5-Coder (1.5B)
GPQA Diamond41.8%—
ARC (AI2) Challenge—60.9%
MMLU—68%

Frequently asked questions

Is Qwen Turbo better than Qwen2.5-Coder (1.5B)?

Qwen Turbo has enough public results to be ranked (#335); Qwen2.5-Coder (1.5B) does not yet, so treat this comparison as directional.

How many benchmarks do Qwen Turbo and Qwen2.5-Coder (1.5B) share?

0 benchmarks have published results for both models. Qwen Turbo has 3 scored results on Noometry and Qwen2.5-Coder (1.5B) has 6.

Related comparisons

Go deeper