Model comparison

Qwen2.5-Coder (1.5B) vs Step 1o Turbo 202506

Step 1o Turbo 202506 has enough public results to be ranked (#160); Qwen2.5-Coder (1.5B) does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Summary

  • Qwen2.5-Coder (1.5B) has downloadable open weights; the other is API-only.

Side by side

Qwen2.5-Coder (1.5B) and Step 1o Turbo 202506 specifications
Qwen2.5-Coder (1.5B)Step 1o Turbo 202506
ProviderAlibaba (Qwen)StepFun
Noometry Index—39.7
Released2024-09-18—
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked614

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Qwen2.5-Coder (1.5B): —, Step 1o Turbo 202506: 39.2 (#160)

Coding benchmarks
BenchmarkQwen2.5-Coder (1.5B)Step 1o Turbo 202506
LMArena Coding—1339

Reasoning Not comparable

Qwen2.5-Coder (1.5B): —, Step 1o Turbo 202506: 26.8 (#129)

Reasoning benchmarks
BenchmarkQwen2.5-Coder (1.5B)Step 1o Turbo 202506
LMArena Hard Prompts—1335
Epoch Capabilities Index113.14—
HellaSwag76.8%—
WinoGrande72.9%—

Math Not comparable

Qwen2.5-Coder (1.5B): —, Step 1o Turbo 202506: 36.6 (#164)

Math benchmarks
BenchmarkQwen2.5-Coder (1.5B)Step 1o Turbo 202506
LMArena Math—1318
GSM8K86.7%—

Knowledge Not comparable

Qwen2.5-Coder (1.5B): —, Step 1o Turbo 202506: 36.1 (#176)

Knowledge benchmarks
BenchmarkQwen2.5-Coder (1.5B)Step 1o Turbo 202506
LMArena Expert—1308
ARC (AI2) Challenge60.9%—
MMLU68%—

Multimodal Not comparable

Qwen2.5-Coder (1.5B): —, Step 1o Turbo 202506: 36.1 (#80)

Multimodal benchmarks
BenchmarkQwen2.5-Coder (1.5B)Step 1o Turbo 202506
LMArena Vision—1186

Multilingual Not comparable

Qwen2.5-Coder (1.5B): —, Step 1o Turbo 202506: 45.3 (#173)

Multilingual benchmarks
BenchmarkQwen2.5-Coder (1.5B)Step 1o Turbo 202506
LMArena Non-English—1313
LMArena Chinese—1380
LMArena German—1314
LMArena Russian—1327

Instruction Following Not comparable

Qwen2.5-Coder (1.5B): —, Step 1o Turbo 202506: 69.2 (#176)

Instruction Following benchmarks
BenchmarkQwen2.5-Coder (1.5B)Step 1o Turbo 202506
LMArena Instruction Following—1310

Long Context Not comparable

Qwen2.5-Coder (1.5B): —, Step 1o Turbo 202506: 41.0 (#146)

Long Context benchmarks
BenchmarkQwen2.5-Coder (1.5B)Step 1o Turbo 202506
LMArena Longer Query—1348

Writing & Preference Not comparable

Qwen2.5-Coder (1.5B): —, Step 1o Turbo 202506: 53.1 (#160)

Writing & Preference benchmarks
BenchmarkQwen2.5-Coder (1.5B)Step 1o Turbo 202506
LMArena Text—1336
LMArena Creative Writing—1307
LMArena Multi-Turn—1340

Frequently asked questions

Is Qwen2.5-Coder (1.5B) better than Step 1o Turbo 202506?

Step 1o Turbo 202506 has enough public results to be ranked (#160); Qwen2.5-Coder (1.5B) does not yet, so treat this comparison as directional.

How many benchmarks do Qwen2.5-Coder (1.5B) and Step 1o Turbo 202506 share?

0 benchmarks have published results for both models. Qwen2.5-Coder (1.5B) has 6 scored results on Noometry and Step 1o Turbo 202506 has 14.

Related comparisons

Go deeper