Model comparison

Qwen2.5-Coder-32B vs Step 5 Preview

Step 5 Preview is the stronger model overall, scoring 43.8 to 32.9 on the Noometry Index. Qwen2.5-Coder-32B costs 1.9× less per token, which makes it the better buy when Step 5 Preview's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

Qwen2.5-Coder-32B Alibaba (Qwen)

32.9

Rank #239 Confirmed

Step 5 Preview StepFun

43.8

Rank #78 Reported

Summary

  • The widest gap is in coding, where Step 5 Preview leads 50.6 to 22.4.
  • Qwen2.5-Coder-32B is cheaper at $0.66 / $1 per million input/output tokens, against $1 / $2.70 for Step 5 Preview.
  • Step 5 Preview accepts more context: 1.02M tokens versus 33K.
  • Qwen2.5-Coder-32B has downloadable open weights; the other is API-only.

Side by side

Qwen2.5-Coder-32B and Step 5 Preview specifications
Qwen2.5-Coder-32BStep 5 Preview
ProviderAlibaba (Qwen)StepFun
Noometry Index32.943.8
Released2024-09-182026-09-16
WeightsOpenProprietary
Context window33K1.02M
Max output29K66K
Input $ / M tokens$0.66$1
Output $ / M tokens$1$2.70
Results tracked313

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 5 Preview leads

Qwen2.5-Coder-32B: 22.4 (#328), Step 5 Preview: 50.6 (#40)

Coding benchmarks
BenchmarkQwen2.5-Coder-32BStep 5 Preview
SWE-bench Verified (bash only)9%—
Aider Polyglot16.4%—
LMArena WebDev—1569
SciCode—58.9%
BigCodeBench Instruct49%—
LiveBench Coding56.9%—
LMArena Coding1276—
BigCodeBench Complete58%—
HumanEval+87.2%—
MBPP+77%—

Reasoning Step 5 Preview leads

Qwen2.5-Coder-32B: 20.4 (#220), Step 5 Preview: 38.0 (#58)

Reasoning benchmarks
BenchmarkQwen2.5-Coder-32BStep 5 Preview
CritPt—20.9%
LiveBench Reasoning42.1%—
LMArena Hard Prompts1251—
LiveBench Data Analysis49.9%—
Epoch Capabilities Index119.41—
HellaSwag83%—
LiveBench46.2%—
WinoGrande80.8%—

Math Not comparable

Qwen2.5-Coder-32B: 30.8 (#203), Step 5 Preview: —

Math benchmarks
BenchmarkQwen2.5-Coder-32BStep 5 Preview
LiveBench Math46.6%—
LMArena Math1251—
GSM8K93%—

Knowledge Not comparable

Qwen2.5-Coder-32B: 32.9 (#200), Step 5 Preview: —

Knowledge benchmarks
BenchmarkQwen2.5-Coder-32BStep 5 Preview
LMArena Expert1221—
ARC (AI2) Challenge70.5%—
MMLU79.1%—

Multilingual Not comparable

Qwen2.5-Coder-32B: 38.0 (#230), Step 5 Preview: —

Multilingual benchmarks
BenchmarkQwen2.5-Coder-32BStep 5 Preview
LMArena Non-English1205—
LMArena Chinese1222—
LMArena Russian1228—

Instruction Following Not comparable

Qwen2.5-Coder-32B: 61.6 (#240), Step 5 Preview: —

Instruction Following benchmarks
BenchmarkQwen2.5-Coder-32BStep 5 Preview
LiveBench Instruction Following58.7%—
LMArena Instruction Following1223—

Long Context Not comparable

Qwen2.5-Coder-32B: 37.9 (#204), Step 5 Preview: —

Long Context benchmarks
BenchmarkQwen2.5-Coder-32BStep 5 Preview
LMArena Longer Query1251—

Writing & Preference Not comparable

Qwen2.5-Coder-32B: 41.8 (#235), Step 5 Preview: —

Writing & Preference benchmarks
BenchmarkQwen2.5-Coder-32BStep 5 Preview
LMArena Text1230—
LMArena Creative Writing1174—
LMArena Multi-Turn1222—
LiveBench Language23.3%—

Frequently asked questions

Is Qwen2.5-Coder-32B better than Step 5 Preview?

Step 5 Preview is the stronger model overall, scoring 43.8 to 32.9 on the Noometry Index. Qwen2.5-Coder-32B costs 1.9× less per token, which makes it the better buy when Step 5 Preview's lead doesn't matter for your workload.

Which is cheaper, Qwen2.5-Coder-32B or Step 5 Preview?

Qwen2.5-Coder-32B is cheaper. It lists at $0.66 per million input tokens and $1 per million output tokens; Step 5 Preview lists at $1 and $2.70.

Is Qwen2.5-Coder-32B or Step 5 Preview better for coding?

Step 5 Preview scores higher on coding benchmarks: 50.6 versus 22.4 in the Noometry coding category.

Which has the bigger context window?

Step 5 Preview does, with 1.02M tokens against 33K.

How many benchmarks do Qwen2.5-Coder-32B and Step 5 Preview share?

0 benchmarks have published results for both models. Qwen2.5-Coder-32B has 31 scored results on Noometry and Step 5 Preview has 3.

Related comparisons

Go deeper