Model comparison

Qwen2.5-Coder-32B vs Step 3.7 Flash

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 33.4 on the Noometry Index.

Last verified . 0 shared benchmarks.

Qwen2.5-Coder-32B Alibaba (Qwen)

33.4

Rank #245 Confirmed

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • The widest gap is in coding, where Step 3.7 Flash leads 40.0 to 22.6.
  • Step 3.7 Flash is cheaper at $0.18 / $1.11 per million input/output tokens, against $0.66 / $1 for Qwen2.5-Coder-32B.
  • Step 3.7 Flash accepts more context: 256K tokens versus 33K.

Side by side

Qwen2.5-Coder-32B and Step 3.7 Flash specifications
Qwen2.5-Coder-32BStep 3.7 Flash
ProviderAlibaba (Qwen)StepFun
Noometry Index33.437.3
Released2024-09-182026-05-29
WeightsOpenOpen
Context window33K256K
Max output29K256K
Input $ / M tokens$0.66$0.18
Output $ / M tokens$1$1.11
Results tracked315

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.7 Flash leads

Qwen2.5-Coder-32B: 22.6 (#333), Step 3.7 Flash: 40.0 (#150)

Coding benchmarks
BenchmarkQwen2.5-Coder-32BStep 3.7 Flash
SWE-bench Verified (bash only)9%—
Aider Polyglot16.4%—
SciCode—40%
BigCodeBench Instruct49%—
LiveBench Coding56.9%—
LMArena Coding1276—
BigCodeBench Complete58%—
ALE-Bench—694.12
HumanEval+87.2%—
MBPP+77%—

Reasoning Too close to call

Qwen2.5-Coder-32B: 21.2 (#225), Step 3.7 Flash: 21.6 (#219)

Reasoning benchmarks
BenchmarkQwen2.5-Coder-32BStep 3.7 Flash
NYT Connections (extended)—39.7%
CritPt—2.3%
LiveBench Reasoning42.1%—
LMArena Hard Prompts1251—
LiveBench Data Analysis49.9%—
Epoch Capabilities Index119.49—
HellaSwag83%—
LiveBench46.2%—
WinoGrande80.8%—

Math Step 3.7 Flash leads

Qwen2.5-Coder-32B: 33.3 (#204), Step 3.7 Flash: 42.9 (#82)

Math benchmarks
BenchmarkQwen2.5-Coder-32BStep 3.7 Flash
MathArena Final-Answer Competitions—68.5%
LiveBench Math46.6%—
LMArena Math1251—
GSM8K93%—

Knowledge Not comparable

Qwen2.5-Coder-32B: 33.4 (#203), Step 3.7 Flash: —

Knowledge benchmarks
BenchmarkQwen2.5-Coder-32BStep 3.7 Flash
LMArena Expert1221—
ARC (AI2) Challenge70.5%—
MMLU79.1%—

Multilingual Not comparable

Qwen2.5-Coder-32B: 37.8 (#235), Step 3.7 Flash: —

Multilingual benchmarks
BenchmarkQwen2.5-Coder-32BStep 3.7 Flash
LMArena Non-English1205—
LMArena Chinese1222—
LMArena Russian1228—

Instruction Following Not comparable

Qwen2.5-Coder-32B: 61.4 (#245), Step 3.7 Flash: —

Instruction Following benchmarks
BenchmarkQwen2.5-Coder-32BStep 3.7 Flash
LiveBench Instruction Following58.7%—
LMArena Instruction Following1223—

Long Context Not comparable

Qwen2.5-Coder-32B: 38.0 (#208), Step 3.7 Flash: —

Long Context benchmarks
BenchmarkQwen2.5-Coder-32BStep 3.7 Flash
LMArena Longer Query1251—

Writing & Preference Not comparable

Qwen2.5-Coder-32B: 41.6 (#240), Step 3.7 Flash: —

Writing & Preference benchmarks
BenchmarkQwen2.5-Coder-32BStep 3.7 Flash
LMArena Text1230—
LMArena Creative Writing1174—
LMArena Multi-Turn1222—
LiveBench Language23.3%—

Frequently asked questions

Is Qwen2.5-Coder-32B better than Step 3.7 Flash?

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 33.4 on the Noometry Index.

Which is cheaper, Qwen2.5-Coder-32B or Step 3.7 Flash?

Step 3.7 Flash is cheaper. It lists at $0.18 per million input tokens and $1.11 per million output tokens; Qwen2.5-Coder-32B lists at $0.66 and $1.

Is Qwen2.5-Coder-32B or Step 3.7 Flash better for coding?

Step 3.7 Flash scores higher on coding benchmarks: 40.0 versus 22.6 in the Noometry coding category.

Which has the bigger context window?

Step 3.7 Flash does, with 256K tokens against 33K.

How many benchmarks do Qwen2.5-Coder-32B and Step 3.7 Flash share?

0 benchmarks have published results for both models. Qwen2.5-Coder-32B has 31 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper