Model comparison

Qwen2.5 72B Instruct vs Step 5 Preview

Step 5 Preview is the stronger model overall, scoring 47.9 to 31.9 on the Noometry Index.

Last verified . 13 shared benchmarks.

Qwen2.5 72B Instruct Alibaba (Qwen)

31.9

Rank #267 Confirmed

Step 5 Preview StepFun

47.9

Rank #58 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Qwen2.5 72B Instruct scores higher in 0 categories and Step 5 Preview in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Step 5 Preview leads 46.1 to 19.3.
  • Step 5 Preview is cheaper at $1 / $2.70 per million input/output tokens, against $1.40 / $5.60 for Qwen2.5 72B Instruct.
  • Step 5 Preview accepts more context: 1.02M tokens versus 131K.
  • Qwen2.5 72B Instruct has downloadable open weights; the other is API-only.

Side by side

Qwen2.5 72B Instruct and Step 5 Preview specifications
Qwen2.5 72B InstructStep 5 Preview
ProviderAlibaba (Qwen)StepFun
Noometry Index31.947.9
Released2024-092026-09-16
WeightsOpenProprietary
Context window131K1.02M
Max output8K66K
Input $ / M tokens$1.40$1
Output $ / M tokens$5.60$2.70
Results tracked4318

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 5 Preview leads

Qwen2.5 72B Instruct: 33.2 (#260), Step 5 Preview: 51.8 (#36)

Coding benchmarks
BenchmarkQwen2.5 72B InstructStep 5 Preview
LMArena Coding12921480
LMArena WebDev—1564
SciCode—58.9%
WeirdML16%—
BigCodeBench Instruct45.8%—
BigCodeBench Complete55.9%—

Agentic & Tool Use Not comparable

Qwen2.5 72B Instruct: 22.1 (#133), Step 5 Preview: —

Agentic & Tool Use benchmarks
BenchmarkQwen2.5 72B InstructStep 5 Preview
TheAgentCompany5.7%—
BALROG16.2%—
METR Time Horizons35.8%—

Reasoning Step 5 Preview leads

Qwen2.5 72B Instruct: 22.3 (#199), Step 5 Preview: 40.0 (#57)

Reasoning benchmarks
BenchmarkQwen2.5 72B InstructStep 5 Preview
LMArena Hard Prompts12711465
CritPt—20.9%
DTBench62.9%—
LMCA13.4%—
BIG-Bench Hard79.8%—
Epoch Capabilities Index129—
ForecastBench57.5—
HellaSwag84.8%—
PIQA82.6%—
WinoGrande82.3%—

Math Step 5 Preview leads

Qwen2.5 72B Instruct: 19.3 (#287), Step 5 Preview: 46.1 (#72)

Math benchmarks
BenchmarkQwen2.5 72B InstructStep 5 Preview
LMArena Math12831470
OTIS Mock AIME 2024-20258.1%—
ProofBench—42%
Omni-MATH33%—
MATH Level 563.2%—

Knowledge Step 5 Preview leads

Qwen2.5 72B Instruct: 27.0 (#253), Step 5 Preview: 41.2 (#112)

Knowledge benchmarks
BenchmarkQwen2.5 72B InstructStep 5 Preview
LMArena Expert12451470
GPQA Diamond49.1%—
MMLU-Pro63.1%—
Confabulations19.1%—
GPQA (HELM)42.6%—
ARC (AI2) Challenge94.5%—
MMLU85.3%—
TriviaQA71.9%—

Multimodal Not comparable

Qwen2.5 72B Instruct: —, Step 5 Preview: 41.0 (#41)

Multimodal benchmarks
BenchmarkQwen2.5 72B InstructStep 5 Preview
LMArena Vision—1267

Multilingual Step 5 Preview leads

Qwen2.5 72B Instruct: 41.0 (#213), Step 5 Preview: 53.8 (#54)

Multilingual benchmarks
BenchmarkQwen2.5 72B InstructStep 5 Preview
LMArena Non-English12521432
LMArena Chinese12721519
LMArena Russian12641436
LMArena Spanish12561439
LMArena French1280—
LMArena German1234—
LMArena Japanese1180—
LMArena Korean1188—

Instruction Following Step 5 Preview leads

Qwen2.5 72B Instruct: 65.5 (#221), Step 5 Preview: 76.0 (#50)

Instruction Following benchmarks
BenchmarkQwen2.5 72B InstructStep 5 Preview
LMArena Instruction Following12541444
IFEval80.6%—

Long Context Step 5 Preview leads

Qwen2.5 72B Instruct: 38.9 (#188), Step 5 Preview: 44.5 (#64)

Long Context benchmarks
BenchmarkQwen2.5 72B InstructStep 5 Preview
LMArena Longer Query12821455

Writing & Preference Step 5 Preview leads

Qwen2.5 72B Instruct: 46.7 (#215), Step 5 Preview: 62.8 (#71)

Writing & Preference benchmarks
BenchmarkQwen2.5 72B InstructStep 5 Preview
LMArena Text12691442
LMArena Creative Writing12211410
LMArena Multi-Turn12721447
WildBench80.2%—

Frequently asked questions

Is Qwen2.5 72B Instruct better than Step 5 Preview?

Step 5 Preview is the stronger model overall, scoring 47.9 to 31.9 on the Noometry Index.

Which is cheaper, Qwen2.5 72B Instruct or Step 5 Preview?

Step 5 Preview is cheaper. It lists at $1 per million input tokens and $2.70 per million output tokens; Qwen2.5 72B Instruct lists at $1.40 and $5.60.

Is Qwen2.5 72B Instruct or Step 5 Preview better for coding?

Step 5 Preview scores higher on coding benchmarks: 51.8 versus 33.2 in the Noometry coding category.

Which has the bigger context window?

Step 5 Preview does, with 1.02M tokens against 131K.

How many benchmarks do Qwen2.5 72B Instruct and Step 5 Preview share?

13 benchmarks have published results for both models. Qwen2.5 72B Instruct has 43 scored results on Noometry and Step 5 Preview has 18.

Related comparisons

Go deeper