Model comparison

Qwen2.5-VL 72B Instruct vs Step 3

Step 3 is the stronger model overall, scoring 39.9 to 29.4 on the Noometry Index.

Last verified . 2 shared benchmarks.

Step 3 StepFun

39.9

Rank #145 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Qwen2.5-VL 72B Instruct scores higher in 0 categories and Step 3 in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Step 3 leads 27.6 to 20.0.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 36% for Qwen2.5-VL 72B Instruct and 62.3% for Step 3.

Side by side

Qwen2.5-VL 72B Instruct and Step 3 specifications
Qwen2.5-VL 72B InstructStep 3
ProviderAlibaba (Qwen)StepFun
Noometry Index29.439.9
Released2024-09—
WeightsOpenOpen
Context window131K—
Max output8K—
Input $ / M tokens$2.80—
Output $ / M tokens$8.40—
Results tracked617

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Qwen2.5-VL 72B Instruct: —, Step 3: 39.5 (#144)

Coding benchmarks
BenchmarkQwen2.5-VL 72B InstructStep 3
LMArena Coding—1367

Agentic & Tool Use Not comparable

Qwen2.5-VL 72B Instruct: 18.4 (#136), Step 3: —

Agentic & Tool Use benchmarks
BenchmarkQwen2.5-VL 72B InstructStep 3
OSWorld5%—

Reasoning Step 3 leads

Qwen2.5-VL 72B Instruct: 20.0 (#228), Step 3: 27.6 (#102)

Reasoning benchmarks
BenchmarkQwen2.5-VL 72B InstructStep 3
Kagi LLM Benchmark36%62.3%
LMArena Hard Prompts—1355

Math Not comparable

Qwen2.5-VL 72B Instruct: —, Step 3: 34.9 (#148)

Math benchmarks
BenchmarkQwen2.5-VL 72B InstructStep 3
LMArena Math—1366

Knowledge Not comparable

Qwen2.5-VL 72B Instruct: —, Step 3: 36.2 (#161)

Knowledge benchmarks
BenchmarkQwen2.5-VL 72B InstructStep 3
LMArena Expert—1333

Multimodal Step 3 leads

Qwen2.5-VL 72B Instruct: 32.9 (#92), Step 3: 34.9 (#81)

Multimodal benchmarks
BenchmarkQwen2.5-VL 72B InstructStep 3
LMArena Vision11071176
Video-MME73.5%—
GeoBench62%—
SpatialViz-Bench33.3%—

Multilingual Not comparable

Qwen2.5-VL 72B Instruct: —, Step 3: 46.5 (#154)

Multilingual benchmarks
BenchmarkQwen2.5-VL 72B InstructStep 3
LMArena Non-English—1327
LMArena Chinese—1396
LMArena German—1371
LMArena Korean—1271
LMArena Russian—1331
LMArena Spanish—1372

Instruction Following Not comparable

Qwen2.5-VL 72B Instruct: —, Step 3: 70.6 (#159)

Instruction Following benchmarks
BenchmarkQwen2.5-VL 72B InstructStep 3
LMArena Instruction Following—1332

Long Context Not comparable

Qwen2.5-VL 72B Instruct: —, Step 3: 40.3 (#152)

Long Context benchmarks
BenchmarkQwen2.5-VL 72B InstructStep 3
LMArena Longer Query—1326

Writing & Preference Not comparable

Qwen2.5-VL 72B Instruct: —, Step 3: 54.5 (#146)

Writing & Preference benchmarks
BenchmarkQwen2.5-VL 72B InstructStep 3
LMArena Text—1351
LMArena Creative Writing—1322
LMArena Multi-Turn—1340

Frequently asked questions

Is Qwen2.5-VL 72B Instruct better than Step 3?

Step 3 is the stronger model overall, scoring 39.9 to 29.4 on the Noometry Index.

How many benchmarks do Qwen2.5-VL 72B Instruct and Step 3 share?

2 benchmarks have published results for both models. Qwen2.5-VL 72B Instruct has 6 scored results on Noometry and Step 3 has 17.

Related comparisons

Go deeper