Model comparison

Qwen2-72B vs Step 3.7 Flash

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 30.0 on the Noometry Index.

Last verified . 0 shared benchmarks.

Qwen2-72B Alibaba (Qwen)

30.0

Rank #300 Confirmed

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • The widest gap is in math, where Step 3.7 Flash leads 42.9 to 30.2.

Side by side

Qwen2-72B and Step 3.7 Flash specifications
Qwen2-72BStep 3.7 Flash
ProviderAlibaba (Qwen)StepFun
Noometry Index30.037.3
Released2024-06-072026-05-29
WeightsOpenOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.18
Output $ / M tokens—$1.11
Results tracked265

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.7 Flash leads

Qwen2-72B: 29.1 (#310), Step 3.7 Flash: 40.0 (#150)

Coding benchmarks
BenchmarkQwen2-72BStep 3.7 Flash
SciCode—40%
WeirdML11.3%—
BigCodeBench Instruct38.5%—
LMArena Coding1196—
BigCodeBench Complete54%—
ALE-Bench—694.12

Agentic & Tool Use Not comparable

Qwen2-72B: 17.0 (#146), Step 3.7 Flash: —

Agentic & Tool Use benchmarks
BenchmarkQwen2-72BStep 3.7 Flash
TheAgentCompany1.1%—
METR Time Horizons29.9%—

Reasoning Qwen2-72B leads

Qwen2-72B: 23.2 (#181), Step 3.7 Flash: 21.6 (#219)

Reasoning benchmarks
BenchmarkQwen2-72BStep 3.7 Flash
NYT Connections (extended)—39.7%
CritPt—2.3%
LMArena Hard Prompts1191—
Epoch Capabilities Index125.28—

Math Step 3.7 Flash leads

Qwen2-72B: 30.2 (#236), Step 3.7 Flash: 42.9 (#82)

Math benchmarks
BenchmarkQwen2-72BStep 3.7 Flash
MathArena Final-Answer Competitions—68.5%
LMArena Math1235—
MATH Level 539.1%—

Knowledge Not comparable

Qwen2-72B: 21.2 (#275), Step 3.7 Flash: —

Knowledge benchmarks
BenchmarkQwen2-72BStep 3.7 Flash
GPQA Diamond40.8%—
LMArena Expert1171—
MMLU82.4%—

Multilingual Not comparable

Qwen2-72B: 35.9 (#244), Step 3.7 Flash: —

Multilingual benchmarks
BenchmarkQwen2-72BStep 3.7 Flash
LMArena Non-English1176—
LMArena Chinese1240—
LMArena French1170—
LMArena German1151—
LMArena Japanese1111—
LMArena Korean1083—
LMArena Russian1169—
LMArena Spanish1169—

Instruction Following Not comparable

Qwen2-72B: 61.7 (#241), Step 3.7 Flash: —

Instruction Following benchmarks
BenchmarkQwen2-72BStep 3.7 Flash
LMArena Instruction Following1181—

Long Context Not comparable

Qwen2-72B: 36.1 (#235), Step 3.7 Flash: —

Long Context benchmarks
BenchmarkQwen2-72BStep 3.7 Flash
LMArena Longer Query1192—

Writing & Preference Not comparable

Qwen2-72B: 40.8 (#241), Step 3.7 Flash: —

Writing & Preference benchmarks
BenchmarkQwen2-72BStep 3.7 Flash
LMArena Text1203—
LMArena Creative Writing1181—
LMArena Multi-Turn1196—

Frequently asked questions

Is Qwen2-72B better than Step 3.7 Flash?

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 30.0 on the Noometry Index.

Is Qwen2-72B or Step 3.7 Flash better for coding?

Step 3.7 Flash scores higher on coding benchmarks: 40.0 versus 29.1 in the Noometry coding category.

How many benchmarks do Qwen2-72B and Step 3.7 Flash share?

0 benchmarks have published results for both models. Qwen2-72B has 26 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper