Model comparison

Qwen1.5-7B vs Step 3.7 Flash

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 31.4 on the Noometry Index.

Last verified . 0 shared benchmarks.

Qwen1.5-7B Alibaba (Qwen)

31.4

Rank #273 Confirmed

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • The widest gap is in math, where Step 3.7 Flash leads 42.9 to 31.4.

Side by side

Qwen1.5-7B and Step 3.7 Flash specifications
Qwen1.5-7BStep 3.7 Flash
ProviderAlibaba (Qwen)StepFun
Noometry Index31.437.3
Released2024-02-042026-05-29
WeightsOpenOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.18
Output $ / M tokens—$1.11
Results tracked135

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.7 Flash leads

Qwen1.5-7B: 32.2 (#276), Step 3.7 Flash: 40.0 (#150)

Coding benchmarks
BenchmarkQwen1.5-7BStep 3.7 Flash
SciCode—40%
LMArena Coding1107—
ALE-Bench—694.12

Reasoning Step 3.7 Flash leads

Qwen1.5-7B: 20.4 (#240), Step 3.7 Flash: 21.6 (#219)

Reasoning benchmarks
BenchmarkQwen1.5-7BStep 3.7 Flash
NYT Connections (extended)—39.7%
CritPt—2.3%
LMArena Hard Prompts1065—

Math Step 3.7 Flash leads

Qwen1.5-7B: 31.4 (#224), Step 3.7 Flash: 42.9 (#82)

Math benchmarks
BenchmarkQwen1.5-7BStep 3.7 Flash
MathArena Final-Answer Competitions—68.5%
LMArena Math1080—

Knowledge Not comparable

Qwen1.5-7B: 28.7 (#243), Step 3.7 Flash: —

Knowledge benchmarks
BenchmarkQwen1.5-7BStep 3.7 Flash
LMArena Expert1055—
MMLU62.6%—

Multilingual Not comparable

Qwen1.5-7B: 28.5 (#271), Step 3.7 Flash: —

Multilingual benchmarks
BenchmarkQwen1.5-7BStep 3.7 Flash
LMArena Non-English1058—
LMArena Chinese1141—
LMArena Russian1006—

Instruction Following Not comparable

Qwen1.5-7B: 54.1 (#281), Step 3.7 Flash: —

Instruction Following benchmarks
BenchmarkQwen1.5-7BStep 3.7 Flash
LMArena Instruction Following1058—

Long Context Not comparable

Qwen1.5-7B: 33.1 (#266), Step 3.7 Flash: —

Long Context benchmarks
BenchmarkQwen1.5-7BStep 3.7 Flash
LMArena Longer Query1090—

Writing & Preference Not comparable

Qwen1.5-7B: 29.6 (#293), Step 3.7 Flash: —

Writing & Preference benchmarks
BenchmarkQwen1.5-7BStep 3.7 Flash
LMArena Text1083—
LMArena Creative Writing1035—
LMArena Multi-Turn1062—

Frequently asked questions

Is Qwen1.5-7B better than Step 3.7 Flash?

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 31.4 on the Noometry Index.

Is Qwen1.5-7B or Step 3.7 Flash better for coding?

Step 3.7 Flash scores higher on coding benchmarks: 40.0 versus 32.2 in the Noometry coding category.

How many benchmarks do Qwen1.5-7B and Step 3.7 Flash share?

0 benchmarks have published results for both models. Qwen1.5-7B has 13 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper