Model comparison

Qwen1.5-14B vs Step 3.7 Flash

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 32.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Qwen1.5-14B Alibaba (Qwen)

32.7

Rank #253 Confirmed

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • The widest gap is in math, where Step 3.7 Flash leads 42.9 to 32.4.

Side by side

Qwen1.5-14B and Step 3.7 Flash specifications
Qwen1.5-14BStep 3.7 Flash
ProviderAlibaba (Qwen)StepFun
Noometry Index32.737.3
Released2024-02-042026-05-29
WeightsOpenOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.18
Output $ / M tokens—$1.11
Results tracked175

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.7 Flash leads

Qwen1.5-14B: 33.1 (#263), Step 3.7 Flash: 40.0 (#150)

Coding benchmarks
BenchmarkQwen1.5-14BStep 3.7 Flash
SciCode—40%
LMArena Coding1138—
ALE-Bench—694.12

Reasoning Too close to call

Qwen1.5-14B: 21.4 (#223), Step 3.7 Flash: 21.6 (#219)

Reasoning benchmarks
BenchmarkQwen1.5-14BStep 3.7 Flash
NYT Connections (extended)—39.7%
CritPt—2.3%
LMArena Hard Prompts1113—

Math Step 3.7 Flash leads

Qwen1.5-14B: 32.4 (#215), Step 3.7 Flash: 42.9 (#82)

Math benchmarks
BenchmarkQwen1.5-14BStep 3.7 Flash
MathArena Final-Answer Competitions—68.5%
LMArena Math1125—

Knowledge Not comparable

Qwen1.5-14B: 29.8 (#232), Step 3.7 Flash: —

Knowledge benchmarks
BenchmarkQwen1.5-14BStep 3.7 Flash
LMArena Expert1094—
MMLU68.6%—

Multilingual Not comparable

Qwen1.5-14B: 30.7 (#262), Step 3.7 Flash: —

Multilingual benchmarks
BenchmarkQwen1.5-14BStep 3.7 Flash
LMArena Non-English1095—
LMArena Chinese1147—
LMArena French1116—
LMArena German1043—
LMArena Japanese1019—
LMArena Russian1046—
LMArena Spanish1085—

Instruction Following Not comparable

Qwen1.5-14B: 56.8 (#271), Step 3.7 Flash: —

Instruction Following benchmarks
BenchmarkQwen1.5-14BStep 3.7 Flash
LMArena Instruction Following1102—

Long Context Not comparable

Qwen1.5-14B: 33.7 (#257), Step 3.7 Flash: —

Long Context benchmarks
BenchmarkQwen1.5-14BStep 3.7 Flash
LMArena Longer Query1113—

Writing & Preference Not comparable

Qwen1.5-14B: 33.6 (#276), Step 3.7 Flash: —

Writing & Preference benchmarks
BenchmarkQwen1.5-14BStep 3.7 Flash
LMArena Text1128—
LMArena Creative Writing1091—
LMArena Multi-Turn1110—

Frequently asked questions

Is Qwen1.5-14B better than Step 3.7 Flash?

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 32.7 on the Noometry Index.

Is Qwen1.5-14B or Step 3.7 Flash better for coding?

Step 3.7 Flash scores higher on coding benchmarks: 40.0 versus 33.1 in the Noometry coding category.

How many benchmarks do Qwen1.5-14B and Step 3.7 Flash share?

0 benchmarks have published results for both models. Qwen1.5-14B has 17 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper