Model comparison

Qwen-14B vs Step 3.7 Flash

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 31.4 on the Noometry Index.

Last verified . 0 shared benchmarks.

Qwen-14B Alibaba (Qwen)

31.4

Rank #275 Confirmed

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • The widest gap is in math, where Step 3.7 Flash leads 42.9 to 31.2.

Side by side

Qwen-14B and Step 3.7 Flash specifications
Qwen-14BStep 3.7 Flash
ProviderAlibaba (Qwen)StepFun
Noometry Index31.437.3
Released2023-09-242026-05-29
WeightsOpenOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.18
Output $ / M tokens—$1.11
Results tracked185

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.7 Flash leads

Qwen-14B: 31.2 (#288), Step 3.7 Flash: 40.0 (#150)

Coding benchmarks
BenchmarkQwen-14BStep 3.7 Flash
SciCode—40%
LMArena Coding1071—
ALE-Bench—694.12

Reasoning Step 3.7 Flash leads

Qwen-14B: 19.6 (#257), Step 3.7 Flash: 21.6 (#219)

Reasoning benchmarks
BenchmarkQwen-14BStep 3.7 Flash
NYT Connections (extended)—39.7%
CritPt—2.3%
LMArena Hard Prompts1027—
BIG-Bench Hard55%—
Epoch Capabilities Index113.03—
LAMBADA71.1%—
PIQA79.9%—

Math Step 3.7 Flash leads

Qwen-14B: 31.2 (#227), Step 3.7 Flash: 42.9 (#82)

Math benchmarks
BenchmarkQwen-14BStep 3.7 Flash
MathArena Final-Answer Competitions—68.5%
LMArena Math1068—
GSM8K61.3%—

Knowledge Not comparable

Qwen-14B: —, Step 3.7 Flash: —

Knowledge benchmarks
BenchmarkQwen-14BStep 3.7 Flash
ARC (AI2) Challenge84.4%—
BoolQ86.2%—
MMLU66.3%—

Multilingual Not comparable

Qwen-14B: 27.5 (#275), Step 3.7 Flash: —

Multilingual benchmarks
BenchmarkQwen-14BStep 3.7 Flash
LMArena Non-English1041—
LMArena Chinese1077—

Instruction Following Not comparable

Qwen-14B: 52.4 (#289), Step 3.7 Flash: —

Instruction Following benchmarks
BenchmarkQwen-14BStep 3.7 Flash
LMArena Instruction Following1031—

Long Context Not comparable

Qwen-14B: 31.3 (#280), Step 3.7 Flash: —

Long Context benchmarks
BenchmarkQwen-14BStep 3.7 Flash
LMArena Longer Query1028—

Writing & Preference Not comparable

Qwen-14B: 27.6 (#299), Step 3.7 Flash: —

Writing & Preference benchmarks
BenchmarkQwen-14BStep 3.7 Flash
LMArena Text1051—
LMArena Creative Writing1028—
LMArena Multi-Turn1022—

Frequently asked questions

Is Qwen-14B better than Step 3.7 Flash?

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 31.4 on the Noometry Index.

Is Qwen-14B or Step 3.7 Flash better for coding?

Step 3.7 Flash scores higher on coding benchmarks: 40.0 versus 31.2 in the Noometry coding category.

How many benchmarks do Qwen-14B and Step 3.7 Flash share?

0 benchmarks have published results for both models. Qwen-14B has 18 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper