Model comparison

Step 3.7 Flash vs Yi-1.5-34B

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 30.6 on the Noometry Index.

Last verified . 0 shared benchmarks.

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Yi-1.5-34B 01.AI

30.6

Rank #289 Confirmed

Summary

  • The widest gap is in math, where Step 3.7 Flash leads 42.9 to 27.5.

Side by side

Step 3.7 Flash and Yi-1.5-34B specifications
Step 3.7 FlashYi-1.5-34B
ProviderStepFun01.AI
Noometry Index37.330.6
Released2026-05-292024-05-13
WeightsOpenOpen
Context window256K—
Max output256K—
Input $ / M tokens$0.18—
Output $ / M tokens$1.11—
Results tracked521

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.7 Flash leads

Step 3.7 Flash: 40.0 (#150), Yi-1.5-34B: 32.4 (#272)

Coding benchmarks
BenchmarkStep 3.7 FlashYi-1.5-34B
SciCode40%—
BigCodeBench Instruct—33.9%
LMArena Coding—1169
BigCodeBench Complete—43.8%
ALE-Bench694.12—

Reasoning Too close to call

Step 3.7 Flash: 21.6 (#219), Yi-1.5-34B: 22.5 (#191)

Reasoning benchmarks
BenchmarkStep 3.7 FlashYi-1.5-34B
NYT Connections (extended)39.7%—
CritPt2.3%—
LMArena Hard Prompts—1160

Math Step 3.7 Flash leads

Step 3.7 Flash: 42.9 (#82), Yi-1.5-34B: 27.5 (#249)

Math benchmarks
BenchmarkStep 3.7 FlashYi-1.5-34B
MathArena Final-Answer Competitions68.5%—
LMArena Math—1182
MATH Level 5—25.5%

Knowledge Not comparable

Step 3.7 Flash: —, Yi-1.5-34B: 14.8 (#295)

Knowledge benchmarks
BenchmarkStep 3.7 FlashYi-1.5-34B
GPQA Diamond—32%
LMArena Expert—1144

Multilingual Not comparable

Step 3.7 Flash: —, Yi-1.5-34B: 32.3 (#256)

Multilingual benchmarks
BenchmarkStep 3.7 FlashYi-1.5-34B
LMArena Non-English—1121
LMArena Chinese—1213
LMArena French—1156
LMArena German—1111
LMArena Japanese—1021
LMArena Korean—1005
LMArena Russian—1091
LMArena Spanish—1121

Instruction Following Not comparable

Step 3.7 Flash: —, Yi-1.5-34B: 59.2 (#257)

Instruction Following benchmarks
BenchmarkStep 3.7 FlashYi-1.5-34B
LMArena Instruction Following—1139

Long Context Not comparable

Step 3.7 Flash: —, Yi-1.5-34B: 34.6 (#248)

Long Context benchmarks
BenchmarkStep 3.7 FlashYi-1.5-34B
LMArena Longer Query—1143

Writing & Preference Not comparable

Step 3.7 Flash: —, Yi-1.5-34B: 37.4 (#257)

Writing & Preference benchmarks
BenchmarkStep 3.7 FlashYi-1.5-34B
LMArena Text—1173
LMArena Creative Writing—1135
LMArena Multi-Turn—1153

Frequently asked questions

Is Step 3.7 Flash better than Yi-1.5-34B?

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 30.6 on the Noometry Index.

Is Step 3.7 Flash or Yi-1.5-34B better for coding?

Step 3.7 Flash scores higher on coding benchmarks: 40.0 versus 32.4 in the Noometry coding category.

How many benchmarks do Step 3.7 Flash and Yi-1.5-34B share?

0 benchmarks have published results for both models. Step 3.7 Flash has 5 scored results on Noometry and Yi-1.5-34B has 21.

Related comparisons

Go deeper