Model comparison

StarCoder 2 7B vs Step 3.7 Flash

Step 3.7 Flash has enough public results to be ranked (#207); StarCoder 2 7B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

StarCoder 2 7B NVIDIA

37.0

Unranked Sparse

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • The widest gap is in coding, where Step 3.7 Flash leads 40.0 to 34.8.

Side by side

StarCoder 2 7B and Step 3.7 Flash specifications
StarCoder 2 7BStep 3.7 Flash
ProviderNVIDIAStepFun
Noometry Index37.037.3
Released2024-02-202026-05-29
WeightsOpenOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.18
Output $ / M tokens—$1.11
Results tracked75

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.7 Flash leads

StarCoder 2 7B: 34.8, Step 3.7 Flash: 40.0 (#150)

Coding benchmarks
BenchmarkStarCoder 2 7BStep 3.7 Flash
SciCode—40%
BigCodeBench Complete27.7%—
ALE-Bench—694.12
HumanEval+29.9%—

Reasoning Not comparable

StarCoder 2 7B: —, Step 3.7 Flash: 21.6 (#219)

Reasoning benchmarks
BenchmarkStarCoder 2 7BStep 3.7 Flash
NYT Connections (extended)—39.7%
CritPt—2.3%
Epoch Capabilities Index93.56—
WinoGrande57.1%—

Math Not comparable

StarCoder 2 7B: —, Step 3.7 Flash: 42.9 (#82)

Math benchmarks
BenchmarkStarCoder 2 7BStep 3.7 Flash
MathArena Final-Answer Competitions—68.5%
GSM8K32.7%—

Knowledge Not comparable

StarCoder 2 7B: —, Step 3.7 Flash: —

Knowledge benchmarks
BenchmarkStarCoder 2 7BStep 3.7 Flash
ARC (AI2) Challenge38.7%—
MMLU38.8%—

Frequently asked questions

Is StarCoder 2 7B better than Step 3.7 Flash?

Step 3.7 Flash has enough public results to be ranked (#207); StarCoder 2 7B does not yet, so treat this comparison as directional.

Is StarCoder 2 7B or Step 3.7 Flash better for coding?

Step 3.7 Flash scores higher on coding benchmarks: 40.0 versus 34.8 in the Noometry coding category.

How many benchmarks do StarCoder 2 7B and Step 3.7 Flash share?

0 benchmarks have published results for both models. StarCoder 2 7B has 7 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper