Noometry

Model comparison

Claude 2.1 vs Step 3.7 Flash

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 25.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 2.1 Anthropic

25.2

Rank #345 Reported

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • The widest gap is in math, where Step 3.7 Flash leads 42.9 to 10.2.
  • Step 3.7 Flash has downloadable open weights; the other is API-only.

Side by side

Claude 2.1Step 3.7 Flash
ProviderAnthropicStepFun
Noometry Index25.237.3
Released2023-11-212026-05-29
WeightsProprietaryOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.18
Output $ / M tokens—$1.11
Results tracked75

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.7 Flash leads

Claude 2.1: 26.2 (#327), Step 3.7 Flash: 40.0 (#150)

BenchmarkClaude 2.1Step 3.7 Flash
SciCode—40%
WeirdML7.1%—
ALE-Bench—694.12

Reasoning Too close to call

Claude 2.1: 21.4 (#221), Step 3.7 Flash: 21.6 (#219)

BenchmarkClaude 2.1Step 3.7 Flash
NYT Connections (extended)—39.7%
CritPt—2.3%
DTBench51%—
Epoch Capabilities Index119.27—
ForecastBench54.2—

Math Step 3.7 Flash leads

Claude 2.1: 10.2 (#315), Step 3.7 Flash: 42.9 (#82)

BenchmarkClaude 2.1Step 3.7 Flash
MathArena Final-Answer Competitions—68.5%
OTIS Mock AIME 2024-20251.9%—

Knowledge Not comparable

Claude 2.1: 15.4 (#292), Step 3.7 Flash: —

BenchmarkClaude 2.1Step 3.7 Flash
GPQA Diamond33%—
MMLU73.5%—

Frequently asked questions

Is Claude 2.1 better than Step 3.7 Flash?

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 25.2 on the Noometry Index.

Is Claude 2.1 or Step 3.7 Flash better for coding?

Step 3.7 Flash scores higher on coding benchmarks: 40.0 versus 26.2 in the Noometry coding category.

How many benchmarks do Claude 2.1 and Step 3.7 Flash share?

0 benchmarks have published results for both models. Claude 2.1 has 7 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper