Model comparison

OLMo 2 Furious 13B vs Step 3.7 Flash

Step 3.7 Flash is the stronger model overall, scoring 36.5 to 29.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Step 3.7 Flash StepFun

36.5

Rank #207 Reported

Summary

  • The widest gap is in math, where Step 3.7 Flash leads 40.9 to 21.3.

Side by side

OLMo 2 Furious 13B and Step 3.7 Flash specifications
OLMo 2 Furious 13BStep 3.7 Flash
ProviderAllen Institute for AI (Ai2)StepFun
Noometry Index29.236.5
Released2024-12-312026-05-29
WeightsOpenOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.18
Output $ / M tokens—$1.11
Results tracked125

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.7 Flash leads

OLMo 2 Furious 13B: 28.1 (#309), Step 3.7 Flash: 39.4 (#147)

Coding benchmarks
BenchmarkOLMo 2 Furious 13BStep 3.7 Flash
SciCode—40%
LiveBench Coding10.4%—
ALE-Bench—694.12

Reasoning Step 3.7 Flash leads

OLMo 2 Furious 13B: 14.8 (#312), Step 3.7 Flash: 20.9 (#211)

Reasoning benchmarks
BenchmarkOLMo 2 Furious 13BStep 3.7 Flash
NYT Connections (extended)—39.7%
CritPt—2.3%
LiveBench Reasoning16.3%—
LiveBench Data Analysis20.6%—
LiveBench22.1%—

Math Step 3.7 Flash leads

OLMo 2 Furious 13B: 21.3 (#270), Step 3.7 Flash: 40.9 (#74)

Math benchmarks
BenchmarkOLMo 2 Furious 13BStep 3.7 Flash
MathArena Final-Answer Competitions—68.5%
Omni-MATH15.6%—
LiveBench Math13.6%—

Knowledge Not comparable

OLMo 2 Furious 13B: 18.0 (#278), Step 3.7 Flash: —

Knowledge benchmarks
BenchmarkOLMo 2 Furious 13BStep 3.7 Flash
MMLU-Pro31%—
GPQA (HELM)31.6%—

Instruction Following Not comparable

OLMo 2 Furious 13B: 61.1 (#243), Step 3.7 Flash: —

Instruction Following benchmarks
BenchmarkOLMo 2 Furious 13BStep 3.7 Flash
LiveBench Instruction Following60.6%—
IFEval73%—

Writing & Preference Not comparable

OLMo 2 Furious 13B: 43.0 (#226), Step 3.7 Flash: —

Writing & Preference benchmarks
BenchmarkOLMo 2 Furious 13BStep 3.7 Flash
WildBench68.9%—
LiveBench Language11.2%—

Frequently asked questions

Is OLMo 2 Furious 13B better than Step 3.7 Flash?

Step 3.7 Flash is the stronger model overall, scoring 36.5 to 29.2 on the Noometry Index.

Is OLMo 2 Furious 13B or Step 3.7 Flash better for coding?

Step 3.7 Flash scores higher on coding benchmarks: 39.4 versus 28.1 in the Noometry coding category.

How many benchmarks do OLMo 2 Furious 13B and Step 3.7 Flash share?

0 benchmarks have published results for both models. OLMo 2 Furious 13B has 12 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper