Model comparison

Falcon-180B vs Step 3.7 Flash

Step 3.7 Flash is the stronger model overall, scoring 36.5 to 31.8 on the Noometry Index.

Last verified . 0 shared benchmarks.

Step 3.7 Flash StepFun

36.5

Rank #207 Reported

Side by side

Falcon-180B and Step 3.7 Flash specifications
Falcon-180BStep 3.7 Flash
ProviderTechnology Innovation InstituteStepFun
Noometry Index31.836.5
Released2023-09-062026-05-29
WeightsOpenOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.18
Output $ / M tokens—$1.11
Results tracked165

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, Step 3.7 Flash: 39.4 (#147)

Coding benchmarks
BenchmarkFalcon-180BStep 3.7 Flash
SciCode—40%
ALE-Bench—694.12

Reasoning Step 3.7 Flash leads

Falcon-180B: 18.3 (#266), Step 3.7 Flash: 20.9 (#211)

Reasoning benchmarks
BenchmarkFalcon-180BStep 3.7 Flash
NYT Connections (extended)—39.7%
CritPt—2.3%
LMArena Hard Prompts1007—
Epoch Capabilities Index111.89—
HellaSwag89%—
LAMBADA79.8%—
PIQA84.9%—
WinoGrande87.1%—

Math Not comparable

Falcon-180B: —, Step 3.7 Flash: 40.9 (#74)

Math benchmarks
BenchmarkFalcon-180BStep 3.7 Flash
MathArena Final-Answer Competitions—68.5%
GSM8K54.4%—

Knowledge Not comparable

Falcon-180B: —, Step 3.7 Flash: —

Knowledge benchmarks
BenchmarkFalcon-180BStep 3.7 Flash
ARC (AI2) Challenge67.8%—
BoolQ89%—
MMLU70.6%—
OpenBookQA64.2%—

Multilingual Not comparable

Falcon-180B: 25.3 (#281), Step 3.7 Flash: —

Multilingual benchmarks
BenchmarkFalcon-180BStep 3.7 Flash
LMArena Non-English1000—

Instruction Following Not comparable

Falcon-180B: 53.6 (#281), Step 3.7 Flash: —

Instruction Following benchmarks
BenchmarkFalcon-180BStep 3.7 Flash
LMArena Instruction Following1047—

Writing & Preference Not comparable

Falcon-180B: 29.3 (#290), Step 3.7 Flash: —

Writing & Preference benchmarks
BenchmarkFalcon-180BStep 3.7 Flash
LMArena Text1054—
LMArena Creative Writing1089—
LMArena Multi-Turn1013—

Frequently asked questions

Is Falcon-180B better than Step 3.7 Flash?

Step 3.7 Flash is the stronger model overall, scoring 36.5 to 31.8 on the Noometry Index.

How many benchmarks do Falcon-180B and Step 3.7 Flash share?

0 benchmarks have published results for both models. Falcon-180B has 16 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper