Noometry

Model comparison

Claude Haiku 4.5 vs Step 3.7 Flash

Claude Haiku 4.5 is the stronger model overall, scoring 39.5 to 37.3 on the Noometry Index. Step 3.7 Flash costs 4.8× less per token, which makes it the better buy when Claude Haiku 4.5's lead doesn't matter for your workload.

Last verified . 4 shared benchmarks.

Claude Haiku 4.5 Anthropic

39.5

Rank #165 Confirmed

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • They share 4 benchmarks with published results for both. Claude Haiku 4.5 scores higher in 2 categories and Step 3.7 Flash in 1 category; 3 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Step 3.7 Flash leads 21.6 to 15.1.
  • The biggest single-benchmark swing is NYT Connections (extended): 14.3% for Claude Haiku 4.5 and 39.7% for Step 3.7 Flash.
  • Step 3.7 Flash is cheaper at $0.18 / $1.11 per million input/output tokens, against $1 / $5 for Claude Haiku 4.5.
  • Step 3.7 Flash accepts more context: 256K tokens versus 200K.
  • Step 3.7 Flash has downloadable open weights; the other is API-only.

Side by side

Claude Haiku 4.5Step 3.7 Flash
ProviderAnthropicStepFun
Noometry Index39.537.3
Released2025-10-152026-05-29
WeightsProprietaryOpen
Context window200K256K
Max output64K256K
Input $ / M tokens$1$0.18
Output $ / M tokens$5$1.11
Results tracked535

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Haiku 4.5 leads

Claude Haiku 4.5: 44.0 (#78), Step 3.7 Flash: 40.0 (#150)

BenchmarkClaude Haiku 4.5Step 3.7 Flash
SciCode43.3%40%
ALE-Bench653.48694.12
SWE-bench Verified (bash only)66.6%—
LMArena WebDev1330—
SWE-bench Multilingual64.7%—
WeirdML45.4%—
LMArena Coding1453—

Agentic & Tool Use Not comparable

Claude Haiku 4.5: 33.6 (#52), Step 3.7 Flash: —

BenchmarkClaude Haiku 4.5Step 3.7 Flash
Terminal-Bench35.5%—
Berkeley Function Calling Leaderboard68.7%—
DeepResearch Bench45.5%—
BALROG31.2%—
ExploitBench13.7%—
Vending-Bench 2458.89—

Reasoning Step 3.7 Flash leads

Claude Haiku 4.5: 15.1 (#320), Step 3.7 Flash: 21.6 (#219)

BenchmarkClaude Haiku 4.5Step 3.7 Flash
NYT Connections (extended)14.3%39.7%
CritPt0%2.3%
ARC-AGI-24%—
ARC-AGI-147.7%—
Chess Puzzles8%—
LMArena Hard Prompts1420—
DTBench73.6%—
LMCA30.9%—
Epoch Capabilities Index142.41—
ForecastBench61.4—

Math Claude Haiku 4.5 leads

Claude Haiku 4.5: 44.9 (#78), Step 3.7 Flash: 42.9 (#82)

BenchmarkClaude Haiku 4.5Step 3.7 Flash
MathArena Final-Answer Competitions—68.5%
OTIS Mock AIME 2024-202566.7%—
Omni-MATH56.1%—
LMArena Math1396—
MATH Level 596.4%—
FrontierMath (Feb 2025 set)5.9%—
FrontierMath Tier 4 (v1)2.1%—

Knowledge Not comparable

Claude Haiku 4.5: 37.7 (#153), Step 3.7 Flash: —

BenchmarkClaude Haiku 4.5Step 3.7 Flash
GPQA Diamond71.2%—
SimpleQA Verified13.2%—
MMLU-Pro77.7%—
Vectara Hallucination Rate9.8%—
GPQA (HELM)60.5%—
LMArena Expert1442—

Multimodal Not comparable

Claude Haiku 4.5: 26.8 (#118), Step 3.7 Flash: —

BenchmarkClaude Haiku 4.5Step 3.7 Flash
Blueprint-Bench 20%—
LMArena Document1420—

Multilingual Not comparable

Claude Haiku 4.5: 49.9 (#129), Step 3.7 Flash: —

BenchmarkClaude Haiku 4.5Step 3.7 Flash
LMArena Non-English1377—
LMArena Chinese1417—
LMArena French1408—
LMArena German1375—
LMArena Japanese1339—
LMArena Korean1347—
LMArena Russian1381—
LMArena Spanish1420—

Instruction Following Not comparable

Claude Haiku 4.5: 71.4 (#149), Step 3.7 Flash: —

BenchmarkClaude Haiku 4.5Step 3.7 Flash
IFEval80.1%—
LMArena Instruction Following1414—

Long Context Not comparable

Claude Haiku 4.5: 43.6 (#92), Step 3.7 Flash: —

BenchmarkClaude Haiku 4.5Step 3.7 Flash
LMArena Longer Query1427—

Writing & Preference Not comparable

Claude Haiku 4.5: 57.9 (#123), Step 3.7 Flash: —

BenchmarkClaude Haiku 4.5Step 3.7 Flash
LMArena Text1396—
LMArena Creative Writing1372—
WildBench83.9%—
EQ-Bench 41064—
LMArena Multi-Turn1409—

Frequently asked questions

Is Claude Haiku 4.5 better than Step 3.7 Flash?

Claude Haiku 4.5 is the stronger model overall, scoring 39.5 to 37.3 on the Noometry Index. Step 3.7 Flash costs 4.8× less per token, which makes it the better buy when Claude Haiku 4.5's lead doesn't matter for your workload.

Which is cheaper, Claude Haiku 4.5 or Step 3.7 Flash?

Step 3.7 Flash is cheaper. It lists at $0.18 per million input tokens and $1.11 per million output tokens; Claude Haiku 4.5 lists at $1 and $5.

Is Claude Haiku 4.5 or Step 3.7 Flash better for coding?

Claude Haiku 4.5 scores higher on coding benchmarks: 44.0 versus 40.0 in the Noometry coding category.

Which has the bigger context window?

Step 3.7 Flash does, with 256K tokens against 200K.

How many benchmarks do Claude Haiku 4.5 and Step 3.7 Flash share?

4 benchmarks have published results for both models. Claude Haiku 4.5 has 53 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper