Model comparison

Inkling vs Step 3.7 Flash

Inkling is the stronger model overall, scoring 44.1 to 37.3 on the Noometry Index. Step 3.7 Flash costs 6.2× less per token, which makes it the better buy when Inkling's lead doesn't matter for your workload.

Last verified . 3 shared benchmarks.

Inkling Thinking Machines Lab

44.1

Rank #80 Confirmed

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • They share 3 benchmarks with published results for both. Inkling scores higher in 1 category and Step 3.7 Flash in 2 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Inkling leads 40.4 to 21.6.
  • The biggest single-benchmark swing is SciCode: 47% for Inkling and 40% for Step 3.7 Flash.
  • Step 3.7 Flash is cheaper at $0.18 / $1.11 per million input/output tokens, against $1.87 / $4.68 for Inkling.
  • Step 3.7 Flash accepts more context: 256K tokens versus 66K.

Side by side

Inkling and Step 3.7 Flash specifications
InklingStep 3.7 Flash
ProviderThinking Machines LabStepFun
Noometry Index44.137.3
Released2026-07-152026-05-29
WeightsOpenOpen
Context window66K256K
Max output66K256K
Input $ / M tokens$1.87$0.18
Output $ / M tokens$4.68$1.11
Results tracked415

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.7 Flash leads

Inkling: 34.5 (#234), Step 3.7 Flash: 40.0 (#150)

Coding benchmarks
BenchmarkInklingStep 3.7 Flash
SciCode47%40%
ALE-Bench946694.12
FrontierCode14%—
LMArena WebDev1413—
FrontierSWE4.1%—
WeirdML32.3%—
LMArena Coding1464—

Agentic & Tool Use Not comparable

Inkling: 29.6 (#85), Step 3.7 Flash: —

Agentic & Tool Use benchmarks
BenchmarkInklingStep 3.7 Flash
APEX-Agents33.8%—
τ²-bench Banking25%—

Reasoning Inkling leads

Inkling: 40.4 (#56), Step 3.7 Flash: 21.6 (#219)

Reasoning benchmarks
BenchmarkInklingStep 3.7 Flash
CritPt5.4%2.3%
ARC-AGI-236.5%—
SimpleBench50%—
NYT Connections (extended)—39.7%
ARC-AGI-179.5%—
Chess Puzzles21%—
LMArena Hard Prompts1451—
DTBench87.5%—
LMCA37.6%—
Epoch Capabilities Index148.54—

Math Step 3.7 Flash leads

Inkling: 31.3 (#225), Step 3.7 Flash: 42.9 (#82)

Math benchmarks
BenchmarkInklingStep 3.7 Flash
FrontierMath (Tiers 1-3)33.3%—
FrontierMath Tier 44.9%—
MathArena Final-Answer Competitions—68.5%
OTIS Mock AIME 2024-202588.9%—
ProofBench0%—
LMArena Math1479—

Knowledge Not comparable

Inkling: 55.1 (#49), Step 3.7 Flash: —

Knowledge benchmarks
BenchmarkInklingStep 3.7 Flash
GPQA Diamond88.3%—
SimpleQA Verified40.3%—
LMArena Expert1465—

Multilingual Not comparable

Inkling: 54.0 (#52), Step 3.7 Flash: —

Multilingual benchmarks
BenchmarkInklingStep 3.7 Flash
LMArena Non-English1434—
LMArena Chinese1490—
LMArena French1458—
LMArena German1446—
LMArena Japanese1429—
LMArena Korean1404—
LMArena Russian1429—
LMArena Spanish1448—

Instruction Following Not comparable

Inkling: 75.1 (#71), Step 3.7 Flash: —

Instruction Following benchmarks
BenchmarkInklingStep 3.7 Flash
LMArena Instruction Following1426—

Long Context Not comparable

Inkling: 43.8 (#86), Step 3.7 Flash: —

Long Context benchmarks
BenchmarkInklingStep 3.7 Flash
LMArena Longer Query1434—

Writing & Preference Not comparable

Inkling: 65.2 (#51), Step 3.7 Flash: —

Writing & Preference benchmarks
BenchmarkInklingStep 3.7 Flash
LMArena Text1441—
LMArena Creative Writing1387—
EQ-Bench Creative Writing1611—
EQ-Bench 41226—
LMArena Multi-Turn1436—

Frequently asked questions

Is Inkling better than Step 3.7 Flash?

Inkling is the stronger model overall, scoring 44.1 to 37.3 on the Noometry Index. Step 3.7 Flash costs 6.2× less per token, which makes it the better buy when Inkling's lead doesn't matter for your workload.

Which is cheaper, Inkling or Step 3.7 Flash?

Step 3.7 Flash is cheaper. It lists at $0.18 per million input tokens and $1.11 per million output tokens; Inkling lists at $1.87 and $4.68.

Is Inkling or Step 3.7 Flash better for coding?

Step 3.7 Flash scores higher on coding benchmarks: 40.0 versus 34.5 in the Noometry coding category.

Which has the bigger context window?

Step 3.7 Flash does, with 256K tokens against 66K.

How many benchmarks do Inkling and Step 3.7 Flash share?

3 benchmarks have published results for both models. Inkling has 41 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper