Model comparison

Inkling-Small vs Step 3.7 Flash

Inkling-Small is the stronger model overall, scoring 46.5 to 37.3 on the Noometry Index. Step 3.7 Flash costs 1.5× less per token, which makes it the better buy when Inkling-Small's lead doesn't matter for your workload.

Last verified . 2 shared benchmarks.

Inkling-Small Thinking Machines Lab

46.5

Rank #63 Confirmed

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • They share 2 benchmarks with published results for both. Inkling-Small scores higher in 3 categories and Step 3.7 Flash in 0 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Inkling-Small leads 38.6 to 21.6.
  • The biggest single-benchmark swing is SciCode: 48.7% for Inkling-Small and 40% for Step 3.7 Flash.
  • Step 3.7 Flash is cheaper at $0.18 / $1.11 per million input/output tokens, against $0.45 / $1.20 for Inkling-Small.
  • Inkling-Small accepts more context: 524K tokens versus 256K.

Side by side

Inkling-Small and Step 3.7 Flash specifications
Inkling-SmallStep 3.7 Flash
ProviderThinking Machines LabStepFun
Noometry Index46.537.3
Released2026-07-152026-05-29
WeightsOpenOpen
Context window524K256K
Max output1.05M256K
Input $ / M tokens$0.45$0.18
Output $ / M tokens$1.20$1.11
Results tracked335

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Inkling-Small leads

Inkling-Small: 43.6 (#85), Step 3.7 Flash: 40.0 (#150)

Coding benchmarks
BenchmarkInkling-SmallStep 3.7 Flash
SciCode48.7%40%
LMArena WebDev1409—
LMArena Coding1451—
ALE-Bench—694.12

Reasoning Inkling-Small leads

Inkling-Small: 38.6 (#63), Step 3.7 Flash: 21.6 (#219)

Reasoning benchmarks
BenchmarkInkling-SmallStep 3.7 Flash
CritPt8.3%2.3%
ARC-AGI-240.1%—
NYT Connections (extended)—39.7%
ARC-AGI-184%—
Chess Puzzles18%—
LMArena Hard Prompts1423—
Mystery Game Puzzles6%—
Epoch Capabilities Index150.15—

Math Inkling-Small leads

Inkling-Small: 45.1 (#77), Step 3.7 Flash: 42.9 (#82)

Math benchmarks
BenchmarkInkling-SmallStep 3.7 Flash
FrontierMath (Tiers 1-3)46.3%—
FrontierMath Tier 417.1%—
MathArena Final-Answer Competitions—68.5%
OTIS Mock AIME 2024-202590%—
ProofBench6%—
LMArena Math1459—

Knowledge Not comparable

Inkling-Small: 48.2 (#77), Step 3.7 Flash: —

Knowledge benchmarks
BenchmarkInkling-SmallStep 3.7 Flash
GPQA Diamond88.5%—
SimpleQA Verified19.1%—
LMArena Expert1442—

Multimodal Not comparable

Inkling-Small: 39.1 (#62), Step 3.7 Flash: —

Multimodal benchmarks
BenchmarkInkling-SmallStep 3.7 Flash
LMArena Vision1235—

Multilingual Not comparable

Inkling-Small: 51.7 (#104), Step 3.7 Flash: —

Multilingual benchmarks
BenchmarkInkling-SmallStep 3.7 Flash
LMArena Non-English1402—
LMArena Chinese1465—
LMArena French1436—
LMArena German1405—
LMArena Japanese1405—
LMArena Korean1363—
LMArena Russian1391—
LMArena Spanish1428—

Instruction Following Not comparable

Inkling-Small: 73.8 (#114), Step 3.7 Flash: —

Instruction Following benchmarks
BenchmarkInkling-SmallStep 3.7 Flash
LMArena Instruction Following1399—

Long Context Not comparable

Inkling-Small: 42.7 (#118), Step 3.7 Flash: —

Long Context benchmarks
BenchmarkInkling-SmallStep 3.7 Flash
LMArena Longer Query1401—

Writing & Preference Not comparable

Inkling-Small: 59.6 (#107), Step 3.7 Flash: —

Writing & Preference benchmarks
BenchmarkInkling-SmallStep 3.7 Flash
LMArena Text1414—
LMArena Creative Writing1331—
EQ-Bench Creative Writing1491—
LMArena Multi-Turn1418—

Frequently asked questions

Is Inkling-Small better than Step 3.7 Flash?

Inkling-Small is the stronger model overall, scoring 46.5 to 37.3 on the Noometry Index. Step 3.7 Flash costs 1.5× less per token, which makes it the better buy when Inkling-Small's lead doesn't matter for your workload.

Which is cheaper, Inkling-Small or Step 3.7 Flash?

Step 3.7 Flash is cheaper. It lists at $0.18 per million input tokens and $1.11 per million output tokens; Inkling-Small lists at $0.45 and $1.20.

Is Inkling-Small or Step 3.7 Flash better for coding?

Inkling-Small scores higher on coding benchmarks: 43.6 versus 40.0 in the Noometry coding category.

Which has the bigger context window?

Inkling-Small does, with 524K tokens against 256K.

How many benchmarks do Inkling-Small and Step 3.7 Flash share?

2 benchmarks have published results for both models. Inkling-Small has 33 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper