Model comparison

DeepSeek-R1 vs Inkling

Inkling is the stronger model overall, scoring 44.1 to 42.3 on the Noometry Index. DeepSeek-R1 costs 2.8× less per token, which makes it the better buy when Inkling's lead doesn't matter for your workload.

Last verified . 28 shared benchmarks.

DeepSeek-R1 DeepSeek

42.3

Rank #115 Confirmed

Inkling Thinking Machines Lab

44.1

Rank #80 Confirmed

Summary

  • They share 28 benchmarks with published results for both. DeepSeek-R1 scores higher in 4 categories and Inkling in 5 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Inkling leads 40.4 to 18.6.
  • The biggest single-benchmark swing is ARC-AGI-1: 21.2% for DeepSeek-R1 and 79.5% for Inkling.
  • DeepSeek-R1 is cheaper at $0.50 / $2.15 per million input/output tokens, against $1.87 / $4.68 for Inkling.
  • DeepSeek-R1 accepts more context: 164K tokens versus 66K.
  • Inkling has downloadable open weights; the other is API-only.

Side by side

DeepSeek-R1 and Inkling specifications
DeepSeek-R1Inkling
ProviderDeepSeekThinking Machines Lab
Noometry Index42.344.1
Released2025-01-202026-07-15
WeightsProprietaryOpen
Context window164K66K
Max output64K66K
Input $ / M tokens$0.50$1.87
Output $ / M tokens$2.15$4.68
Results tracked5241

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek-R1 leads

DeepSeek-R1: 46.3 (#68), Inkling: 34.5 (#234)

Coding benchmarks
BenchmarkDeepSeek-R1Inkling
SciCode35.7%47%
WeirdML41.6%32.3%
LMArena Coding14271464
ALE-Bench804.12946
FrontierCode—14%
Aider Polyglot71.4%—
LMArena WebDev—1413
FrontierSWE—4.1%
LiveBench Coding66.7%—
AlgoTune1.7—

Agentic & Tool Use DeepSeek-R1 leads

DeepSeek-R1: 30.7 (#75), Inkling: 29.6 (#85)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-R1Inkling
APEX-Agents—33.8%
τ²-bench Banking—25%
DeepResearch Bench35.1%—
BALROG34.9%—
METR Time Horizons53.8%—

Reasoning Inkling leads

DeepSeek-R1: 18.6 (#278), Inkling: 40.4 (#56)

Reasoning benchmarks
BenchmarkDeepSeek-R1Inkling
ARC-AGI-21.3%36.5%
SimpleBench40.8%50%
ARC-AGI-121.2%79.5%
CritPt1.1%5.4%
LMArena Hard Prompts14161451
Epoch Capabilities Index141.29148.54
Kagi LLM Benchmark69.4%—
Chess Puzzles—21%
LiveBench Reasoning83.2%—
DTBench—87.5%
LiveBench Data Analysis69.8%—
LMCA—37.6%
ForecastBench60—
LiveBench71.6%—

Math DeepSeek-R1 leads

DeepSeek-R1: 43.8 (#79), Inkling: 31.3 (#225)

Math benchmarks
BenchmarkDeepSeek-R1Inkling
OTIS Mock AIME 2024-202566.4%88.9%
LMArena Math14001479
FrontierMath (Tiers 1-3)—33.3%
FrontierMath Tier 4—4.9%
ProofBench—0%
Omni-MATH42.4%—
LiveBench Math80.7%—
MATH Level 596.6%—

Knowledge Inkling leads

DeepSeek-R1: 44.5 (#87), Inkling: 55.1 (#49)

Knowledge benchmarks
BenchmarkDeepSeek-R1Inkling
GPQA Diamond76.3%88.3%
LMArena Expert13941465
SimpleQA Verified—40.3%
MMLU-Pro79.3%—
Confabulations12.7%—
Vectara Hallucination Rate11.3%—
GPQA (HELM)66.6%—

Multilingual Inkling leads

DeepSeek-R1: 52.4 (#85), Inkling: 54.0 (#52)

Multilingual benchmarks
BenchmarkDeepSeek-R1Inkling
LMArena Non-English14121434
LMArena Chinese14421490
LMArena French14171458
LMArena German14041446
LMArena Japanese13911429
LMArena Korean13601404
LMArena Russian14231429
LMArena Spanish14111448

Instruction Following Inkling leads

DeepSeek-R1: 72.0 (#143), Inkling: 75.1 (#71)

Instruction Following benchmarks
BenchmarkDeepSeek-R1Inkling
LMArena Instruction Following13821426
LiveBench Instruction Following80.5%—
IFEval78.4%—

Long Context DeepSeek-R1 leads

DeepSeek-R1: 45.4 (#36), Inkling: 43.8 (#86)

Long Context benchmarks
BenchmarkDeepSeek-R1Inkling
LMArena Longer Query13911434
Fiction.LiveBench75%—

Writing & Preference Inkling leads

DeepSeek-R1: 61.4 (#88), Inkling: 65.2 (#51)

Writing & Preference benchmarks
BenchmarkDeepSeek-R1Inkling
LMArena Text14281441
LMArena Creative Writing14051387
EQ-Bench Creative Writing15001611
LMArena Multi-Turn14051436
Short-Story Creative Writing83%—
WildBench82.8%—
EQ-Bench 4—1226
LiveBench Language48.5%—

Frequently asked questions

Is DeepSeek-R1 better than Inkling?

Inkling is the stronger model overall, scoring 44.1 to 42.3 on the Noometry Index. DeepSeek-R1 costs 2.8× less per token, which makes it the better buy when Inkling's lead doesn't matter for your workload.

Which is cheaper, DeepSeek-R1 or Inkling?

DeepSeek-R1 is cheaper. It lists at $0.50 per million input tokens and $2.15 per million output tokens; Inkling lists at $1.87 and $4.68.

Is DeepSeek-R1 or Inkling better for coding?

DeepSeek-R1 scores higher on coding benchmarks: 46.3 versus 34.5 in the Noometry coding category.

Which has the bigger context window?

DeepSeek-R1 does, with 164K tokens against 66K.

How many benchmarks do DeepSeek-R1 and Inkling share?

28 benchmarks have published results for both models. DeepSeek-R1 has 52 scored results on Noometry and Inkling has 41.

Related comparisons

Go deeper