Noometry

Model comparison

Inkling-Small vs Qwen2-72B

Inkling-Small is the stronger model overall, scoring 46.5 to 30.0 on the Noometry Index.

Last verified . 19 shared benchmarks.

Inkling-Small Thinking Machines Lab

46.5

Rank #63 Confirmed

Qwen2-72B Alibaba (Qwen)

30.0

Rank #300 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Inkling-Small scores higher in 8 categories and Qwen2-72B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Inkling-Small leads 48.2 to 21.2.
  • The biggest single-benchmark swing is GPQA Diamond: 88.5% for Inkling-Small and 40.8% for Qwen2-72B.

Side by side

Inkling-SmallQwen2-72B
ProviderThinking Machines LabAlibaba (Qwen)
Noometry Index46.530.0
Released2026-07-152024-06-07
WeightsOpenOpen
Context window524K—
Max output1.05M—
Input $ / M tokens$0.45—
Output $ / M tokens$1.20—
Results tracked3326

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Inkling-Small leads

Inkling-Small: 43.6 (#85), Qwen2-72B: 29.1 (#310)

BenchmarkInkling-SmallQwen2-72B
LMArena Coding14511196
LMArena WebDev1409—
SciCode48.7%—
WeirdML—11.3%
BigCodeBench Instruct—38.5%
BigCodeBench Complete—54%

Agentic & Tool Use Not comparable

Inkling-Small: —, Qwen2-72B: 17.0 (#146)

BenchmarkInkling-SmallQwen2-72B
TheAgentCompany—1.1%
METR Time Horizons—29.9%

Reasoning Inkling-Small leads

Inkling-Small: 38.6 (#63), Qwen2-72B: 23.2 (#181)

BenchmarkInkling-SmallQwen2-72B
LMArena Hard Prompts14231191
Epoch Capabilities Index150.15125.28
ARC-AGI-240.1%—
ARC-AGI-184%—
CritPt8.3%—
Chess Puzzles18%—
Mystery Game Puzzles6%—

Math Inkling-Small leads

Inkling-Small: 45.1 (#77), Qwen2-72B: 30.2 (#236)

BenchmarkInkling-SmallQwen2-72B
LMArena Math14591235
FrontierMath (Tiers 1-3)46.3%—
FrontierMath Tier 417.1%—
OTIS Mock AIME 2024-202590%—
ProofBench6%—
MATH Level 5—39.1%

Knowledge Inkling-Small leads

Inkling-Small: 48.2 (#77), Qwen2-72B: 21.2 (#275)

BenchmarkInkling-SmallQwen2-72B
GPQA Diamond88.5%40.8%
LMArena Expert14421171
SimpleQA Verified19.1%—
MMLU—82.4%

Multimodal Not comparable

Inkling-Small: 39.1 (#62), Qwen2-72B: —

BenchmarkInkling-SmallQwen2-72B
LMArena Vision1235—

Multilingual Inkling-Small leads

Inkling-Small: 51.7 (#104), Qwen2-72B: 35.9 (#244)

BenchmarkInkling-SmallQwen2-72B
LMArena Non-English14021176
LMArena Chinese14651240
LMArena French14361170
LMArena German14051151
LMArena Japanese14051111
LMArena Korean13631083
LMArena Russian13911169
LMArena Spanish14281169

Instruction Following Inkling-Small leads

Inkling-Small: 73.8 (#114), Qwen2-72B: 61.7 (#241)

BenchmarkInkling-SmallQwen2-72B
LMArena Instruction Following13991181

Long Context Inkling-Small leads

Inkling-Small: 42.7 (#118), Qwen2-72B: 36.1 (#235)

BenchmarkInkling-SmallQwen2-72B
LMArena Longer Query14011192

Writing & Preference Inkling-Small leads

Inkling-Small: 59.6 (#107), Qwen2-72B: 40.8 (#241)

BenchmarkInkling-SmallQwen2-72B
LMArena Text14141203
LMArena Creative Writing13311181
LMArena Multi-Turn14181196
EQ-Bench Creative Writing1491—

Frequently asked questions

Is Inkling-Small better than Qwen2-72B?

Inkling-Small is the stronger model overall, scoring 46.5 to 30.0 on the Noometry Index.

Is Inkling-Small or Qwen2-72B better for coding?

Inkling-Small scores higher on coding benchmarks: 43.6 versus 29.1 in the Noometry coding category.

How many benchmarks do Inkling-Small and Qwen2-72B share?

19 benchmarks have published results for both models. Inkling-Small has 33 scored results on Noometry and Qwen2-72B has 26.

Related comparisons

Go deeper