Noometry

Model comparison

Inkling-Small vs Tulu 3 (Tülu 3) 70B

Inkling-Small is the stronger model overall, scoring 46.5 to 33.0 on the Noometry Index.

Last verified . 13 shared benchmarks.

Inkling-Small Thinking Machines Lab

46.5

Rank #63 Confirmed

Tulu 3 (Tülu 3) 70B Allen Institute for AI (Ai2)

33.0

Rank #251 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Inkling-Small scores higher in 8 categories and Tulu 3 (Tülu 3) 70B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Inkling-Small leads 45.1 to 14.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 90% for Inkling-Small and 4.4% for Tulu 3 (Tülu 3) 70B.

Side by side

Inkling-SmallTulu 3 (Tülu 3) 70B
ProviderThinking Machines LabAllen Institute for AI (Ai2)
Noometry Index46.533.0
Released2026-07-152024-11-21
WeightsOpenOpen
Context window524K—
Max output1.05M—
Input $ / M tokens$0.45—
Output $ / M tokens$1.20—
Results tracked3314

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Inkling-Small leads

Inkling-Small: 43.6 (#85), Tulu 3 (Tülu 3) 70B: 36.0 (#214)

BenchmarkInkling-SmallTulu 3 (Tülu 3) 70B
LMArena Coding14511235
LMArena WebDev1409—
SciCode48.7%—

Reasoning Inkling-Small leads

Inkling-Small: 38.6 (#63), Tulu 3 (Tülu 3) 70B: 23.9 (#169)

BenchmarkInkling-SmallTulu 3 (Tülu 3) 70B
LMArena Hard Prompts14231220
ARC-AGI-240.1%—
ARC-AGI-184%—
CritPt8.3%—
Chess Puzzles18%—
Mystery Game Puzzles6%—
Epoch Capabilities Index150.15—

Math Inkling-Small leads

Inkling-Small: 45.1 (#77), Tulu 3 (Tülu 3) 70B: 14.2 (#303)

BenchmarkInkling-SmallTulu 3 (Tülu 3) 70B
OTIS Mock AIME 2024-202590%4.4%
LMArena Math14591242
FrontierMath (Tiers 1-3)46.3%—
FrontierMath Tier 417.1%—
ProofBench6%—
MATH Level 5—42.7%

Knowledge Inkling-Small leads

Inkling-Small: 48.2 (#77), Tulu 3 (Tülu 3) 70B: 25.0 (#264)

BenchmarkInkling-SmallTulu 3 (Tülu 3) 70B
GPQA Diamond88.5%46.3%
SimpleQA Verified19.1%—
LMArena Expert1442—

Multimodal Not comparable

Inkling-Small: 39.1 (#62), Tulu 3 (Tülu 3) 70B: —

BenchmarkInkling-SmallTulu 3 (Tülu 3) 70B
LMArena Vision1235—

Multilingual Inkling-Small leads

Inkling-Small: 51.7 (#104), Tulu 3 (Tülu 3) 70B: 39.9 (#222)

BenchmarkInkling-SmallTulu 3 (Tülu 3) 70B
LMArena Non-English14021236
LMArena Chinese14651249
LMArena Russian13911246
LMArena French1436—
LMArena German1405—
LMArena Japanese1405—
LMArena Korean1363—
LMArena Spanish1428—

Instruction Following Inkling-Small leads

Inkling-Small: 73.8 (#114), Tulu 3 (Tülu 3) 70B: 64.8 (#227)

BenchmarkInkling-SmallTulu 3 (Tülu 3) 70B
LMArena Instruction Following13991233

Long Context Inkling-Small leads

Inkling-Small: 42.7 (#118), Tulu 3 (Tülu 3) 70B: 37.1 (#222)

BenchmarkInkling-SmallTulu 3 (Tülu 3) 70B
LMArena Longer Query14011224

Writing & Preference Inkling-Small leads

Inkling-Small: 59.6 (#107), Tulu 3 (Tülu 3) 70B: 45.6 (#223)

BenchmarkInkling-SmallTulu 3 (Tülu 3) 70B
LMArena Text14141256
LMArena Creative Writing13311231
LMArena Multi-Turn14181252
EQ-Bench Creative Writing1491—

Frequently asked questions

Is Inkling-Small better than Tulu 3 (Tülu 3) 70B?

Inkling-Small is the stronger model overall, scoring 46.5 to 33.0 on the Noometry Index.

Is Inkling-Small or Tulu 3 (Tülu 3) 70B better for coding?

Inkling-Small scores higher on coding benchmarks: 43.6 versus 36.0 in the Noometry coding category.

How many benchmarks do Inkling-Small and Tulu 3 (Tülu 3) 70B share?

13 benchmarks have published results for both models. Inkling-Small has 33 scored results on Noometry and Tulu 3 (Tülu 3) 70B has 14.

Related comparisons

Go deeper