Noometry

Model comparison

Inkling vs Magistral Medium

Inkling is the stronger model overall, scoring 44.1 to 35.2 on the Noometry Index.

Last verified . 21 shared benchmarks.

Inkling Thinking Machines Lab

44.1

Rank #80 Confirmed

Magistral Medium Mistral AI

35.2

Rank #227 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Inkling scores higher in 6 categories and Magistral Medium in 2 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Inkling leads 40.4 to 8.6.
  • The biggest single-benchmark swing is ARC-AGI-1: 79.5% for Inkling and 6.1% for Magistral Medium.
  • Inkling is cheaper at $1.87 / $4.68 per million input/output tokens, against $2 / $5 for Magistral Medium.
  • Magistral Medium accepts more context: 262K tokens versus 66K.

Side by side

InklingMagistral Medium
ProviderThinking Machines LabMistral AI
Noometry Index44.135.2
Released2026-07-152025-03-17
WeightsOpenOpen
Context window66K262K
Max output66K16K
Input $ / M tokens$1.87$2
Output $ / M tokens$4.68$5
Results tracked4122

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Magistral Medium leads

Inkling: 34.5 (#234), Magistral Medium: 39.1 (#161)

BenchmarkInklingMagistral Medium
SciCode47%39.2%
LMArena Coding14641319
FrontierCode14%—
LMArena WebDev1413—
FrontierSWE4.1%—
WeirdML32.3%—
ALE-Bench946—

Agentic & Tool Use Not comparable

Inkling: 29.6 (#85), Magistral Medium: —

BenchmarkInklingMagistral Medium
APEX-Agents33.8%—
τ²-bench Banking25%—

Reasoning Inkling leads

Inkling: 40.4 (#56), Magistral Medium: 8.6 (#348)

BenchmarkInklingMagistral Medium
ARC-AGI-236.5%0%
ARC-AGI-179.5%6.1%
CritPt5.4%0.3%
LMArena Hard Prompts14511267
SimpleBench50%—
Kagi LLM Benchmark—16.2%
Chess Puzzles21%—
DTBench87.5%—
LMCA37.6%—
Epoch Capabilities Index148.54—

Math Magistral Medium leads

Inkling: 31.3 (#225), Magistral Medium: 35.1 (#189)

BenchmarkInklingMagistral Medium
LMArena Math14791250
FrontierMath (Tiers 1-3)33.3%—
FrontierMath Tier 44.9%—
OTIS Mock AIME 2024-202588.9%—
ProofBench0%—

Knowledge Inkling leads

Inkling: 55.1 (#49), Magistral Medium: 33.5 (#202)

BenchmarkInklingMagistral Medium
LMArena Expert14651223
GPQA Diamond88.3%—
SimpleQA Verified40.3%—

Multilingual Inkling leads

Inkling: 54.0 (#52), Magistral Medium: 39.6 (#224)

BenchmarkInklingMagistral Medium
LMArena Non-English14341232
LMArena Chinese14901227
LMArena French14581267
LMArena German14461248
LMArena Japanese14291175
LMArena Korean14041125
LMArena Russian14291224
LMArena Spanish14481271

Instruction Following Inkling leads

Inkling: 75.1 (#71), Magistral Medium: 66.0 (#211)

BenchmarkInklingMagistral Medium
LMArena Instruction Following14261254

Long Context Inkling leads

Inkling: 43.8 (#86), Magistral Medium: 39.3 (#183)

BenchmarkInklingMagistral Medium
LMArena Longer Query14341295

Writing & Preference Inkling leads

Inkling: 65.2 (#51), Magistral Medium: 46.3 (#219)

BenchmarkInklingMagistral Medium
LMArena Text14411255
LMArena Creative Writing13871245
LMArena Multi-Turn14361275
EQ-Bench Creative Writing1611—
EQ-Bench 41226—

Frequently asked questions

Is Inkling better than Magistral Medium?

Inkling is the stronger model overall, scoring 44.1 to 35.2 on the Noometry Index.

Which is cheaper, Inkling or Magistral Medium?

Inkling is cheaper. It lists at $1.87 per million input tokens and $4.68 per million output tokens; Magistral Medium lists at $2 and $5.

Is Inkling or Magistral Medium better for coding?

Magistral Medium scores higher on coding benchmarks: 39.1 versus 34.5 in the Noometry coding category.

Which has the bigger context window?

Magistral Medium does, with 262K tokens against 66K.

How many benchmarks do Inkling and Magistral Medium share?

21 benchmarks have published results for both models. Inkling has 41 scored results on Noometry and Magistral Medium has 22.

Related comparisons

Go deeper