Noometry

Model comparison

Inkling-Small vs Mistral Medium 3.5

Inkling-Small is the stronger model overall, scoring 46.5 to 40.2 on the Noometry Index.

Last verified . 19 shared benchmarks.

Inkling-Small Thinking Machines Lab

46.5

Rank #63 Confirmed

Mistral Medium 3.5 Mistral AI

40.2

Rank #152 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Inkling-Small scores higher in 6 categories and Mistral Medium 3.5 in 3 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Inkling-Small leads 38.6 to 17.3.
  • Inkling-Small is cheaper at $0.45 / $1.20 per million input/output tokens, against $1.50 / $7.50 for Mistral Medium 3.5.
  • Inkling-Small accepts more context: 524K tokens versus 262K.

Side by side

Inkling-SmallMistral Medium 3.5
ProviderThinking Machines LabMistral AI
Noometry Index46.540.2
Released2026-07-15—
WeightsOpenOpen
Context window524K262K
Max output1.05M210K
Input $ / M tokens$0.45$1.50
Output $ / M tokens$1.20$7.50
Results tracked3322

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Inkling-Small leads

Inkling-Small: 43.6 (#85), Mistral Medium 3.5: 36.0 (#213)

BenchmarkInkling-SmallMistral Medium 3.5
LMArena WebDev14091264
LMArena Coding14511461
SciCode48.7%—

Reasoning Inkling-Small leads

Inkling-Small: 38.6 (#63), Mistral Medium 3.5: 17.3 (#295)

BenchmarkInkling-SmallMistral Medium 3.5
LMArena Hard Prompts14231436
Epoch Capabilities Index150.15141.35
ARC-AGI-240.1%—
Kagi LLM Benchmark—41.4%
NYT Connections (extended)—12.9%
ARC-AGI-184%—
CritPt8.3%—
Chess Puzzles18%—
Mystery Game Puzzles6%—

Math Inkling-Small leads

Inkling-Small: 45.1 (#77), Mistral Medium 3.5: 39.1 (#113)

BenchmarkInkling-SmallMistral Medium 3.5
LMArena Math14591431
FrontierMath (Tiers 1-3)46.3%—
FrontierMath Tier 417.1%—
OTIS Mock AIME 2024-202590%—
ProofBench6%—

Knowledge Inkling-Small leads

Inkling-Small: 48.2 (#77), Mistral Medium 3.5: 40.0 (#126)

BenchmarkInkling-SmallMistral Medium 3.5
LMArena Expert14421432
GPQA Diamond88.5%—
SimpleQA Verified19.1%—

Multimodal Too close to call

Inkling-Small: 39.1 (#62), Mistral Medium 3.5: 38.3 (#65)

BenchmarkInkling-SmallMistral Medium 3.5
LMArena Vision12351223

Multilingual Too close to call

Inkling-Small: 51.7 (#104), Mistral Medium 3.5: 51.9 (#100)

BenchmarkInkling-SmallMistral Medium 3.5
LMArena Non-English14021404
LMArena Chinese14651442
LMArena French14361448
LMArena German14051451
LMArena Korean13631385
LMArena Russian13911395
LMArena Spanish14281409
LMArena Japanese1405—

Instruction Following Too close to call

Inkling-Small: 73.8 (#114), Mistral Medium 3.5: 74.6 (#90)

BenchmarkInkling-SmallMistral Medium 3.5
LMArena Instruction Following13991415

Long Context Too close to call

Inkling-Small: 42.7 (#118), Mistral Medium 3.5: 43.2 (#103)

BenchmarkInkling-SmallMistral Medium 3.5
LMArena Longer Query14011415

Writing & Preference Inkling-Small leads

Inkling-Small: 59.6 (#107), Mistral Medium 3.5: 58.5 (#117)

BenchmarkInkling-SmallMistral Medium 3.5
LMArena Text14141421
LMArena Creative Writing13311374
LMArena Multi-Turn14181423
EQ-Bench Creative Writing1491—
EQ-Bench 4—993

Frequently asked questions

Is Inkling-Small better than Mistral Medium 3.5?

Inkling-Small is the stronger model overall, scoring 46.5 to 40.2 on the Noometry Index.

Which is cheaper, Inkling-Small or Mistral Medium 3.5?

Inkling-Small is cheaper. It lists at $0.45 per million input tokens and $1.20 per million output tokens; Mistral Medium 3.5 lists at $1.50 and $7.50.

Is Inkling-Small or Mistral Medium 3.5 better for coding?

Inkling-Small scores higher on coding benchmarks: 43.6 versus 36.0 in the Noometry coding category.

Which has the bigger context window?

Inkling-Small does, with 524K tokens against 262K.

How many benchmarks do Inkling-Small and Mistral Medium 3.5 share?

19 benchmarks have published results for both models. Inkling-Small has 33 scored results on Noometry and Mistral Medium 3.5 has 22.

Related comparisons

Go deeper