Noometry

Model comparison

Claude Fable 5.1 vs Devstral Medium

Claude Fable 5.1 has enough public results to be ranked (#2); Devstral Medium does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Claude Fable 5.1 Anthropic

69.0

Rank #2 Confirmed

Devstral Medium Mistral AI

30.1

Unranked Sparse

Summary

  • They share 1 benchmark with published results for both. Claude Fable 5.1 scores higher in 2 categories and Devstral Medium in 0 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Claude Fable 5.1 leads 76.7 to 21.1.
  • Devstral Medium is cheaper at $0.40 / $2 per million input/output tokens, against $10 / $50 for Claude Fable 5.1.
  • Claude Fable 5.1 accepts more context: 1M tokens versus 262K.
  • Devstral Medium has downloadable open weights; the other is API-only.

Side by side

Claude Fable 5.1Devstral Medium
ProviderAnthropicMistral AI
Noometry Index69.030.1
Released2026-09-012025-07-10
WeightsProprietaryOpen
Context window1M262K
Max output128K262K
Input $ / M tokens$10$0.40
Output $ / M tokens$50$2
Results tracked522

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Fable 5.1 leads

Claude Fable 5.1: 74.7 (#1), Devstral Medium: 24.3

BenchmarkClaude Fable 5.1Devstral Medium
LMArena WebDev17441076
FrontierCode50.9%—
CursorBench51.8%—
FrontierSWE56.3%—
SciCode63.1%—
GSO88.2%—
WeirdML92.9%—
LMArena Coding1528—
MirrorCode73.3%—
ALE-Bench2,143—

Agentic & Tool Use Not comparable

Claude Fable 5.1: 50.7 (#5), Devstral Medium: —

BenchmarkClaude Fable 5.1Devstral Medium
APEX-Agents68.6%—
Remote Labor Index17.9%—
GDP.pdf29.6%—
Vending-Bench 25,422—

Reasoning Claude Fable 5.1 leads

Claude Fable 5.1: 76.7 (#7), Devstral Medium: 21.1

BenchmarkClaude Fable 5.1Devstral Medium
ARC-AGI-290%—
Kagi LLM Benchmark—37.7%
NYT Connections (extended)90%—
ARC-AGI-197.5%—
CritPt31.1%—
Chess Puzzles47%—
EBR-Bench57.1%—
LMArena Hard Prompts1526—
Mystery Game Puzzles58%—
DTBench97.6%—
LMCA65.5%—
Epoch Capabilities Index164.7—

Math Not comparable

Claude Fable 5.1: 89.6 (#4), Devstral Medium: —

BenchmarkClaude Fable 5.1Devstral Medium
FrontierMath (Tiers 1-3)90.2%—
FrontierMath Tier 487.8%—
OTIS Mock AIME 2024-2025100%—
ProofBench100%—
LMArena Math1525—
FrontierMath Erdős0%—

Knowledge Not comparable

Claude Fable 5.1: 69.6 (#6), Devstral Medium: —

BenchmarkClaude Fable 5.1Devstral Medium
Humanity's Last Exam46.5%—
SimpleQA Verified70.8%—
LMArena Expert1535—

Multimodal Not comparable

Claude Fable 5.1: 53.9 (#4), Devstral Medium: —

BenchmarkClaude Fable 5.1Devstral Medium
LMArena Vision1318—
Blueprint-Bench 241.9%—
Furniture Assembly70%—
LMArena Document1513—

Multilingual Not comparable

Claude Fable 5.1: 59.1 (#3), Devstral Medium: —

BenchmarkClaude Fable 5.1Devstral Medium
LMArena Non-English1507—
LMArena Chinese1586—
LMArena French1525—
LMArena German1500—
LMArena Japanese1543—
LMArena Korean1534—
LMArena Russian1521—
LMArena Spanish1516—

Instruction Following Not comparable

Claude Fable 5.1: 79.2 (#6), Devstral Medium: —

BenchmarkClaude Fable 5.1Devstral Medium
LMArena Instruction Following1517—

Long Context Not comparable

Claude Fable 5.1: 46.7 (#20), Devstral Medium: —

BenchmarkClaude Fable 5.1Devstral Medium
LMArena Longer Query1522—

Writing & Preference Not comparable

Claude Fable 5.1: 79.2 (#2), Devstral Medium: —

BenchmarkClaude Fable 5.1Devstral Medium
LMArena Text1510—
LMArena Creative Writing1507—
EQ-Bench Creative Writing2162—
LMArena Multi-Turn1492—

Frequently asked questions

Is Claude Fable 5.1 better than Devstral Medium?

Claude Fable 5.1 has enough public results to be ranked (#2); Devstral Medium does not yet, so treat this comparison as directional.

Which is cheaper, Claude Fable 5.1 or Devstral Medium?

Devstral Medium is cheaper. It lists at $0.40 per million input tokens and $2 per million output tokens; Claude Fable 5.1 lists at $10 and $50.

Is Claude Fable 5.1 or Devstral Medium better for coding?

Claude Fable 5.1 scores higher on coding benchmarks: 74.7 versus 24.3 in the Noometry coding category.

Which has the bigger context window?

Claude Fable 5.1 does, with 1M tokens against 262K.

How many benchmarks do Claude Fable 5.1 and Devstral Medium share?

1 benchmark has published results for both models. Claude Fable 5.1 has 52 scored results on Noometry and Devstral Medium has 2.

Related comparisons

Go deeper