Noometry

Model comparison

Claude Fable 5.1 vs Devstral 2

Claude Fable 5.1 has enough public results to be ranked (#2); Devstral 2 does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Claude Fable 5.1 Anthropic

69.0

Rank #2 Confirmed

Devstral 2 Mistral AI

36.1

Unranked Sparse

Summary

  • They share 1 benchmark with published results for both. Claude Fable 5.1 scores higher in 1 category and Devstral 2 in 0 categories; one gap is clear of the uncertainty.
  • The widest gap is in coding, where Claude Fable 5.1 leads 74.7 to 33.2.
  • Devstral 2 is cheaper at $0.40 / $2 per million input/output tokens, against $10 / $50 for Claude Fable 5.1.
  • Claude Fable 5.1 accepts more context: 1M tokens versus 262K.
  • Devstral 2 has downloadable open weights; the other is API-only.

Side by side

Claude Fable 5.1Devstral 2
ProviderAnthropicMistral AI
Noometry Index69.036.1
Released2026-09-012025-12-09
WeightsProprietaryOpen
Context window1M262K
Max output128K262K
Input $ / M tokens$10$0.40
Output $ / M tokens$50$2
Results tracked522

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Fable 5.1 leads

Claude Fable 5.1: 74.7 (#1), Devstral 2: 33.2 (#261)

BenchmarkClaude Fable 5.1Devstral 2
LMArena WebDev17441197
FrontierCode50.9%—
SWE-bench Verified (bash only)—53.8%
CursorBench51.8%—
FrontierSWE56.3%—
SciCode63.1%—
GSO88.2%—
WeirdML92.9%—
LMArena Coding1528—
MirrorCode73.3%—
ALE-Bench2,143—

Agentic & Tool Use Not comparable

Claude Fable 5.1: 50.7 (#5), Devstral 2: —

BenchmarkClaude Fable 5.1Devstral 2
APEX-Agents68.6%—
Remote Labor Index17.9%—
GDP.pdf29.6%—
Vending-Bench 25,422—

Reasoning Not comparable

Claude Fable 5.1: 76.7 (#7), Devstral 2: —

BenchmarkClaude Fable 5.1Devstral 2
ARC-AGI-290%—
NYT Connections (extended)90%—
ARC-AGI-197.5%—
CritPt31.1%—
Chess Puzzles47%—
EBR-Bench57.1%—
LMArena Hard Prompts1526—
Mystery Game Puzzles58%—
DTBench97.6%—
LMCA65.5%—
Epoch Capabilities Index164.7—

Math Not comparable

Claude Fable 5.1: 89.6 (#4), Devstral 2: —

BenchmarkClaude Fable 5.1Devstral 2
FrontierMath (Tiers 1-3)90.2%—
FrontierMath Tier 487.8%—
OTIS Mock AIME 2024-2025100%—
ProofBench100%—
LMArena Math1525—
FrontierMath Erdős0%—

Knowledge Not comparable

Claude Fable 5.1: 69.6 (#6), Devstral 2: —

BenchmarkClaude Fable 5.1Devstral 2
Humanity's Last Exam46.5%—
SimpleQA Verified70.8%—
LMArena Expert1535—

Multimodal Not comparable

Claude Fable 5.1: 53.9 (#4), Devstral 2: —

BenchmarkClaude Fable 5.1Devstral 2
LMArena Vision1318—
Blueprint-Bench 241.9%—
Furniture Assembly70%—
LMArena Document1513—

Multilingual Not comparable

Claude Fable 5.1: 59.1 (#3), Devstral 2: —

BenchmarkClaude Fable 5.1Devstral 2
LMArena Non-English1507—
LMArena Chinese1586—
LMArena French1525—
LMArena German1500—
LMArena Japanese1543—
LMArena Korean1534—
LMArena Russian1521—
LMArena Spanish1516—

Instruction Following Not comparable

Claude Fable 5.1: 79.2 (#6), Devstral 2: —

BenchmarkClaude Fable 5.1Devstral 2
LMArena Instruction Following1517—

Long Context Not comparable

Claude Fable 5.1: 46.7 (#20), Devstral 2: —

BenchmarkClaude Fable 5.1Devstral 2
LMArena Longer Query1522—

Writing & Preference Not comparable

Claude Fable 5.1: 79.2 (#2), Devstral 2: —

BenchmarkClaude Fable 5.1Devstral 2
LMArena Text1510—
LMArena Creative Writing1507—
EQ-Bench Creative Writing2162—
LMArena Multi-Turn1492—

Frequently asked questions

Is Claude Fable 5.1 better than Devstral 2?

Claude Fable 5.1 has enough public results to be ranked (#2); Devstral 2 does not yet, so treat this comparison as directional.

Which is cheaper, Claude Fable 5.1 or Devstral 2?

Devstral 2 is cheaper. It lists at $0.40 per million input tokens and $2 per million output tokens; Claude Fable 5.1 lists at $10 and $50.

Is Claude Fable 5.1 or Devstral 2 better for coding?

Claude Fable 5.1 scores higher on coding benchmarks: 74.7 versus 33.2 in the Noometry coding category.

Which has the bigger context window?

Claude Fable 5.1 does, with 1M tokens against 262K.

How many benchmarks do Claude Fable 5.1 and Devstral 2 share?

1 benchmark has published results for both models. Claude Fable 5.1 has 52 scored results on Noometry and Devstral 2 has 2.

Related comparisons

Go deeper