Model comparison

Claude Haiku 5.5 vs Magistral Medium

Claude Haiku 5.5 is the stronger model overall, scoring 49.5 to 35.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude Haiku 5.5 Anthropic

49.5

Rank #52 Confirmed

Magistral Medium Mistral AI

35.2

Rank #227 Confirmed

Summary

  • The widest gap is in math, where Claude Haiku 5.5 leads 73.6 to 35.1.
  • Claude Haiku 5.5 is cheaper at $0.10 / $0.50 per million input/output tokens, against $2 / $5 for Magistral Medium.
  • Claude Haiku 5.5 accepts more context: 1M tokens versus 262K.
  • Magistral Medium has downloadable open weights; the other is API-only.

Side by side

Claude Haiku 5.5 and Magistral Medium specifications
Claude Haiku 5.5Magistral Medium
ProviderAnthropicMistral AI
Noometry Index49.535.2
Released2026-10-072025-03-17
WeightsProprietaryOpen
Context window1M262K
Max output128K16K
Input $ / M tokens$0.10$2
Output $ / M tokens$0.50$5
Results tracked922

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Haiku 5.5 leads

Claude Haiku 5.5: 49.2 (#50), Magistral Medium: 39.1 (#161)

Coding benchmarks
BenchmarkClaude Haiku 5.5Magistral Medium
LMArena WebDev1587—
SciCode—39.2%
LMArena Coding—1319

Reasoning Claude Haiku 5.5 leads

Claude Haiku 5.5: 35.2 (#69), Magistral Medium: 8.6 (#348)

Reasoning benchmarks
BenchmarkClaude Haiku 5.5Magistral Medium
ARC-AGI-2—0%
Kagi LLM Benchmark—16.2%
NYT Connections (extended)65.7%—
ARC-AGI-1—6.1%
CritPt—0.3%
LMArena Hard Prompts—1267
Mystery Game Puzzles30%—

Math Claude Haiku 5.5 leads

Claude Haiku 5.5: 73.6 (#18), Magistral Medium: 35.1 (#189)

Math benchmarks
BenchmarkClaude Haiku 5.5Magistral Medium
FrontierMath (Tiers 1-3)75.1%—
FrontierMath Tier 446.3%—
OTIS Mock AIME 2024-202598.9%—
LMArena Math—1250

Knowledge Claude Haiku 5.5 leads

Claude Haiku 5.5: 50.8 (#70), Magistral Medium: 33.5 (#202)

Knowledge benchmarks
BenchmarkClaude Haiku 5.5Magistral Medium
GPQA Diamond89.6%—
SimpleQA Verified23.8%—
LMArena Expert—1223

Multimodal Not comparable

Claude Haiku 5.5: 43.7 (#21), Magistral Medium: —

Multimodal benchmarks
BenchmarkClaude Haiku 5.5Magistral Medium
Furniture Assembly47.5%—

Multilingual Not comparable

Claude Haiku 5.5: —, Magistral Medium: 39.6 (#224)

Multilingual benchmarks
BenchmarkClaude Haiku 5.5Magistral Medium
LMArena Non-English—1232
LMArena Chinese—1227
LMArena French—1267
LMArena German—1248
LMArena Japanese—1175
LMArena Korean—1125
LMArena Russian—1224
LMArena Spanish—1271

Instruction Following Not comparable

Claude Haiku 5.5: —, Magistral Medium: 66.0 (#211)

Instruction Following benchmarks
BenchmarkClaude Haiku 5.5Magistral Medium
LMArena Instruction Following—1254

Long Context Not comparable

Claude Haiku 5.5: —, Magistral Medium: 39.3 (#183)

Long Context benchmarks
BenchmarkClaude Haiku 5.5Magistral Medium
LMArena Longer Query—1295

Writing & Preference Not comparable

Claude Haiku 5.5: —, Magistral Medium: 46.3 (#219)

Writing & Preference benchmarks
BenchmarkClaude Haiku 5.5Magistral Medium
LMArena Text—1255
LMArena Creative Writing—1245
LMArena Multi-Turn—1275

Frequently asked questions

Is Claude Haiku 5.5 better than Magistral Medium?

Claude Haiku 5.5 is the stronger model overall, scoring 49.5 to 35.2 on the Noometry Index.

Which is cheaper, Claude Haiku 5.5 or Magistral Medium?

Claude Haiku 5.5 is cheaper. It lists at $0.10 per million input tokens and $0.50 per million output tokens; Magistral Medium lists at $2 and $5.

Is Claude Haiku 5.5 or Magistral Medium better for coding?

Claude Haiku 5.5 scores higher on coding benchmarks: 49.2 versus 39.1 in the Noometry coding category.

Which has the bigger context window?

Claude Haiku 5.5 does, with 1M tokens against 262K.

How many benchmarks do Claude Haiku 5.5 and Magistral Medium share?

0 benchmarks have published results for both models. Claude Haiku 5.5 has 9 scored results on Noometry and Magistral Medium has 22.

Related comparisons

Go deeper