Model comparison

Claude Haiku 5.5 vs Mistral Small 3.1

Claude Haiku 5.5 is the stronger model overall, scoring 49.5 to 31.7 on the Noometry Index.

Last verified . 2 shared benchmarks.

Claude Haiku 5.5 Anthropic

49.5

Rank #52 Confirmed

Mistral Small 3.1 Mistral AI

31.7

Rank #269 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Claude Haiku 5.5 scores higher in 5 categories and Mistral Small 3.1 in 0 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Haiku 5.5 leads 73.6 to 14.7.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 98.9% for Claude Haiku 5.5 and 3.9% for Mistral Small 3.1.
  • Claude Haiku 5.5 is cheaper at $0.10 / $0.50 per million input/output tokens, against $0.35 / $0.56 for Mistral Small 3.1.
  • Claude Haiku 5.5 accepts more context: 1M tokens versus 128K.
  • Mistral Small 3.1 has downloadable open weights; the other is API-only.

Side by side

Claude Haiku 5.5 and Mistral Small 3.1 specifications
Claude Haiku 5.5Mistral Small 3.1
ProviderAnthropicMistral AI
Noometry Index49.531.7
Released2026-10-072025-03-17
WeightsProprietaryOpen
Context window1M128K
Max output128K102K
Input $ / M tokens$0.10$0.35
Output $ / M tokens$0.50$0.56
Results tracked928

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Haiku 5.5 leads

Claude Haiku 5.5: 49.2 (#50), Mistral Small 3.1: 38.3 (#179)

Coding benchmarks
BenchmarkClaude Haiku 5.5Mistral Small 3.1
LMArena WebDev1587—
LMArena Coding—1309

Reasoning Claude Haiku 5.5 leads

Claude Haiku 5.5: 35.2 (#69), Mistral Small 3.1: 19.7 (#254)

Reasoning benchmarks
BenchmarkClaude Haiku 5.5Mistral Small 3.1
NYT Connections (extended)65.7%—
Chess Puzzles—1%
LMArena Hard Prompts—1278
Mystery Game Puzzles30%—
Epoch Capabilities Index—127.48

Math Claude Haiku 5.5 leads

Claude Haiku 5.5: 73.6 (#18), Mistral Small 3.1: 14.7 (#301)

Math benchmarks
BenchmarkClaude Haiku 5.5Mistral Small 3.1
OTIS Mock AIME 2024-202598.9%3.9%
FrontierMath (Tiers 1-3)75.1%—
FrontierMath Tier 446.3%—
Omni-MATH—24.8%
LMArena Math—1262

Knowledge Claude Haiku 5.5 leads

Claude Haiku 5.5: 50.8 (#70), Mistral Small 3.1: 22.6 (#271)

Knowledge benchmarks
BenchmarkClaude Haiku 5.5Mistral Small 3.1
GPQA Diamond89.6%41.9%
SimpleQA Verified23.8%—
MMLU-Pro—61%
GPQA (HELM)—39.2%
LMArena Expert—1257

Multimodal Claude Haiku 5.5 leads

Claude Haiku 5.5: 43.7 (#21), Mistral Small 3.1: 33.2 (#99)

Multimodal benchmarks
BenchmarkClaude Haiku 5.5Mistral Small 3.1
LMArena Vision—1136
Furniture Assembly47.5%—

Multilingual Not comparable

Claude Haiku 5.5: —, Mistral Small 3.1: 41.2 (#209)

Multilingual benchmarks
BenchmarkClaude Haiku 5.5Mistral Small 3.1
LMArena Non-English—1255
LMArena Chinese—1253
LMArena French—1273
LMArena German—1266
LMArena Japanese—1208
LMArena Korean—1206
LMArena Russian—1263
LMArena Spanish—1283

Instruction Following Not comparable

Claude Haiku 5.5: —, Mistral Small 3.1: 63.6 (#230)

Instruction Following benchmarks
BenchmarkClaude Haiku 5.5Mistral Small 3.1
IFEval—75%
LMArena Instruction Following—1264

Long Context Not comparable

Claude Haiku 5.5: —, Mistral Small 3.1: 39.5 (#178)

Long Context benchmarks
BenchmarkClaude Haiku 5.5Mistral Small 3.1
LMArena Longer Query—1299

Writing & Preference Not comparable

Claude Haiku 5.5: —, Mistral Small 3.1: 37.0 (#259)

Writing & Preference benchmarks
BenchmarkClaude Haiku 5.5Mistral Small 3.1
LMArena Text—1277
LMArena Creative Writing—1253
EQ-Bench Creative Writing—761
WildBench—78.8%
LMArena Multi-Turn—1270

Frequently asked questions

Is Claude Haiku 5.5 better than Mistral Small 3.1?

Claude Haiku 5.5 is the stronger model overall, scoring 49.5 to 31.7 on the Noometry Index.

Which is cheaper, Claude Haiku 5.5 or Mistral Small 3.1?

Claude Haiku 5.5 is cheaper. It lists at $0.10 per million input tokens and $0.50 per million output tokens; Mistral Small 3.1 lists at $0.35 and $0.56.

Is Claude Haiku 5.5 or Mistral Small 3.1 better for coding?

Claude Haiku 5.5 scores higher on coding benchmarks: 49.2 versus 38.3 in the Noometry coding category.

Which has the bigger context window?

Claude Haiku 5.5 does, with 1M tokens against 128K.

How many benchmarks do Claude Haiku 5.5 and Mistral Small 3.1 share?

2 benchmarks have published results for both models. Claude Haiku 5.5 has 9 scored results on Noometry and Mistral Small 3.1 has 28.

Related comparisons

Go deeper