Noometry

Model comparison

Claude Sonnet 4.5 vs Mistral Medium

Claude Sonnet 4.5 is the stronger model overall, scoring 44.1 to 36.3 on the Noometry Index. Mistral Medium costs 2.0× less per token, which makes it the better buy when Claude Sonnet 4.5's lead doesn't matter for your workload.

Last verified . 32 shared benchmarks.

Claude Sonnet 4.5 Anthropic

44.1

Rank #81 Confirmed

Mistral Medium Mistral AI

36.3

Rank #218 Confirmed

Summary

  • They share 32 benchmarks with published results for both. Claude Sonnet 4.5 scores higher in 9 categories and Mistral Medium in 1 category; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Claude Sonnet 4.5 leads 48.4 to 25.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 77.8% for Claude Sonnet 4.5 and 32.2% for Mistral Medium.
  • Mistral Medium is cheaper at $1.50 / $7.50 per million input/output tokens, against $3 / $15 for Claude Sonnet 4.5.
  • Mistral Medium accepts more context: 262K tokens versus 200K.
  • Mistral Medium has downloadable open weights; the other is API-only.

Side by side

Claude Sonnet 4.5Mistral Medium
ProviderAnthropicMistral AI
Noometry Index44.136.3
Released2025-09-292023-12-11
WeightsProprietaryOpen
Context window200K262K
Max output64K262K
Input $ / M tokens$3$1.50
Output $ / M tokens$15$7.50
Results tracked7336

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 4.5 leads

Claude Sonnet 4.5: 47.3 (#61), Mistral Medium: 34.2 (#243)

BenchmarkClaude Sonnet 4.5Mistral Medium
SciCode44.7%40.2%
WeirdML47.7%43.7%
LMArena Coding14891434
ALE-Bench796.15763.98
SWE-bench Verified71.3%—
FrontierCode—8%
SWE-bench Verified (bash only)71.4%—
LMArena WebDev1393—
SWE-bench Multilingual67%—
GSO14.7%—
AlgoTune1.52—

Agentic & Tool Use Claude Sonnet 4.5 leads

Claude Sonnet 4.5: 38.3 (#32), Mistral Medium: 28.3 (#90)

BenchmarkClaude Sonnet 4.5Mistral Medium
Berkeley Function Calling Leaderboard73.2%37.7%
Terminal-Bench46.5%—
GDPval42.5%—
Remote Labor Index2.1%—
τ²-bench Airline72%—
τ²-bench Banking25.3%—
τ²-bench Retail72.4%—
τ²-bench Telecom84.9%—
Cybench60%—
DeepResearch Bench52.6%—
OSWorld62.9%—
LMArena Search1159—
METR Time Horizons67.4%—
Vending-Bench 23,839—

Reasoning Claude Sonnet 4.5 leads

Claude Sonnet 4.5: 26.9 (#125), Mistral Medium: 24.0 (#167)

BenchmarkClaude Sonnet 4.5Mistral Medium
Kagi LLM Benchmark57.9%50%
CritPt1.1%0%
LMArena Hard Prompts14621426
DTBench83.2%75.5%
LMCA38.8%26.1%
ARC-AGI-213.6%—
SimpleBench54.3%—
NYT Connections (extended)37.3%—
ARC-AGI-163.7%—
Chess Puzzles12%—
EnigmaEval6%—
EBR-Bench2.4%—
Mystery Game Puzzles17%—
Surface Evolver Bench—26.9%
Epoch Capabilities Index146.84—
ForecastBench61.9—

Math Claude Sonnet 4.5 leads

Claude Sonnet 4.5: 32.3 (#216), Mistral Medium: 28.1 (#245)

BenchmarkClaude Sonnet 4.5Mistral Medium
OTIS Mock AIME 2024-202577.8%32.2%
ProofBench19%9%
LMArena Math14491408
MATH Level 597.7%81.6%
FrontierMath (Feb 2025 set)15.2%0.3%
FrontierMath (Tiers 1-3)23.9%—
FrontierMath Tier 42.4%—
Omni-MATH55.3%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Claude Sonnet 4.5 leads

Claude Sonnet 4.5: 48.4 (#76), Mistral Medium: 25.0 (#265)

BenchmarkClaude Sonnet 4.5Mistral Medium
GPQA Diamond82.3%59.5%
Humanity's Last Exam13.7%4.5%
Vectara Hallucination Rate12%22.7%
LMArena Expert14821408
SimpleQA Verified30.7%—
MMLU-Pro86.9%—
GPQA (HELM)68.6%—

Multimodal Too close to call

Claude Sonnet 4.5: 34.8 (#89), Mistral Medium: 35.3 (#88)

BenchmarkClaude Sonnet 4.5Mistral Medium
LMArena Vision—1172
VPCT39.8%—
LMArena Document1450—

Multilingual Claude Sonnet 4.5 leads

Claude Sonnet 4.5: 53.4 (#69), Mistral Medium: 52.1 (#91)

BenchmarkClaude Sonnet 4.5Mistral Medium
LMArena Non-English14251408
LMArena Chinese14591447
LMArena French14581459
LMArena German14271432
LMArena Japanese13901378
LMArena Korean14031380
LMArena Russian14371411
LMArena Spanish14571433

Instruction Following Claude Sonnet 4.5 leads

Claude Sonnet 4.5: 75.0 (#78), Mistral Medium: 73.7 (#116)

BenchmarkClaude Sonnet 4.5Mistral Medium
LMArena Instruction Following14591398
IFEval85%—

Long Context Claude Sonnet 4.5 leads

Claude Sonnet 4.5: 45.2 (#46), Mistral Medium: 42.9 (#114)

BenchmarkClaude Sonnet 4.5Mistral Medium
LMArena Longer Query14761406

Writing & Preference Claude Sonnet 4.5 leads

Claude Sonnet 4.5: 66.5 (#34), Mistral Medium: 60.0 (#103)

BenchmarkClaude Sonnet 4.5Mistral Medium
LMArena Text14391424
LMArena Creative Writing14421391
LMArena Multi-Turn14651418
Short-Story Creative Writing—77.3%
EQ-Bench Creative Writing1678—
WildBench85.4%—

Frequently asked questions

Is Claude Sonnet 4.5 better than Mistral Medium?

Claude Sonnet 4.5 is the stronger model overall, scoring 44.1 to 36.3 on the Noometry Index. Mistral Medium costs 2.0× less per token, which makes it the better buy when Claude Sonnet 4.5's lead doesn't matter for your workload.

Which is cheaper, Claude Sonnet 4.5 or Mistral Medium?

Mistral Medium is cheaper. It lists at $1.50 per million input tokens and $7.50 per million output tokens; Claude Sonnet 4.5 lists at $3 and $15.

Is Claude Sonnet 4.5 or Mistral Medium better for coding?

Claude Sonnet 4.5 scores higher on coding benchmarks: 47.3 versus 34.2 in the Noometry coding category.

Which has the bigger context window?

Mistral Medium does, with 262K tokens against 200K.

How many benchmarks do Claude Sonnet 4.5 and Mistral Medium share?

32 benchmarks have published results for both models. Claude Sonnet 4.5 has 73 scored results on Noometry and Mistral Medium has 36.

Related comparisons

Go deeper