Noometry

Model comparison

Claude Sonnet 4.6 vs Mistral Medium

Claude Sonnet 4.6 is the stronger model overall, scoring 50.3 to 36.3 on the Noometry Index. Mistral Medium costs 2.0× less per token, which makes it the better buy when Claude Sonnet 4.6's lead doesn't matter for your workload.

Last verified . 30 shared benchmarks.

Claude Sonnet 4.6 Anthropic

50.3

Rank #50 Confirmed

Mistral Medium Mistral AI

36.3

Rank #218 Confirmed

Summary

  • They share 30 benchmarks with published results for both. Claude Sonnet 4.6 scores higher in 10 categories and Mistral Medium in 0 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Claude Sonnet 4.6 leads 51.7 to 25.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 85.8% for Claude Sonnet 4.6 and 32.2% for Mistral Medium.
  • Mistral Medium is cheaper at $1.50 / $7.50 per million input/output tokens, against $3 / $15 for Claude Sonnet 4.6.
  • Claude Sonnet 4.6 accepts more context: 1M tokens versus 262K.
  • Mistral Medium has downloadable open weights; the other is API-only.

Side by side

Claude Sonnet 4.6Mistral Medium
ProviderAnthropicMistral AI
Noometry Index50.336.3
Released2026-02-172023-12-11
WeightsProprietaryOpen
Context window1M262K
Max output128K262K
Input $ / M tokens$3$1.50
Output $ / M tokens$15$7.50
Results tracked5736

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 46.3 (#67), Mistral Medium: 34.2 (#243)

BenchmarkClaude Sonnet 4.6Mistral Medium
FrontierCode24.3%8%
SciCode46.8%40.2%
WeirdML66.1%43.7%
LMArena Coding15041434
ALE-Bench1,327763.98
SWE-bench Verified75.2%—
DeepSWE29.9%—
LMArena WebDev1522—

Agentic & Tool Use Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 39.1 (#28), Mistral Medium: 28.3 (#90)

BenchmarkClaude Sonnet 4.6Mistral Medium
Terminal-Bench53.4%—
APEX-Agents43%—
Berkeley Function Calling Leaderboard—37.7%
OSWorld 2.09.3%—
DeepResearch Bench54.9%—
OSWorld72.1%—
ExploitBench23.6%—
GBAEval48.8%—
GDP.pdf18%—
LMArena Search1221—
Vending-Bench 27,204—

Reasoning Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 46.1 (#45), Mistral Medium: 24.0 (#167)

BenchmarkClaude Sonnet 4.6Mistral Medium
CritPt3.1%0%
LMArena Hard Prompts14841426
DTBench89.9%75.5%
LMCA46.5%26.1%
ARC-AGI-260.4%—
Kagi LLM Benchmark—50%
NYT Connections (extended)80.9%—
ARC-AGI-186.5%—
Chess Puzzles13%—
Thematic Generalization76.3%—
Mystery Game Puzzles16%—
Surface Evolver Bench—26.9%
Epoch Capabilities Index152.24—
ForecastBench62—

Math Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 52.9 (#49), Mistral Medium: 28.1 (#245)

BenchmarkClaude Sonnet 4.6Mistral Medium
OTIS Mock AIME 2024-202585.8%32.2%
ProofBench45%9%
LMArena Math14621408
FrontierMath (Feb 2025 set)32.4%0.3%
MATH Level 5—81.6%
FrontierMath Tier 4 (v1)8.3%—

Knowledge Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 51.7 (#65), Mistral Medium: 25.0 (#265)

BenchmarkClaude Sonnet 4.6Mistral Medium
GPQA Diamond87.4%59.5%
Vectara Hallucination Rate10.6%22.7%
LMArena Expert15001408
Humanity's Last Exam—4.5%
SimpleQA Verified35.5%—

Multimodal Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 38.0 (#68), Mistral Medium: 35.3 (#88)

BenchmarkClaude Sonnet 4.6Mistral Medium
LMArena Vision12831172
Blueprint-Bench 26.7%—
LMArena Document1482—

Multilingual Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 54.4 (#41), Mistral Medium: 52.1 (#91)

BenchmarkClaude Sonnet 4.6Mistral Medium
LMArena Non-English14401408
LMArena Chinese14911447
LMArena French14651459
LMArena German14281432
LMArena Japanese14201378
LMArena Korean14111380
LMArena Russian14401411
LMArena Spanish14641433

Instruction Following Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 77.4 (#25), Mistral Medium: 73.7 (#116)

BenchmarkClaude Sonnet 4.6Mistral Medium
LMArena Instruction Following14751398

Long Context Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 45.3 (#44), Mistral Medium: 42.9 (#114)

BenchmarkClaude Sonnet 4.6Mistral Medium
LMArena Longer Query14791406

Writing & Preference Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 70.2 (#22), Mistral Medium: 60.0 (#103)

BenchmarkClaude Sonnet 4.6Mistral Medium
LMArena Text14581424
LMArena Creative Writing14351391
LMArena Multi-Turn14641418
Short-Story Creative Writing—77.3%
EQ-Bench Creative Writing1810—
EQ-Bench 41207—

Frequently asked questions

Is Claude Sonnet 4.6 better than Mistral Medium?

Claude Sonnet 4.6 is the stronger model overall, scoring 50.3 to 36.3 on the Noometry Index. Mistral Medium costs 2.0× less per token, which makes it the better buy when Claude Sonnet 4.6's lead doesn't matter for your workload.

Which is cheaper, Claude Sonnet 4.6 or Mistral Medium?

Mistral Medium is cheaper. It lists at $1.50 per million input tokens and $7.50 per million output tokens; Claude Sonnet 4.6 lists at $3 and $15.

Is Claude Sonnet 4.6 or Mistral Medium better for coding?

Claude Sonnet 4.6 scores higher on coding benchmarks: 46.3 versus 34.2 in the Noometry coding category.

Which has the bigger context window?

Claude Sonnet 4.6 does, with 1M tokens against 262K.

How many benchmarks do Claude Sonnet 4.6 and Mistral Medium share?

30 benchmarks have published results for both models. Claude Sonnet 4.6 has 57 scored results on Noometry and Mistral Medium has 36.

Related comparisons

Go deeper