Noometry

Model comparison

Claude Opus 4.8 vs Mistral Medium

Claude Opus 4.8 is the stronger model overall, scoring 60.7 to 36.3 on the Noometry Index. Mistral Medium costs 3.3× less per token, which makes it the better buy when Claude Opus 4.8's lead doesn't matter for your workload.

Last verified . 31 shared benchmarks.

Claude Opus 4.8 Anthropic

60.7

Rank #13 Confirmed

Mistral Medium Mistral AI

36.3

Rank #218 Confirmed

Summary

  • They share 31 benchmarks with published results for both. Claude Opus 4.8 scores higher in 10 categories and Mistral Medium in 0 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Opus 4.8 leads 78.4 to 28.1.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 98.3% for Claude Opus 4.8 and 32.2% for Mistral Medium.
  • Mistral Medium is cheaper at $1.50 / $7.50 per million input/output tokens, against $5 / $25 for Claude Opus 4.8.
  • Claude Opus 4.8 accepts more context: 1M tokens versus 262K.
  • Mistral Medium has downloadable open weights; the other is API-only.

Side by side

Claude Opus 4.8Mistral Medium
ProviderAnthropicMistral AI
Noometry Index60.736.3
Released2026-05-282023-12-11
WeightsProprietaryOpen
Context window1M262K
Max output128K262K
Input $ / M tokens$5$1.50
Output $ / M tokens$25$7.50
Results tracked6536

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4.8 leads

Claude Opus 4.8: 59.9 (#12), Mistral Medium: 34.2 (#243)

BenchmarkClaude Opus 4.8Mistral Medium
FrontierCode46.5%8%
SciCode53.5%40.2%
WeirdML82.9%43.7%
LMArena Coding14901434
ALE-Bench1,564763.98
DeepSWE59%—
LMArena WebDev1556—
GSO47.1%—

Agentic & Tool Use Claude Opus 4.8 leads

Claude Opus 4.8: 47.6 (#11), Mistral Medium: 28.3 (#90)

BenchmarkClaude Opus 4.8Mistral Medium
APEX-Agents48.9%—
Berkeley Function Calling Leaderboard—37.7%
OSWorld 2.020.6%—
Remote Labor Index8.3%—
τ²-bench Banking39.7%—
DeepResearch Bench50.2%—
PostTrainBench33.8%—
GBAEval70.9%—
GDP.pdf24%—
LMArena Search1204—
Vending-Bench 25,787—

Reasoning Claude Opus 4.8 leads

Claude Opus 4.8: 64.7 (#16), Mistral Medium: 24.0 (#167)

BenchmarkClaude Opus 4.8Mistral Medium
Kagi LLM Benchmark88.8%50%
CritPt20.9%0%
LMArena Hard Prompts14821426
DTBench94.9%75.5%
LMCA57.5%26.1%
Surface Evolver Bench87.5%26.9%
ARC-AGI-272.1%—
SimpleBench64.8%—
NYT Connections (extended)91.1%—
ARC-AGI-192.5%—
Chess Puzzles34%—
EnigmaEval23.5%—
EBR-Bench28.6%—
Mystery Game Puzzles36%—
Bench to the Future 30.14—
Epoch Capabilities Index158.21—
ForecastBench59.9—

Math Claude Opus 4.8 leads

Claude Opus 4.8: 78.4 (#13), Mistral Medium: 28.1 (#245)

BenchmarkClaude Opus 4.8Mistral Medium
OTIS Mock AIME 2024-202598.3%32.2%
ProofBench69%9%
LMArena Math14871408
FrontierMath (Feb 2025 set)47.2%0.3%
FrontierMath (Tiers 1-3)80%—
FrontierMath Tier 456.1%—
MathArena Final-Answer Competitions91.8%—
MATH Level 5—81.6%
FrontierMath Tier 4 (v1)31.3%—

Knowledge Claude Opus 4.8 leads

Claude Opus 4.8: 61.3 (#29), Mistral Medium: 25.0 (#265)

BenchmarkClaude Opus 4.8Mistral Medium
GPQA Diamond91%59.5%
LMArena Expert15021408
Humanity's Last Exam—4.5%
SimpleQA Verified53%—
Vectara Hallucination Rate—22.7%

Multimodal Claude Opus 4.8 leads

Claude Opus 4.8: 42.9 (#26), Mistral Medium: 35.3 (#88)

BenchmarkClaude Opus 4.8Mistral Medium
LMArena Vision12941172
Blueprint-Bench 214.5%—
Furniture Assembly42.5%—
LMArena Document1475—

Multilingual Claude Opus 4.8 leads

Claude Opus 4.8: 55.2 (#33), Mistral Medium: 52.1 (#91)

BenchmarkClaude Opus 4.8Mistral Medium
LMArena Non-English14501408
LMArena Chinese15071447
LMArena French14811459
LMArena German14721432
LMArena Japanese14401378
LMArena Korean14321380
LMArena Russian14741411
LMArena Spanish14661433

Instruction Following Claude Opus 4.8 leads

Claude Opus 4.8: 77.4 (#24), Mistral Medium: 73.7 (#116)

BenchmarkClaude Opus 4.8Mistral Medium
LMArena Instruction Following14761398

Long Context Claude Opus 4.8 leads

Claude Opus 4.8: 45.4 (#35), Mistral Medium: 42.9 (#114)

BenchmarkClaude Opus 4.8Mistral Medium
LMArena Longer Query14831406

Writing & Preference Claude Opus 4.8 leads

Claude Opus 4.8: 72.0 (#16), Mistral Medium: 60.0 (#103)

BenchmarkClaude Opus 4.8Mistral Medium
LMArena Text14611424
LMArena Creative Writing14541391
LMArena Multi-Turn14761418
Short-Story Creative Writing—77.3%
EQ-Bench Creative Writing1840—
EQ-Bench 41281—

Frequently asked questions

Is Claude Opus 4.8 better than Mistral Medium?

Claude Opus 4.8 is the stronger model overall, scoring 60.7 to 36.3 on the Noometry Index. Mistral Medium costs 3.3× less per token, which makes it the better buy when Claude Opus 4.8's lead doesn't matter for your workload.

Which is cheaper, Claude Opus 4.8 or Mistral Medium?

Mistral Medium is cheaper. It lists at $1.50 per million input tokens and $7.50 per million output tokens; Claude Opus 4.8 lists at $5 and $25.

Is Claude Opus 4.8 or Mistral Medium better for coding?

Claude Opus 4.8 scores higher on coding benchmarks: 59.9 versus 34.2 in the Noometry coding category.

Which has the bigger context window?

Claude Opus 4.8 does, with 1M tokens against 262K.

How many benchmarks do Claude Opus 4.8 and Mistral Medium share?

31 benchmarks have published results for both models. Claude Opus 4.8 has 65 scored results on Noometry and Mistral Medium has 36.

Related comparisons

Go deeper