Model comparison

MiniMax-M2.5 vs Mistral Medium

MiniMax-M2.5 is the stronger model overall, scoring 38.3 to 36.3 on the Noometry Index.

Last verified . 21 shared benchmarks.

MiniMax-M2.5 MiniMax

38.3

Rank #188 Confirmed

Mistral Medium Mistral AI

36.3

Rank #218 Confirmed

Summary

  • They share 21 benchmarks with published results for both. MiniMax-M2.5 scores higher in 3 categories and Mistral Medium in 6 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where MiniMax-M2.5 leads 39.2 to 25.0.
  • The biggest single-benchmark swing is Vectara Hallucination Rate: 9.1% for MiniMax-M2.5 and 22.7% for Mistral Medium.
  • MiniMax-M2.5 is cheaper at $0.30 / $1.20 per million input/output tokens, against $1.50 / $7.50 for Mistral Medium.
  • Mistral Medium accepts more context: 262K tokens versus 205K.

Side by side

MiniMax-M2.5 and Mistral Medium specifications
MiniMax-M2.5Mistral Medium
ProviderMiniMaxMistral AI
Noometry Index38.336.3
Released2026-02-122023-12-11
WeightsOpenOpen
Context window205K262K
Max output131K262K
Input $ / M tokens$0.30$1.50
Output $ / M tokens$1.20$7.50
Results tracked3336

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax-M2.5 leads

MiniMax-M2.5: 48.1 (#58), Mistral Medium: 34.2 (#243)

Coding benchmarks
BenchmarkMiniMax-M2.5Mistral Medium
LMArena Coding13811434
ALE-Bench618.17763.98
FrontierCode—8%
SWE-bench Verified (bash only)75.8%—
LMArena WebDev1387—
SWE-bench Multilingual68.3%—
SciCode—40.2%
WeirdML—43.7%

Agentic & Tool Use MiniMax-M2.5 leads

MiniMax-M2.5: 30.4 (#77), Mistral Medium: 28.3 (#90)

Agentic & Tool Use benchmarks
BenchmarkMiniMax-M2.5Mistral Medium
Terminal-Bench42.7%—
Berkeley Function Calling Leaderboard—37.7%
Vending-Bench 2-23.16—

Reasoning Mistral Medium leads

MiniMax-M2.5: 17.5 (#292), Mistral Medium: 24.0 (#167)

Reasoning benchmarks
BenchmarkMiniMax-M2.5Mistral Medium
Kagi LLM Benchmark55.2%50%
LMArena Hard Prompts13721426
ARC-AGI-24.9%—
NYT Connections (extended)16.8%—
ARC-AGI-163.7%—
CritPt—0%
DTBench—75.5%
LMCA—26.1%
Surface Evolver Bench—26.9%
Epoch Capabilities Index146.68—

Math Mistral Medium leads

MiniMax-M2.5: 26.9 (#253), Mistral Medium: 28.1 (#245)

Math benchmarks
BenchmarkMiniMax-M2.5Mistral Medium
ProofBench4%9%
LMArena Math13781408
OTIS Mock AIME 2024-2025—32.2%
MATH Level 5—81.6%
FrontierMath (Feb 2025 set)—0.3%

Knowledge MiniMax-M2.5 leads

MiniMax-M2.5: 39.2 (#135), Mistral Medium: 25.0 (#265)

Knowledge benchmarks
BenchmarkMiniMax-M2.5Mistral Medium
Vectara Hallucination Rate9.1%22.7%
LMArena Expert13791408
GPQA Diamond—59.5%
Humanity's Last Exam—4.5%

Multimodal Not comparable

MiniMax-M2.5: —, Mistral Medium: 35.3 (#88)

Multimodal benchmarks
BenchmarkMiniMax-M2.5Mistral Medium
LMArena Vision—1172

Multilingual Mistral Medium leads

MiniMax-M2.5: 47.1 (#152), Mistral Medium: 52.1 (#91)

Multilingual benchmarks
BenchmarkMiniMax-M2.5Mistral Medium
LMArena Non-English13381408
LMArena Chinese13931447
LMArena French13621459
LMArena German13621432
LMArena Japanese11711378
LMArena Korean12321380
LMArena Russian13581411
LMArena Spanish13541433

Instruction Following Mistral Medium leads

MiniMax-M2.5: 71.5 (#148), Mistral Medium: 73.7 (#116)

Instruction Following benchmarks
BenchmarkMiniMax-M2.5Mistral Medium
LMArena Instruction Following13531398

Long Context Mistral Medium leads

MiniMax-M2.5: 37.5 (#216), Mistral Medium: 42.9 (#114)

Long Context benchmarks
BenchmarkMiniMax-M2.5Mistral Medium
LMArena Longer Query13661406
CL-bench11.4%—
CL-bench Life6.3%—

Writing & Preference Mistral Medium leads

MiniMax-M2.5: 53.9 (#153), Mistral Medium: 60.0 (#103)

Writing & Preference benchmarks
BenchmarkMiniMax-M2.5Mistral Medium
LMArena Text13591424
LMArena Creative Writing13311391
LMArena Multi-Turn13641418
Short-Story Creative Writing—77.3%
EQ-Bench Creative Writing1361—

Frequently asked questions

Is MiniMax-M2.5 better than Mistral Medium?

MiniMax-M2.5 is the stronger model overall, scoring 38.3 to 36.3 on the Noometry Index.

Which is cheaper, MiniMax-M2.5 or Mistral Medium?

MiniMax-M2.5 is cheaper. It lists at $0.30 per million input tokens and $1.20 per million output tokens; Mistral Medium lists at $1.50 and $7.50.

Is MiniMax-M2.5 or Mistral Medium better for coding?

MiniMax-M2.5 scores higher on coding benchmarks: 48.1 versus 34.2 in the Noometry coding category.

Which has the bigger context window?

Mistral Medium does, with 262K tokens against 205K.

How many benchmarks do MiniMax-M2.5 and Mistral Medium share?

21 benchmarks have published results for both models. MiniMax-M2.5 has 33 scored results on Noometry and Mistral Medium has 36.

Related comparisons

Go deeper