Noometry

Model comparison

Magistral Medium vs MiniMax-M2.5

MiniMax-M2.5 is the stronger model overall, scoring 38.3 to 35.2 on the Noometry Index.

Last verified . 20 shared benchmarks.

Magistral Medium Mistral AI

35.2

Rank #227 Confirmed

MiniMax-M2.5 MiniMax

38.3

Rank #188 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Magistral Medium scores higher in 2 categories and MiniMax-M2.5 in 6 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in coding, where MiniMax-M2.5 leads 48.1 to 39.1.
  • The biggest single-benchmark swing is ARC-AGI-1: 6.1% for Magistral Medium and 63.7% for MiniMax-M2.5.
  • MiniMax-M2.5 is cheaper at $0.30 / $1.20 per million input/output tokens, against $2 / $5 for Magistral Medium.
  • Magistral Medium accepts more context: 262K tokens versus 205K.

Side by side

Magistral MediumMiniMax-M2.5
ProviderMistral AIMiniMax
Noometry Index35.238.3
Released2025-03-172026-02-12
WeightsOpenOpen
Context window262K205K
Max output16K131K
Input $ / M tokens$2$0.30
Output $ / M tokens$5$1.20
Results tracked2233

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax-M2.5 leads

Magistral Medium: 39.1 (#161), MiniMax-M2.5: 48.1 (#58)

BenchmarkMagistral MediumMiniMax-M2.5
LMArena Coding13191381
SWE-bench Verified (bash only)—75.8%
LMArena WebDev—1387
SWE-bench Multilingual—68.3%
SciCode39.2%—
ALE-Bench—618.17

Agentic & Tool Use Not comparable

Magistral Medium: —, MiniMax-M2.5: 30.4 (#77)

BenchmarkMagistral MediumMiniMax-M2.5
Terminal-Bench—42.7%
Vending-Bench 2—-23.16

Reasoning MiniMax-M2.5 leads

Magistral Medium: 8.6 (#348), MiniMax-M2.5: 17.5 (#292)

BenchmarkMagistral MediumMiniMax-M2.5
ARC-AGI-20%4.9%
Kagi LLM Benchmark16.2%55.2%
ARC-AGI-16.1%63.7%
LMArena Hard Prompts12671372
NYT Connections (extended)—16.8%
CritPt0.3%—
Epoch Capabilities Index—146.68

Math Magistral Medium leads

Magistral Medium: 35.1 (#189), MiniMax-M2.5: 26.9 (#253)

BenchmarkMagistral MediumMiniMax-M2.5
LMArena Math12501378
ProofBench—4%

Knowledge MiniMax-M2.5 leads

Magistral Medium: 33.5 (#202), MiniMax-M2.5: 39.2 (#135)

BenchmarkMagistral MediumMiniMax-M2.5
LMArena Expert12231379
Vectara Hallucination Rate—9.1%

Multilingual MiniMax-M2.5 leads

Magistral Medium: 39.6 (#224), MiniMax-M2.5: 47.1 (#152)

BenchmarkMagistral MediumMiniMax-M2.5
LMArena Non-English12321338
LMArena Chinese12271393
LMArena French12671362
LMArena German12481362
LMArena Japanese11751171
LMArena Korean11251232
LMArena Russian12241358
LMArena Spanish12711354

Instruction Following MiniMax-M2.5 leads

Magistral Medium: 66.0 (#211), MiniMax-M2.5: 71.5 (#148)

BenchmarkMagistral MediumMiniMax-M2.5
LMArena Instruction Following12541353

Long Context Magistral Medium leads

Magistral Medium: 39.3 (#183), MiniMax-M2.5: 37.5 (#216)

BenchmarkMagistral MediumMiniMax-M2.5
LMArena Longer Query12951366
CL-bench—11.4%
CL-bench Life—6.3%

Writing & Preference MiniMax-M2.5 leads

Magistral Medium: 46.3 (#219), MiniMax-M2.5: 53.9 (#153)

BenchmarkMagistral MediumMiniMax-M2.5
LMArena Text12551359
LMArena Creative Writing12451331
LMArena Multi-Turn12751364
EQ-Bench Creative Writing—1361

Frequently asked questions

Is Magistral Medium better than MiniMax-M2.5?

MiniMax-M2.5 is the stronger model overall, scoring 38.3 to 35.2 on the Noometry Index.

Which is cheaper, Magistral Medium or MiniMax-M2.5?

MiniMax-M2.5 is cheaper. It lists at $0.30 per million input tokens and $1.20 per million output tokens; Magistral Medium lists at $2 and $5.

Is Magistral Medium or MiniMax-M2.5 better for coding?

MiniMax-M2.5 scores higher on coding benchmarks: 48.1 versus 39.1 in the Noometry coding category.

Which has the bigger context window?

Magistral Medium does, with 262K tokens against 205K.

How many benchmarks do Magistral Medium and MiniMax-M2.5 share?

20 benchmarks have published results for both models. Magistral Medium has 22 scored results on Noometry and MiniMax-M2.5 has 33.

Related comparisons

Go deeper