Noometry

Model comparison

Grok 4.5 vs Magistral Medium

Grok 4.5 is the stronger model overall, scoring 55.0 to 35.2 on the Noometry Index.

Last verified . 22 shared benchmarks.

Grok 4.5 xAI

55.0

Rank #25 Confirmed

Magistral Medium Mistral AI

35.2

Rank #227 Confirmed

Summary

  • They share 22 benchmarks with published results for both. Grok 4.5 scores higher in 8 categories and Magistral Medium in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.5 leads 56.1 to 8.6.
  • The biggest single-benchmark swing is ARC-AGI-1: 87.2% for Grok 4.5 and 6.1% for Magistral Medium.
  • Magistral Medium is cheaper at $2 / $5 per million input/output tokens, against $2 / $6 for Grok 4.5.
  • Grok 4.5 accepts more context: 500K tokens versus 262K.
  • Magistral Medium has downloadable open weights; the other is API-only.

Side by side

Grok 4.5Magistral Medium
ProviderxAIMistral AI
Noometry Index55.035.2
Released2026-07-082025-03-17
WeightsProprietaryOpen
Context window500K262K
Max output500K16K
Input $ / M tokens$2$2
Output $ / M tokens$6$5
Results tracked5222

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.5 leads

Grok 4.5: 52.2 (#35), Magistral Medium: 39.1 (#161)

BenchmarkGrok 4.5Magistral Medium
SciCode54.1%39.2%
LMArena Coding14741319
DeepSWE53.8%—
FrontierCode42.4%—
LMArena WebDev1553—
WeirdML46.4%—
ALE-Bench1,309—

Agentic & Tool Use Not comparable

Grok 4.5: 44.4 (#17), Magistral Medium: —

BenchmarkGrok 4.5Magistral Medium
APEX-Agents56.2%—
τ²-bench Banking47.9%—
PostTrainBench23.4%—
GBAEval65.4%—
GDP.pdf14%—
LMArena Search1213—
Vending-Bench 23,887—

Reasoning Grok 4.5 leads

Grok 4.5: 56.1 (#25), Magistral Medium: 8.6 (#348)

BenchmarkGrok 4.5Magistral Medium
ARC-AGI-252.6%0%
Kagi LLM Benchmark83.5%16.2%
ARC-AGI-187.2%6.1%
CritPt15.4%0.3%
LMArena Hard Prompts14621267
SimpleBench70%—
NYT Connections (extended)79.9%—
Chess Puzzles36%—
DTBench96.5%—
LMCA45.2%—
Surface Evolver Bench74.4%—
Epoch Capabilities Index153.92—

Math Grok 4.5 leads

Grok 4.5: 60.9 (#35), Magistral Medium: 35.1 (#189)

BenchmarkGrok 4.5Magistral Medium
LMArena Math14591250
FrontierMath (Tiers 1-3)57.2%—
FrontierMath Tier 424.4%—
OTIS Mock AIME 2024-202597.8%—
ProofBench31%—

Knowledge Grok 4.5 leads

Grok 4.5: 62.3 (#24), Magistral Medium: 33.5 (#202)

BenchmarkGrok 4.5Magistral Medium
LMArena Expert14661223
GPQA Diamond93.4%—
SimpleQA Verified48.3%—

Multimodal Not comparable

Grok 4.5: 37.6 (#72), Magistral Medium: —

BenchmarkGrok 4.5Magistral Medium
LMArena Vision1288—
Blueprint-Bench 227.3%—
Furniture Assembly22.5%—
LMArena Document1452—

Multilingual Grok 4.5 leads

Grok 4.5: 54.4 (#42), Magistral Medium: 39.6 (#224)

BenchmarkGrok 4.5Magistral Medium
LMArena Non-English14401232
LMArena Chinese14961227
LMArena French14561267
LMArena German14461248
LMArena Japanese14281175
LMArena Korean14041125
LMArena Russian14481224
LMArena Spanish14501271

Instruction Following Grok 4.5 leads

Grok 4.5: 76.0 (#48), Magistral Medium: 66.0 (#211)

BenchmarkGrok 4.5Magistral Medium
LMArena Instruction Following14461254

Long Context Grok 4.5 leads

Grok 4.5: 44.8 (#56), Magistral Medium: 39.3 (#183)

BenchmarkGrok 4.5Magistral Medium
LMArena Longer Query14631295

Writing & Preference Grok 4.5 leads

Grok 4.5: 65.8 (#42), Magistral Medium: 46.3 (#219)

BenchmarkGrok 4.5Magistral Medium
LMArena Text14481255
LMArena Creative Writing14421245
LMArena Multi-Turn14561275
EQ-Bench Creative Writing1579—

Frequently asked questions

Is Grok 4.5 better than Magistral Medium?

Grok 4.5 is the stronger model overall, scoring 55.0 to 35.2 on the Noometry Index.

Which is cheaper, Grok 4.5 or Magistral Medium?

Magistral Medium is cheaper. It lists at $2 per million input tokens and $5 per million output tokens; Grok 4.5 lists at $2 and $6.

Is Grok 4.5 or Magistral Medium better for coding?

Grok 4.5 scores higher on coding benchmarks: 52.2 versus 39.1 in the Noometry coding category.

Which has the bigger context window?

Grok 4.5 does, with 500K tokens against 262K.

How many benchmarks do Grok 4.5 and Magistral Medium share?

22 benchmarks have published results for both models. Grok 4.5 has 52 scored results on Noometry and Magistral Medium has 22.

Related comparisons

Go deeper