Noometry

Model comparison

Grok 4 Fast vs Mistral Medium

Grok 4 Fast is the stronger model overall, scoring 39.4 to 36.3 on the Noometry Index.

Last verified . 21 shared benchmarks.

Grok 4 Fast xAI

39.4

Rank #167 Confirmed

Mistral Medium Mistral AI

36.3

Rank #218 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Grok 4 Fast scores higher in 5 categories and Mistral Medium in 4 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in long context, where Grok 4 Fast leads 63.2 to 42.9.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 66.1% for Grok 4 Fast and 50% for Mistral Medium.
  • Mistral Medium has downloadable open weights; the other is API-only.

Side by side

Grok 4 FastMistral Medium
ProviderxAIMistral AI
Noometry Index39.436.3
Released2025-09-192023-12-11
WeightsProprietaryOpen
Context window—262K
Max output—262K
Input $ / M tokens—$1.50
Output $ / M tokens—$7.50
Results tracked3036

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Medium leads

Grok 4 Fast: 32.5 (#271), Mistral Medium: 34.2 (#243)

BenchmarkGrok 4 FastMistral Medium
WeirdML42.9%43.7%
LMArena Coding14291434
FrontierCode—8%
LMArena WebDev1159—
SciCode—40.2%
ALE-Bench—763.98

Agentic & Tool Use Grok 4 Fast leads

Grok 4 Fast: 29.5 (#86), Mistral Medium: 28.3 (#90)

BenchmarkGrok 4 FastMistral Medium
Berkeley Function Calling Leaderboard—37.7%
τ²-bench Banking15.7%—
Cybench30%—
LMArena Search1171—

Reasoning Mistral Medium leads

Grok 4 Fast: 22.2 (#201), Mistral Medium: 24.0 (#167)

BenchmarkGrok 4 FastMistral Medium
Kagi LLM Benchmark66.1%50%
LMArena Hard Prompts14121426
DTBench82.7%75.5%
ARC-AGI-25.3%—
ARC-AGI-148.5%—
CritPt—0%
LMCA—26.1%
Surface Evolver Bench—26.9%
Epoch Capabilities Index144.2—
ForecastBench60.5—

Math Grok 4 Fast leads

Grok 4 Fast: 38.9 (#123), Mistral Medium: 28.1 (#245)

BenchmarkGrok 4 FastMistral Medium
LMArena Math14191408
OTIS Mock AIME 2024-2025—32.2%
ProofBench—9%
MATH Level 5—81.6%
FrontierMath (Feb 2025 set)—0.3%

Knowledge Grok 4 Fast leads

Grok 4 Fast: 32.0 (#214), Mistral Medium: 25.0 (#265)

BenchmarkGrok 4 FastMistral Medium
Vectara Hallucination Rate19.7%22.7%
LMArena Expert14111408
GPQA Diamond—59.5%
Humanity's Last Exam—4.5%

Multimodal Not comparable

Grok 4 Fast: —, Mistral Medium: 35.3 (#88)

BenchmarkGrok 4 FastMistral Medium
LMArena Vision—1172

Multilingual Too close to call

Grok 4 Fast: 51.3 (#111), Mistral Medium: 52.1 (#91)

BenchmarkGrok 4 FastMistral Medium
LMArena Non-English13961408
LMArena Chinese14571447
LMArena French14311459
LMArena German13831432
LMArena Japanese13521378
LMArena Korean13571380
LMArena Russian13891411
LMArena Spanish14151433

Instruction Following Too close to call

Grok 4 Fast: 73.2 (#121), Mistral Medium: 73.7 (#116)

BenchmarkGrok 4 FastMistral Medium
LMArena Instruction Following13871398

Long Context Grok 4 Fast leads

Grok 4 Fast: 63.2 (#3), Mistral Medium: 42.9 (#114)

BenchmarkGrok 4 FastMistral Medium
LMArena Longer Query14151406
Fiction.LiveBench94.4%—

Writing & Preference Too close to call

Grok 4 Fast: 60.0 (#102), Mistral Medium: 60.0 (#103)

BenchmarkGrok 4 FastMistral Medium
LMArena Text14071424
LMArena Creative Writing13871391
LMArena Multi-Turn14141418
Short-Story Creative Writing—77.3%

Frequently asked questions

Is Grok 4 Fast better than Mistral Medium?

Grok 4 Fast is the stronger model overall, scoring 39.4 to 36.3 on the Noometry Index.

Is Grok 4 Fast or Mistral Medium better for coding?

Mistral Medium scores higher on coding benchmarks: 34.2 versus 32.5 in the Noometry coding category.

How many benchmarks do Grok 4 Fast and Mistral Medium share?

21 benchmarks have published results for both models. Grok 4 Fast has 30 scored results on Noometry and Mistral Medium has 36.

Related comparisons

Go deeper