Noometry

Model comparison

Grok 4.1 Fast vs Mistral Medium

Grok 4.1 Fast is the stronger model overall, scoring 41.4 to 36.3 on the Noometry Index.

Last verified . 23 shared benchmarks.

Grok 4.1 Fast xAI

41.4

Rank #136 Confirmed

Mistral Medium Mistral AI

36.3

Rank #218 Confirmed

Summary

  • They share 23 benchmarks with published results for both. Grok 4.1 Fast scores higher in 5 categories and Mistral Medium in 5 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.1 Fast leads 43.4 to 24.0.
  • The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 69.6% for Grok 4.1 Fast and 37.7% for Mistral Medium.
  • Grok 4.1 Fast is cheaper at $0.20 / $0.50 per million input/output tokens, against $1.50 / $7.50 for Mistral Medium.
  • Mistral Medium accepts more context: 262K tokens versus 128K.
  • Mistral Medium has downloadable open weights; the other is API-only.

Side by side

Grok 4.1 FastMistral Medium
ProviderxAIMistral AI
Noometry Index41.436.3
Released2025-06-272023-12-11
WeightsProprietaryOpen
Context window128K262K
Max output30K262K
Input $ / M tokens$0.20$1.50
Output $ / M tokens$0.50$7.50
Results tracked3236

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Grok 4.1 Fast: 34.1 (#245), Mistral Medium: 34.2 (#243)

BenchmarkGrok 4.1 FastMistral Medium
LMArena Coding14111434
ALE-Bench394.93763.98
FrontierCode—8%
LMArena WebDev1242—
SciCode—40.2%
WeirdML—43.7%

Agentic & Tool Use Grok 4.1 Fast leads

Grok 4.1 Fast: 36.3 (#39), Mistral Medium: 28.3 (#90)

BenchmarkGrok 4.1 FastMistral Medium
Berkeley Function Calling Leaderboard69.6%37.7%
τ²-bench Banking13.1%—
LMArena Search1171—
Vending-Bench 21,107—

Reasoning Grok 4.1 Fast leads

Grok 4.1 Fast: 43.4 (#49), Mistral Medium: 24.0 (#167)

BenchmarkGrok 4.1 FastMistral Medium
LMArena Hard Prompts14071426
DTBench87.7%75.5%
SimpleBench56%—
Kagi LLM Benchmark—50%
NYT Connections (extended)87.4%—
CritPt—0%
LMCA—26.1%
Surface Evolver Bench—26.9%
ForecastBench61—

Math Grok 4.1 Fast leads

Grok 4.1 Fast: 31.9 (#221), Mistral Medium: 28.1 (#245)

BenchmarkGrok 4.1 FastMistral Medium
ProofBench4%9%
LMArena Math14081408
MathArena Final-Answer Competitions60.9%—
OTIS Mock AIME 2024-2025—32.2%
MATH Level 5—81.6%
FrontierMath (Feb 2025 set)—0.3%

Knowledge Grok 4.1 Fast leads

Grok 4.1 Fast: 33.1 (#207), Mistral Medium: 25.0 (#265)

BenchmarkGrok 4.1 FastMistral Medium
Vectara Hallucination Rate17.8%22.7%
LMArena Expert13991408
GPQA Diamond—59.5%
Humanity's Last Exam—4.5%

Multimodal Grok 4.1 Fast leads

Grok 4.1 Fast: 37.0 (#76), Mistral Medium: 35.3 (#88)

BenchmarkGrok 4.1 FastMistral Medium
LMArena Vision12011172

Multilingual Mistral Medium leads

Grok 4.1 Fast: 51.0 (#114), Mistral Medium: 52.1 (#91)

BenchmarkGrok 4.1 FastMistral Medium
LMArena Non-English13911408
LMArena Chinese14411447
LMArena French14151459
LMArena German14041432
LMArena Japanese13491378
LMArena Korean13611380
LMArena Russian13871411
LMArena Spanish14131433

Instruction Following Mistral Medium leads

Grok 4.1 Fast: 72.7 (#133), Mistral Medium: 73.7 (#116)

BenchmarkGrok 4.1 FastMistral Medium
LMArena Instruction Following13761398

Long Context Too close to call

Grok 4.1 Fast: 42.4 (#126), Mistral Medium: 42.9 (#114)

BenchmarkGrok 4.1 FastMistral Medium
LMArena Longer Query13901406

Writing & Preference Mistral Medium leads

Grok 4.1 Fast: 57.2 (#131), Mistral Medium: 60.0 (#103)

BenchmarkGrok 4.1 FastMistral Medium
LMArena Text14081424
LMArena Creative Writing13941391
LMArena Multi-Turn13891418
Short-Story Creative Writing—77.3%
EQ-Bench Creative Writing1327—

Frequently asked questions

Is Grok 4.1 Fast better than Mistral Medium?

Grok 4.1 Fast is the stronger model overall, scoring 41.4 to 36.3 on the Noometry Index.

Which is cheaper, Grok 4.1 Fast or Mistral Medium?

Grok 4.1 Fast is cheaper. It lists at $0.20 per million input tokens and $0.50 per million output tokens; Mistral Medium lists at $1.50 and $7.50.

Is Grok 4.1 Fast or Mistral Medium better for coding?

They score almost the same on coding (34.1 vs 34.2); test both on your own repository before choosing.

Which has the bigger context window?

Mistral Medium does, with 262K tokens against 128K.

How many benchmarks do Grok 4.1 Fast and Mistral Medium share?

23 benchmarks have published results for both models. Grok 4.1 Fast has 32 scored results on Noometry and Mistral Medium has 36.

Related comparisons

Go deeper