Noometry

Model comparison

Grok 4.1 Fast vs Mistral Medium 3.1

Grok 4.1 Fast is the stronger model overall, scoring 41.4 to 31.9 on the Noometry Index.

Last verified . 2 shared benchmarks.

Grok 4.1 Fast xAI

41.4

Rank #136 Confirmed

Mistral Medium 3.1 Mistral AI

31.9

Rank #266 Reported

Summary

  • They share 2 benchmarks with published results for both. Grok 4.1 Fast scores higher in 2 categories and Mistral Medium 3.1 in 0 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.1 Fast leads 43.4 to 10.6.
  • The biggest single-benchmark swing is NYT Connections (extended): 87.4% for Grok 4.1 Fast and 6.5% for Mistral Medium 3.1.
  • Grok 4.1 Fast is cheaper at $0.20 / $0.50 per million input/output tokens, against $0.40 / $2 for Mistral Medium 3.1.
  • Mistral Medium 3.1 accepts more context: 131K tokens versus 128K.

Side by side

Grok 4.1 FastMistral Medium 3.1
ProviderxAIMistral AI
Noometry Index41.431.9
Released2025-06-27—
WeightsProprietaryProprietary
Context window128K131K
Max output30K105K
Input $ / M tokens$0.20$0.40
Output $ / M tokens$0.50$2
Results tracked323

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Grok 4.1 Fast: 34.1 (#245), Mistral Medium 3.1: —

BenchmarkGrok 4.1 FastMistral Medium 3.1
LMArena WebDev1242—
LMArena Coding1411—
ALE-Bench394.93—

Agentic & Tool Use Not comparable

Grok 4.1 Fast: 36.3 (#39), Mistral Medium 3.1: —

BenchmarkGrok 4.1 FastMistral Medium 3.1
Berkeley Function Calling Leaderboard69.6%—
τ²-bench Banking13.1%—
LMArena Search1171—
Vending-Bench 21,107—

Reasoning Grok 4.1 Fast leads

Grok 4.1 Fast: 43.4 (#49), Mistral Medium 3.1: 10.6 (#341)

BenchmarkGrok 4.1 FastMistral Medium 3.1
NYT Connections (extended)87.4%6.5%
SimpleBench56%—
Thematic Generalization—20.3%
LMArena Hard Prompts1407—
DTBench87.7%—
ForecastBench61—

Math Not comparable

Grok 4.1 Fast: 31.9 (#221), Mistral Medium 3.1: —

BenchmarkGrok 4.1 FastMistral Medium 3.1
MathArena Final-Answer Competitions60.9%—
ProofBench4%—
LMArena Math1408—

Knowledge Not comparable

Grok 4.1 Fast: 33.1 (#207), Mistral Medium 3.1: —

BenchmarkGrok 4.1 FastMistral Medium 3.1
Vectara Hallucination Rate17.8%—
LMArena Expert1399—

Multimodal Not comparable

Grok 4.1 Fast: 37.0 (#76), Mistral Medium 3.1: —

BenchmarkGrok 4.1 FastMistral Medium 3.1
LMArena Vision1201—

Multilingual Not comparable

Grok 4.1 Fast: 51.0 (#114), Mistral Medium 3.1: —

BenchmarkGrok 4.1 FastMistral Medium 3.1
LMArena Non-English1391—
LMArena Chinese1441—
LMArena French1415—
LMArena German1404—
LMArena Japanese1349—
LMArena Korean1361—
LMArena Russian1387—
LMArena Spanish1413—

Instruction Following Not comparable

Grok 4.1 Fast: 72.7 (#133), Mistral Medium 3.1: —

BenchmarkGrok 4.1 FastMistral Medium 3.1
LMArena Instruction Following1376—

Long Context Not comparable

Grok 4.1 Fast: 42.4 (#126), Mistral Medium 3.1: —

BenchmarkGrok 4.1 FastMistral Medium 3.1
LMArena Longer Query1390—

Writing & Preference Grok 4.1 Fast leads

Grok 4.1 Fast: 57.2 (#131), Mistral Medium 3.1: 55.5 (#145)

BenchmarkGrok 4.1 FastMistral Medium 3.1
EQ-Bench Creative Writing13271476
LMArena Text1408—
LMArena Creative Writing1394—
LMArena Multi-Turn1389—

Frequently asked questions

Is Grok 4.1 Fast better than Mistral Medium 3.1?

Grok 4.1 Fast is the stronger model overall, scoring 41.4 to 31.9 on the Noometry Index.

Which is cheaper, Grok 4.1 Fast or Mistral Medium 3.1?

Grok 4.1 Fast is cheaper. It lists at $0.20 per million input tokens and $0.50 per million output tokens; Mistral Medium 3.1 lists at $0.40 and $2.

Which has the bigger context window?

Mistral Medium 3.1 does, with 131K tokens against 128K.

How many benchmarks do Grok 4.1 Fast and Mistral Medium 3.1 share?

2 benchmarks have published results for both models. Grok 4.1 Fast has 32 scored results on Noometry and Mistral Medium 3.1 has 3.

Related comparisons

Go deeper