Noometry

Model comparison

Grok 4.20 (Non-Reasoning) vs Mistral Large

Grok 4.20 (Non-Reasoning) is the stronger model overall, scoring 48.6 to 31.9 on the Noometry Index.

Last verified . 25 shared benchmarks.

Grok 4.20 (Non-Reasoning) xAI

48.6

Rank #54 Confirmed

Mistral Large Mistral AI

31.9

Rank #263 Confirmed

Summary

  • They share 25 benchmarks with published results for both. Grok 4.20 (Non-Reasoning) scores higher in 9 categories and Mistral Large in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.20 (Non-Reasoning) leads 52.3 to 15.8.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 92.2% for Grok 4.20 (Non-Reasoning) and 8.5% for Mistral Large.
  • Grok 4.20 (Non-Reasoning) is cheaper at $1.25 / $2.50 per million input/output tokens, against $2 / $6 for Mistral Large.
  • Grok 4.20 (Non-Reasoning) accepts more context: 1M tokens versus 131K.
  • Mistral Large has downloadable open weights; the other is API-only.

Side by side

Grok 4.20 (Non-Reasoning)Mistral Large
ProviderxAIMistral AI
Noometry Index48.631.9
Released2026-02-172024-02-26
WeightsProprietaryOpen
Context window1M131K
Max output30K16K
Input $ / M tokens$1.25$2
Output $ / M tokens$2.50$6
Results tracked4651

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 42.1 (#112), Mistral Large: 34.3 (#240)

BenchmarkGrok 4.20 (Non-Reasoning)Mistral Large
LMArena Coding14591277
ALE-Bench1,150264.7
LMArena WebDev1375—
SciCode—36.2%
WeirdML52.3%—
BigCodeBench Instruct—30%
LiveBench Coding—47.1%
BigCodeBench Complete—38.3%
HumanEval+—62.2%
MBPP+—59.5%

Agentic & Tool Use Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 34.4 (#46), Mistral Large: 28.6 (#89)

BenchmarkGrok 4.20 (Non-Reasoning)Mistral Large
Terminal-Bench57.3%—
Berkeley Function Calling Leaderboard—38.4%
τ²-bench Banking18%—
LMArena Search1189—
Vending-Bench 24,663—

Reasoning Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 52.3 (#32), Mistral Large: 15.8 (#310)

BenchmarkGrok 4.20 (Non-Reasoning)Mistral Large
LMArena Hard Prompts14511257
DTBench90.1%65.1%
LMCA38.7%16.7%
Epoch Capabilities Index151.98128.52
ForecastBench61.457.1
ARC-AGI-265.1%—
SimpleBench—22.5%
Kagi LLM Benchmark75%—
NYT Connections (extended)85.4%—
ARC-AGI-189.5%—
CritPt—0%
Chess Puzzles24%—
Thematic Generalization63.8%—
LiveBench Reasoning—43.5%
LiveBench Data Analysis—50.1%
LiveBench—48.4%

Math Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 48.2 (#65), Mistral Large: 18.2 (#291)

BenchmarkGrok 4.20 (Non-Reasoning)Mistral Large
OTIS Mock AIME 2024-202592.2%8.5%
LMArena Math14551262
FrontierMath (Tiers 1-3)44.9%—
FrontierMath Tier 417.1%—
ProofBench14%—
Omni-MATH—28.1%
LiveBench Math—42.5%
MATH Level 5—50.3%
FrontierMath (Feb 2025 set)—0.3%

Knowledge Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 52.8 (#60), Mistral Large: 30.1 (#230)

BenchmarkGrok 4.20 (Non-Reasoning)Mistral Large
GPQA Diamond89.3%51.3%
LMArena Expert14391232
SimpleQA Verified30.2%—
MMLU-Pro—59.9%
Confabulations—21.4%
Vectara Hallucination Rate—4.5%
GPQA (HELM)—43.5%
MMLU—80%

Multimodal Not comparable

Grok 4.20 (Non-Reasoning): 33.3 (#98), Mistral Large: —

BenchmarkGrok 4.20 (Non-Reasoning)Mistral Large
LMArena Vision1263—
Blueprint-Bench 20%—
LMArena Document1416—

Multilingual Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 54.5 (#40), Mistral Large: 40.0 (#219)

BenchmarkGrok 4.20 (Non-Reasoning)Mistral Large
LMArena Non-English14411237
LMArena Chinese14811240
LMArena French14761325
LMArena German14651254
LMArena Japanese14491188
LMArena Korean14171202
LMArena Russian14581257
LMArena Spanish14431268

Instruction Following Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 74.8 (#83), Mistral Large: 67.9 (#191)

BenchmarkGrok 4.20 (Non-Reasoning)Mistral Large
LMArena Instruction Following14201249
LiveBench Instruction Following—67.9%
IFEval—87.7%

Long Context Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 45.5 (#34), Mistral Large: 38.3 (#199)

BenchmarkGrok 4.20 (Non-Reasoning)Mistral Large
LMArena Longer Query14371261
CL-bench22.2%—
CL-bench Life11.9%—

Writing & Preference Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 65.7 (#44), Mistral Large: 40.7 (#242)

BenchmarkGrok 4.20 (Non-Reasoning)Mistral Large
LMArena Text14511266
LMArena Creative Writing14381243
EQ-Bench Creative Writing1574985
LMArena Multi-Turn14561260
Short-Story Creative Writing—69%
WildBench—80.1%
LiveBench Language—39.4%

Frequently asked questions

Is Grok 4.20 (Non-Reasoning) better than Mistral Large?

Grok 4.20 (Non-Reasoning) is the stronger model overall, scoring 48.6 to 31.9 on the Noometry Index.

Which is cheaper, Grok 4.20 (Non-Reasoning) or Mistral Large?

Grok 4.20 (Non-Reasoning) is cheaper. It lists at $1.25 per million input tokens and $2.50 per million output tokens; Mistral Large lists at $2 and $6.

Is Grok 4.20 (Non-Reasoning) or Mistral Large better for coding?

Grok 4.20 (Non-Reasoning) scores higher on coding benchmarks: 42.1 versus 34.3 in the Noometry coding category.

Which has the bigger context window?

Grok 4.20 (Non-Reasoning) does, with 1M tokens against 131K.

How many benchmarks do Grok 4.20 (Non-Reasoning) and Mistral Large share?

25 benchmarks have published results for both models. Grok 4.20 (Non-Reasoning) has 46 scored results on Noometry and Mistral Large has 51.

Related comparisons

Go deeper