Model comparison

Codestral vs Grok 4 Fast

Grok 4 Fast is the stronger model overall, scoring 39.4 to 30.6 on the Noometry Index.

Last verified . 1 shared benchmarks.

Codestral Mistral AI

30.6

Rank #290 Reported

Grok 4 Fast xAI

39.4

Rank #167 Confirmed

Summary

  • They share 1 benchmark with published results for both. Codestral scores higher in 0 categories and Grok 4 Fast in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Grok 4 Fast leads 32.5 to 27.3.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 32.5% for Codestral and 66.1% for Grok 4 Fast.

Side by side

Codestral and Grok 4 Fast specifications
CodestralGrok 4 Fast
ProviderMistral AIxAI
Noometry Index30.639.4
Released2024-05-292025-09-19
WeightsProprietaryProprietary
Context window256K—
Max output8K—
Input $ / M tokens$0.30—
Output $ / M tokens$0.90—
Results tracked730

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4 Fast leads

Codestral: 27.3 (#321), Grok 4 Fast: 32.5 (#271)

Coding benchmarks
BenchmarkCodestralGrok 4 Fast
Aider Polyglot11.1%—
LMArena WebDev—1159
WeirdML—42.9%
BigCodeBench Instruct41.8%—
LMArena Coding—1429
BigCodeBench Complete52.5%—
ALE-Bench137.78—
HumanEval+73.8%—
MBPP+61.9%—

Agentic & Tool Use Not comparable

Codestral: —, Grok 4 Fast: 29.5 (#86)

Agentic & Tool Use benchmarks
BenchmarkCodestralGrok 4 Fast
τ²-bench Banking—15.7%
Cybench—30%
LMArena Search—1171

Reasoning Grok 4 Fast leads

Codestral: 19.8 (#251), Grok 4 Fast: 22.2 (#201)

Reasoning benchmarks
BenchmarkCodestralGrok 4 Fast
Kagi LLM Benchmark32.5%66.1%
ARC-AGI-2—5.3%
ARC-AGI-1—48.5%
LMArena Hard Prompts—1412
DTBench—82.7%
Epoch Capabilities Index—144.2
ForecastBench—60.5

Math Not comparable

Codestral: —, Grok 4 Fast: 38.9 (#123)

Math benchmarks
BenchmarkCodestralGrok 4 Fast
LMArena Math—1419

Knowledge Not comparable

Codestral: —, Grok 4 Fast: 32.0 (#214)

Knowledge benchmarks
BenchmarkCodestralGrok 4 Fast
Vectara Hallucination Rate—19.7%
LMArena Expert—1411

Multilingual Not comparable

Codestral: —, Grok 4 Fast: 51.3 (#111)

Multilingual benchmarks
BenchmarkCodestralGrok 4 Fast
LMArena Non-English—1396
LMArena Chinese—1457
LMArena French—1431
LMArena German—1383
LMArena Japanese—1352
LMArena Korean—1357
LMArena Russian—1389
LMArena Spanish—1415

Instruction Following Not comparable

Codestral: —, Grok 4 Fast: 73.2 (#121)

Instruction Following benchmarks
BenchmarkCodestralGrok 4 Fast
LMArena Instruction Following—1387

Long Context Not comparable

Codestral: —, Grok 4 Fast: 63.2 (#3)

Long Context benchmarks
BenchmarkCodestralGrok 4 Fast
Fiction.LiveBench—94.4%
LMArena Longer Query—1415

Writing & Preference Not comparable

Codestral: —, Grok 4 Fast: 60.0 (#102)

Writing & Preference benchmarks
BenchmarkCodestralGrok 4 Fast
LMArena Text—1407
LMArena Creative Writing—1387
LMArena Multi-Turn—1414

Frequently asked questions

Is Codestral better than Grok 4 Fast?

Grok 4 Fast is the stronger model overall, scoring 39.4 to 30.6 on the Noometry Index.

Is Codestral or Grok 4 Fast better for coding?

Grok 4 Fast scores higher on coding benchmarks: 32.5 versus 27.3 in the Noometry coding category.

How many benchmarks do Codestral and Grok 4 Fast share?

1 benchmark has published results for both models. Codestral has 7 scored results on Noometry and Grok 4 Fast has 30.

Related comparisons

Go deeper