Noometry

Model comparison

Grok 4.6 vs Mistral Medium 3.5

Grok 4.6 is the stronger model overall, scoring 56.9 to 40.2 on the Noometry Index.

Last verified . 20 shared benchmarks.

Grok 4.6 xAI

56.9

Rank #21 Confirmed

Mistral Medium 3.5 Mistral AI

40.2

Rank #152 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Grok 4.6 scores higher in 9 categories and Mistral Medium 3.5 in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.6 leads 61.4 to 17.3.
  • The biggest single-benchmark swing is NYT Connections (extended): 80% for Grok 4.6 and 12.9% for Mistral Medium 3.5.
  • Both cost about the same: $2 input and $6 output per million tokens.
  • Grok 4.6 accepts more context: 500K tokens versus 262K.
  • Mistral Medium 3.5 has downloadable open weights; the other is API-only.

Side by side

Grok 4.6Mistral Medium 3.5
ProviderxAIMistral AI
Noometry Index56.940.2
Released2026-08-12—
WeightsProprietaryOpen
Context window500K262K
Max output500K210K
Input $ / M tokens$2$1.50
Output $ / M tokens$6$7.50
Results tracked4922

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.6 leads

Grok 4.6: 58.5 (#16), Mistral Medium 3.5: 36.0 (#213)

BenchmarkGrok 4.6Mistral Medium 3.5
LMArena WebDev16171264
LMArena Coding14651461
DeepSWE67.5%—
FrontierCode48%—
CursorBench41.4%—
FrontierSWE25.3%—
SciCode56.5%—
WeirdML67.3%—
ALE-Bench1,508—

Agentic & Tool Use Not comparable

Grok 4.6: 39.4 (#27), Mistral Medium 3.5: —

BenchmarkGrok 4.6Mistral Medium 3.5
APEX-Agents65.3%—
GDP.pdf17.2%—
Vending-Bench 29,047—

Reasoning Grok 4.6 leads

Grok 4.6: 61.4 (#20), Mistral Medium 3.5: 17.3 (#295)

BenchmarkGrok 4.6Mistral Medium 3.5
NYT Connections (extended)80%12.9%
LMArena Hard Prompts14471436
Epoch Capabilities Index156.44141.35
ARC-AGI-267.1%—
SimpleBench75.9%—
Kagi LLM Benchmark—41.4%
ARC-AGI-187.5%—
CritPt19.7%—
Chess Puzzles40%—
EBR-Bench30.5%—
Mystery Game Puzzles34%—
DTBench97.3%—
LMCA48.5%—

Math Grok 4.6 leads

Grok 4.6: 67.0 (#24), Mistral Medium 3.5: 39.1 (#113)

BenchmarkGrok 4.6Mistral Medium 3.5
LMArena Math14231431
FrontierMath (Tiers 1-3)66%—
FrontierMath Tier 431.7%—
OTIS Mock AIME 2024-202599.2%—
ProofBench51%—

Knowledge Grok 4.6 leads

Grok 4.6: 63.3 (#20), Mistral Medium 3.5: 40.0 (#126)

BenchmarkGrok 4.6Mistral Medium 3.5
LMArena Expert14671432
GPQA Diamond94%—
SimpleQA Verified49.3%—

Multimodal Grok 4.6 leads

Grok 4.6: 43.6 (#23), Mistral Medium 3.5: 38.3 (#65)

BenchmarkGrok 4.6Mistral Medium 3.5
LMArena Vision12631223
Blueprint-Bench 233.2%—
Furniture Assembly40%—
LMArena Document1452—

Multilingual Grok 4.6 leads

Grok 4.6: 53.0 (#74), Mistral Medium 3.5: 51.9 (#100)

BenchmarkGrok 4.6Mistral Medium 3.5
LMArena Non-English14201404
LMArena Chinese14801442
LMArena French14611448
LMArena German14311451
LMArena Korean13971385
LMArena Russian14221395
LMArena Spanish14041409
LMArena Japanese1376—

Instruction Following Too close to call

Grok 4.6: 75.4 (#63), Mistral Medium 3.5: 74.6 (#90)

BenchmarkGrok 4.6Mistral Medium 3.5
LMArena Instruction Following14311415

Long Context Grok 4.6 leads

Grok 4.6: 44.5 (#66), Mistral Medium 3.5: 43.2 (#103)

BenchmarkGrok 4.6Mistral Medium 3.5
LMArena Longer Query14541415

Writing & Preference Grok 4.6 leads

Grok 4.6: 62.3 (#80), Mistral Medium 3.5: 58.5 (#117)

BenchmarkGrok 4.6Mistral Medium 3.5
LMArena Text14281421
LMArena Creative Writing14281374
LMArena Multi-Turn14251423
EQ-Bench 4—993

Frequently asked questions

Is Grok 4.6 better than Mistral Medium 3.5?

Grok 4.6 is the stronger model overall, scoring 56.9 to 40.2 on the Noometry Index.

Which is cheaper, Grok 4.6 or Mistral Medium 3.5?

Mistral Medium 3.5 is cheaper. It lists at $1.50 per million input tokens and $7.50 per million output tokens; Grok 4.6 lists at $2 and $6.

Is Grok 4.6 or Mistral Medium 3.5 better for coding?

Grok 4.6 scores higher on coding benchmarks: 58.5 versus 36.0 in the Noometry coding category.

Which has the bigger context window?

Grok 4.6 does, with 500K tokens against 262K.

How many benchmarks do Grok 4.6 and Mistral Medium 3.5 share?

20 benchmarks have published results for both models. Grok 4.6 has 49 scored results on Noometry and Mistral Medium 3.5 has 22.

Related comparisons

Go deeper