Model comparison

Grok 4.6 vs Mistral Nemo

Grok 4.6 is the stronger model overall, scoring 56.9 to 26.4 on the Noometry Index. Mistral Nemo costs 20× less per token, which makes it the better buy when Grok 4.6's lead doesn't matter for your workload.

Last verified . 3 shared benchmarks.

Grok 4.6 xAI

56.9

Rank #21 Confirmed

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Grok 4.6 scores higher in 5 categories and Mistral Nemo in 0 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Grok 4.6 leads 63.3 to 12.3.
  • The biggest single-benchmark swing is GPQA Diamond: 94% for Grok 4.6 and 29.9% for Mistral Nemo.
  • Mistral Nemo is cheaper at $0.15 / $0.15 per million input/output tokens, against $2 / $6 for Grok 4.6.
  • Grok 4.6 accepts more context: 500K tokens versus 128K.
  • Mistral Nemo has downloadable open weights; the other is API-only.

Side by side

Grok 4.6 and Mistral Nemo specifications
Grok 4.6Mistral Nemo
ProviderxAIMistral AI
Noometry Index56.926.4
Released2026-08-122024-07-01
WeightsProprietaryOpen
Context window500K128K
Max output500K128K
Input $ / M tokens$2$0.15
Output $ / M tokens$6$0.15
Results tracked4910

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Grok 4.6: 58.5 (#16), Mistral Nemo: —

Coding benchmarks
BenchmarkGrok 4.6Mistral Nemo
DeepSWE67.5%—
FrontierCode48%—
CursorBench41.4%—
LMArena WebDev1617—
FrontierSWE25.3%—
SciCode56.5%—
WeirdML67.3%—
LMArena Coding1465—
ALE-Bench1,508—

Agentic & Tool Use Grok 4.6 leads

Grok 4.6: 39.4 (#27), Mistral Nemo: 23.5 (#125)

Agentic & Tool Use benchmarks
BenchmarkGrok 4.6Mistral Nemo
APEX-Agents65.3%—
Berkeley Function Calling Leaderboard—27.6%
BALROG—17.6%
GDP.pdf17.2%—
Vending-Bench 29,047—

Reasoning Grok 4.6 leads

Grok 4.6: 61.4 (#20), Mistral Nemo: 20.7 (#232)

Reasoning benchmarks
BenchmarkGrok 4.6Mistral Nemo
DTBench97.3%48.6%
Epoch Capabilities Index156.44118.68
ARC-AGI-267.1%—
SimpleBench75.9%—
NYT Connections (extended)80%—
ARC-AGI-187.5%—
CritPt19.7%—
Chess Puzzles40%—
EBR-Bench30.5%—
LMArena Hard Prompts1447—
Mystery Game Puzzles34%—
LMCA48.5%—
PIQA—83.5%

Math Grok 4.6 leads

Grok 4.6: 67.0 (#24), Mistral Nemo: 25.5 (#268)

Math benchmarks
BenchmarkGrok 4.6Mistral Nemo
FrontierMath (Tiers 1-3)66%—
FrontierMath Tier 431.7%—
OTIS Mock AIME 2024-202599.2%—
ProofBench51%—
LMArena Math1423—
MATH Level 5—10.8%
GSM8K—84.2%

Knowledge Grok 4.6 leads

Grok 4.6: 63.3 (#20), Mistral Nemo: 12.3 (#298)

Knowledge benchmarks
BenchmarkGrok 4.6Mistral Nemo
GPQA Diamond94%29.9%
SimpleQA Verified49.3%—
LMArena Expert1467—
BoolQ—82.5%

Multimodal Not comparable

Grok 4.6: 43.6 (#23), Mistral Nemo: —

Multimodal benchmarks
BenchmarkGrok 4.6Mistral Nemo
LMArena Vision1263—
Blueprint-Bench 233.2%—
Furniture Assembly40%—
LMArena Document1452—

Multilingual Not comparable

Grok 4.6: 53.0 (#74), Mistral Nemo: —

Multilingual benchmarks
BenchmarkGrok 4.6Mistral Nemo
LMArena Non-English1420—
LMArena Chinese1480—
LMArena French1461—
LMArena German1431—
LMArena Japanese1376—
LMArena Korean1397—
LMArena Russian1422—
LMArena Spanish1404—

Instruction Following Not comparable

Grok 4.6: 75.4 (#63), Mistral Nemo: —

Instruction Following benchmarks
BenchmarkGrok 4.6Mistral Nemo
LMArena Instruction Following1431—

Long Context Not comparable

Grok 4.6: 44.5 (#66), Mistral Nemo: —

Long Context benchmarks
BenchmarkGrok 4.6Mistral Nemo
LMArena Longer Query1454—

Writing & Preference Grok 4.6 leads

Grok 4.6: 62.3 (#80), Mistral Nemo: 28.5 (#296)

Writing & Preference benchmarks
BenchmarkGrok 4.6Mistral Nemo
LMArena Text1428—
LMArena Creative Writing1428—
EQ-Bench Creative Writing—881
LMArena Multi-Turn1425—

Frequently asked questions

Is Grok 4.6 better than Mistral Nemo?

Grok 4.6 is the stronger model overall, scoring 56.9 to 26.4 on the Noometry Index. Mistral Nemo costs 20× less per token, which makes it the better buy when Grok 4.6's lead doesn't matter for your workload.

Which is cheaper, Grok 4.6 or Mistral Nemo?

Mistral Nemo is cheaper. It lists at $0.15 per million input tokens and $0.15 per million output tokens; Grok 4.6 lists at $2 and $6.

Which has the bigger context window?

Grok 4.6 does, with 500K tokens against 128K.

How many benchmarks do Grok 4.6 and Mistral Nemo share?

3 benchmarks have published results for both models. Grok 4.6 has 49 scored results on Noometry and Mistral Nemo has 10.

Related comparisons

Go deeper