Noometry

Model comparison

Grok 4.20 Multi-Agent vs Mistral Nemo

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 26.4 on the Noometry Index. Mistral Nemo costs 10× less per token, which makes it the better buy when Grok 4.20 Multi-Agent's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Summary

  • The widest gap is in writing & preference, where Grok 4.20 Multi-Agent leads 64.0 to 28.5.
  • Mistral Nemo is cheaper at $0.15 / $0.15 per million input/output tokens, against $1.25 / $2.50 for Grok 4.20 Multi-Agent.
  • Grok 4.20 Multi-Agent accepts more context: 1M tokens versus 128K.
  • Mistral Nemo has downloadable open weights; the other is API-only.

Side by side

Grok 4.20 Multi-AgentMistral Nemo
ProviderxAIMistral AI
Noometry Index46.226.4
Released2026-03-092024-07-01
WeightsProprietaryOpen
Context window1M128K
Max output30K128K
Input $ / M tokens$1.25$0.15
Output $ / M tokens$2.50$0.15
Results tracked2010

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Grok 4.20 Multi-Agent: 43.0 (#92), Mistral Nemo: —

BenchmarkGrok 4.20 Multi-AgentMistral Nemo
LMArena Coding1457—

Agentic & Tool Use Not comparable

Grok 4.20 Multi-Agent: —, Mistral Nemo: 23.5 (#125)

BenchmarkGrok 4.20 Multi-AgentMistral Nemo
Berkeley Function Calling Leaderboard—27.6%
BALROG—17.6%
LMArena Search1204—

Reasoning Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.9 (#48), Mistral Nemo: 20.7 (#232)

BenchmarkGrok 4.20 Multi-AgentMistral Nemo
NYT Connections (extended)89.6%—
LMArena Hard Prompts1448—
DTBench—48.6%
Epoch Capabilities Index—118.68
PIQA—83.5%

Math Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 39.4 (#104), Mistral Nemo: 25.5 (#268)

BenchmarkGrok 4.20 Multi-AgentMistral Nemo
LMArena Math1442—
MATH Level 5—10.8%
GSM8K—84.2%

Knowledge Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 40.4 (#119), Mistral Nemo: 12.3 (#298)

BenchmarkGrok 4.20 Multi-AgentMistral Nemo
GPQA Diamond—29.9%
LMArena Expert1445—
BoolQ—82.5%

Multimodal Not comparable

Grok 4.20 Multi-Agent: 40.5 (#48), Mistral Nemo: —

BenchmarkGrok 4.20 Multi-AgentMistral Nemo
LMArena Vision1259—

Multilingual Not comparable

Grok 4.20 Multi-Agent: 54.4 (#43), Mistral Nemo: —

BenchmarkGrok 4.20 Multi-AgentMistral Nemo
LMArena Non-English1440—
LMArena Chinese1475—
LMArena French1466—
LMArena German1456—
LMArena Japanese1405—
LMArena Korean1416—
LMArena Russian1457—
LMArena Spanish1447—

Instruction Following Not comparable

Grok 4.20 Multi-Agent: 74.8 (#84), Mistral Nemo: —

BenchmarkGrok 4.20 Multi-AgentMistral Nemo
LMArena Instruction Following1420—

Long Context Not comparable

Grok 4.20 Multi-Agent: 43.7 (#88), Mistral Nemo: —

BenchmarkGrok 4.20 Multi-AgentMistral Nemo
LMArena Longer Query1431—

Writing & Preference Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 64.0 (#59), Mistral Nemo: 28.5 (#296)

BenchmarkGrok 4.20 Multi-AgentMistral Nemo
LMArena Text1450—
LMArena Creative Writing1436—
EQ-Bench Creative Writing—881
LMArena Multi-Turn1452—

Frequently asked questions

Is Grok 4.20 Multi-Agent better than Mistral Nemo?

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 26.4 on the Noometry Index. Mistral Nemo costs 10× less per token, which makes it the better buy when Grok 4.20 Multi-Agent's lead doesn't matter for your workload.

Which is cheaper, Grok 4.20 Multi-Agent or Mistral Nemo?

Mistral Nemo is cheaper. It lists at $0.15 per million input tokens and $0.15 per million output tokens; Grok 4.20 Multi-Agent lists at $1.25 and $2.50.

Which has the bigger context window?

Grok 4.20 Multi-Agent does, with 1M tokens against 128K.

How many benchmarks do Grok 4.20 Multi-Agent and Mistral Nemo share?

0 benchmarks have published results for both models. Grok 4.20 Multi-Agent has 20 scored results on Noometry and Mistral Nemo has 10.

Related comparisons

Go deeper