Noometry

Model comparison

Grok-3 mini vs Grok 4.20 Multi-Agent

Grok 4.20 Multi-Agent is the stronger model overall, scoring 45.5 to 41.0 on the Noometry Index.

Last verified . 17 shared benchmarks.

Grok-3 mini xAI

41.0

Rank #130 Confirmed

Grok 4.20 Multi-Agent xAI

45.5

Rank #62 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Grok-3 mini scores higher in 3 categories and Grok 4.20 Multi-Agent in 5 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.20 Multi-Agent leads 42.4 to 13.8.

Side by side

Grok-3 miniGrok 4.20 Multi-Agent
ProviderxAIxAI
Noometry Index41.045.5
Released2025-04-092026-03-09
WeightsProprietaryProprietary
Context window—1M
Max output—30K
Input $ / M tokens—$1.25
Output $ / M tokens—$2.50
Results tracked3520

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.20 Multi-Agent leads

Grok-3 mini: 40.4 (#126), Grok 4.20 Multi-Agent: 42.4 (#91)

BenchmarkGrok-3 miniGrok 4.20 Multi-Agent
LMArena Coding13801458
Aider Polyglot49.3%—
WeirdML42.6%—

Agentic & Tool Use Not comparable

Grok-3 mini: —, Grok 4.20 Multi-Agent: —

BenchmarkGrok-3 miniGrok 4.20 Multi-Agent
LMArena Search—1204

Reasoning Grok 4.20 Multi-Agent leads

Grok-3 mini: 13.8 (#323), Grok 4.20 Multi-Agent: 42.4 (#44)

BenchmarkGrok-3 miniGrok 4.20 Multi-Agent
LMArena Hard Prompts13741448
ARC-AGI-20.4%—
Kagi LLM Benchmark61.3%—
NYT Connections (extended)—89.6%
ARC-AGI-116.5%—
Epoch Capabilities Index140.35—

Math Grok-3 mini leads

Grok-3 mini: 40.3 (#78), Grok 4.20 Multi-Agent: 36.6 (#106)

BenchmarkGrok-3 miniGrok 4.20 Multi-Agent
LMArena Math13861441
OTIS Mock AIME 2024-202577.8%—
Omni-MATH31.8%—
MATH Level 590.9%—
FrontierMath (Feb 2025 set)5.9%—

Knowledge Grok-3 mini leads

Grok-3 mini: 46.3 (#75), Grok 4.20 Multi-Agent: 39.7 (#116)

BenchmarkGrok-3 miniGrok 4.20 Multi-Agent
LMArena Expert13951445
GPQA Diamond76.3%—
MMLU-Pro79.9%—
Confabulations10.8%—
GPQA (HELM)67.5%—

Multimodal Not comparable

Grok-3 mini: —, Grok 4.20 Multi-Agent: 39.8 (#44)

BenchmarkGrok-3 miniGrok 4.20 Multi-Agent
LMArena Vision—1259

Multilingual Grok 4.20 Multi-Agent leads

Grok-3 mini: 48.3 (#141), Grok 4.20 Multi-Agent: 54.6 (#40)

BenchmarkGrok-3 miniGrok 4.20 Multi-Agent
LMArena Non-English13521440
LMArena Chinese13871475
LMArena French13571467
LMArena German13501456
LMArena Japanese13431405
LMArena Korean13361416
LMArena Russian13521457
LMArena Spanish13791447

Instruction Following Grok-3 mini leads

Grok-3 mini: 78.7 (#8), Grok 4.20 Multi-Agent: 75.0 (#80)

BenchmarkGrok-3 miniGrok 4.20 Multi-Agent
LMArena Instruction Following13561420
IFEval95.1%—

Long Context Grok 4.20 Multi-Agent leads

Grok-3 mini: 41.0 (#142), Grok 4.20 Multi-Agent: 43.7 (#84)

BenchmarkGrok-3 miniGrok 4.20 Multi-Agent
LMArena Longer Query13721430
Fiction.LiveBench66.7%—

Writing & Preference Grok 4.20 Multi-Agent leads

Grok-3 mini: 52.7 (#163), Grok 4.20 Multi-Agent: 64.1 (#57)

BenchmarkGrok-3 miniGrok 4.20 Multi-Agent
LMArena Text13701450
LMArena Creative Writing13421435
LMArena Multi-Turn13551451
Short-Story Creative Writing73.5%—
WildBench65.1%—

Frequently asked questions

Is Grok-3 mini better than Grok 4.20 Multi-Agent?

Grok 4.20 Multi-Agent is the stronger model overall, scoring 45.5 to 41.0 on the Noometry Index.

Is Grok-3 mini or Grok 4.20 Multi-Agent better for coding?

Grok 4.20 Multi-Agent scores higher on coding benchmarks: 42.4 versus 40.4 in the Noometry coding category.

How many benchmarks do Grok-3 mini and Grok 4.20 Multi-Agent share?

17 benchmarks have published results for both models. Grok-3 mini has 35 scored results on Noometry and Grok 4.20 Multi-Agent has 20.

Related comparisons

Go deeper