Noometry

Model comparison

Gemini 3.1 Pro Preview vs Grok 4.20 Multi-Agent

Gemini 3.1 Pro Preview is the stronger model overall, scoring 56.7 to 45.5 on the Noometry Index. Grok 4.20 Multi-Agent costs 2.9× less per token, which makes it the better buy when Gemini 3.1 Pro Preview's lead doesn't matter for your workload.

Last verified . 20 shared benchmarks.

Gemini 3.1 Pro Preview Google

56.7

Rank #20 Confirmed

Grok 4.20 Multi-Agent xAI

45.5

Rank #62 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Gemini 3.1 Pro Preview scores higher in 8 categories and Grok 4.20 Multi-Agent in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 3.1 Pro Preview leads 71.8 to 39.7.
  • The biggest single-benchmark swing is NYT Connections (extended): 97.4% for Gemini 3.1 Pro Preview and 89.6% for Grok 4.20 Multi-Agent.
  • Grok 4.20 Multi-Agent is cheaper at $1.25 / $2.50 per million input/output tokens, against $2 / $12 for Gemini 3.1 Pro Preview.
  • Gemini 3.1 Pro Preview accepts more context: 1.05M tokens versus 1M.

Side by side

Gemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
ProviderGooglexAI
Noometry Index56.745.5
Released2026-02-192026-03-09
WeightsProprietaryProprietary
Context window1.05M1M
Max output66K30K
Input $ / M tokens$2$1.25
Output $ / M tokens$12$2.50
Results tracked7120

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Gemini 3.1 Pro Preview: 42.7 (#88), Grok 4.20 Multi-Agent: 42.4 (#91)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Coding14831458
SWE-bench Verified75.6%—
DeepSWE11.7%—
LMArena WebDev1446—
SciCode58.9%—
GSO22.6%—
WeirdML72.1%—
MirrorCode8.9%—
ALE-Bench1,161—
AlgoTune2.02—

Agentic & Tool Use Not comparable

Gemini 3.1 Pro Preview: 37.7 (#33), Grok 4.20 Multi-Agent: —

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Search12111204
Terminal-Bench80.2%—
APEX-Agents35.3%—
τ²-bench Banking26%—
DeepResearch Bench47.8%—
PostTrainBench22%—
BALROG57%—
ExploitBench26.1%—
GBAEval0.8%—
GDP.pdf17%—
METR Time Horizons77%—
Vending-Bench 23,774—

Reasoning Gemini 3.1 Pro Preview leads

Gemini 3.1 Pro Preview: 71.7 (#9), Grok 4.20 Multi-Agent: 42.4 (#44)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
NYT Connections (extended)97.4%89.6%
LMArena Hard Prompts14841448
ARC-AGI-277.1%—
SimpleBench79.6%—
ARC-AGI-198%—
CritPt17.7%—
Chess Puzzles55%—
EnigmaEval36.8%—
Thematic Generalization79.4%—
EBR-Bench14.3%—
Mystery Game Puzzles34%—
DTBench97.1%—
LMCA53.8%—
Epoch Capabilities Index154.92—
ForecastBench59—

Math Gemini 3.1 Pro Preview leads

Gemini 3.1 Pro Preview: 61.8 (#28), Grok 4.20 Multi-Agent: 36.6 (#106)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Math14851441
FrontierMath (Tiers 1-3)59.6%—
FrontierMath Tier 426.8%—
MathArena Final-Answer Competitions86.5%—
OTIS Mock AIME 2024-202595.6%—
ProofBench26%—
FrontierMath (Feb 2025 set)36.9%—
FrontierMath Tier 4 (v1)16.7%—

Knowledge Gemini 3.1 Pro Preview leads

Gemini 3.1 Pro Preview: 71.8 (#3), Grok 4.20 Multi-Agent: 39.7 (#116)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Expert14841445
GPQA Diamond94.4%—
Humanity's Last Exam46.4%—
SimpleQA Verified73.5%—
Vectara Hallucination Rate10.4%—

Multimodal Grok 4.20 Multi-Agent leads

Gemini 3.1 Pro Preview: 38.1 (#60), Grok 4.20 Multi-Agent: 39.8 (#44)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Vision12961259
Blueprint-Bench 226.5%—
Furniture Assembly26.7%—
LMArena Document1444—

Multilingual Gemini 3.1 Pro Preview leads

Gemini 3.1 Pro Preview: 57.1 (#11), Grok 4.20 Multi-Agent: 54.6 (#40)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Non-English14751440
LMArena Chinese15281475
LMArena French14881467
LMArena German14911456
LMArena Japanese14941405
LMArena Korean14581416
LMArena Russian14961457
LMArena Spanish14801447

Instruction Following Gemini 3.1 Pro Preview leads

Gemini 3.1 Pro Preview: 77.1 (#31), Grok 4.20 Multi-Agent: 75.0 (#80)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Instruction Following14651420

Long Context Gemini 3.1 Pro Preview leads

Gemini 3.1 Pro Preview: 47.3 (#17), Grok 4.20 Multi-Agent: 43.7 (#84)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Longer Query14821430
CL-bench20.8%—
CL-bench Life16.9%—

Writing & Preference Gemini 3.1 Pro Preview leads

Gemini 3.1 Pro Preview: 66.3 (#36), Grok 4.20 Multi-Agent: 64.1 (#57)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Text14801450
LMArena Creative Writing14821435
LMArena Multi-Turn14861451
EQ-Bench Creative Writing1491—
EQ-Bench 41142—

Frequently asked questions

Is Gemini 3.1 Pro Preview better than Grok 4.20 Multi-Agent?

Gemini 3.1 Pro Preview is the stronger model overall, scoring 56.7 to 45.5 on the Noometry Index. Grok 4.20 Multi-Agent costs 2.9× less per token, which makes it the better buy when Gemini 3.1 Pro Preview's lead doesn't matter for your workload.

Which is cheaper, Gemini 3.1 Pro Preview or Grok 4.20 Multi-Agent?

Grok 4.20 Multi-Agent is cheaper. It lists at $1.25 per million input tokens and $2.50 per million output tokens; Gemini 3.1 Pro Preview lists at $2 and $12.

Is Gemini 3.1 Pro Preview or Grok 4.20 Multi-Agent better for coding?

They score almost the same on coding (42.7 vs 42.4); test both on your own repository before choosing.

Which has the bigger context window?

Gemini 3.1 Pro Preview does, with 1.05M tokens against 1M.

How many benchmarks do Gemini 3.1 Pro Preview and Grok 4.20 Multi-Agent share?

20 benchmarks have published results for both models. Gemini 3.1 Pro Preview has 71 scored results on Noometry and Grok 4.20 Multi-Agent has 20.

Related comparisons

Go deeper