Noometry

Model comparison

Grok 4.20 Multi-Agent vs Olmo 3.1 32b Instruct

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 39.4 on the Noometry Index.

Last verified . 16 shared benchmarks.

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

Olmo 3.1 32b Instruct Allen Institute for AI (Ai2)

39.4

Rank #168 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Grok 4.20 Multi-Agent scores higher in 8 categories and Olmo 3.1 32b Instruct in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.20 Multi-Agent leads 43.9 to 26.4.
  • Olmo 3.1 32b Instruct has downloadable open weights; the other is API-only.

Side by side

Grok 4.20 Multi-AgentOlmo 3.1 32b Instruct
ProviderxAIAllen Institute for AI (Ai2)
Noometry Index46.239.4
Released2026-03-09—
WeightsProprietaryOpen
Context window1M—
Max output30K—
Input $ / M tokens$1.25—
Output $ / M tokens$2.50—
Results tracked2016

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.0 (#92), Olmo 3.1 32b Instruct: 39.5 (#157)

BenchmarkGrok 4.20 Multi-AgentOlmo 3.1 32b Instruct
LMArena Coding14571347

Agentic & Tool Use Not comparable

Grok 4.20 Multi-Agent: —, Olmo 3.1 32b Instruct: —

BenchmarkGrok 4.20 Multi-AgentOlmo 3.1 32b Instruct
LMArena Search1204—

Reasoning Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.9 (#48), Olmo 3.1 32b Instruct: 26.4 (#132)

BenchmarkGrok 4.20 Multi-AgentOlmo 3.1 32b Instruct
LMArena Hard Prompts14481322
NYT Connections (extended)89.6%—

Math Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 39.4 (#104), Olmo 3.1 32b Instruct: 36.3 (#167)

BenchmarkGrok 4.20 Multi-AgentOlmo 3.1 32b Instruct
LMArena Math14421305

Knowledge Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 40.4 (#119), Olmo 3.1 32b Instruct: 36.1 (#175)

BenchmarkGrok 4.20 Multi-AgentOlmo 3.1 32b Instruct
LMArena Expert14451308

Multimodal Not comparable

Grok 4.20 Multi-Agent: 40.5 (#48), Olmo 3.1 32b Instruct: —

BenchmarkGrok 4.20 Multi-AgentOlmo 3.1 32b Instruct
LMArena Vision1259—

Multilingual Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 54.4 (#43), Olmo 3.1 32b Instruct: 42.6 (#191)

BenchmarkGrok 4.20 Multi-AgentOlmo 3.1 32b Instruct
LMArena Non-English14401275
LMArena Chinese14751304
LMArena French14661328
LMArena German14561282
LMArena Korean14161206
LMArena Russian14571268
LMArena Spanish14471336
LMArena Japanese1405—

Instruction Following Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 74.8 (#84), Olmo 3.1 32b Instruct: 68.6 (#187)

BenchmarkGrok 4.20 Multi-AgentOlmo 3.1 32b Instruct
LMArena Instruction Following14201299

Long Context Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.7 (#88), Olmo 3.1 32b Instruct: 39.9 (#166)

BenchmarkGrok 4.20 Multi-AgentOlmo 3.1 32b Instruct
LMArena Longer Query14311312

Writing & Preference Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 64.0 (#59), Olmo 3.1 32b Instruct: 50.2 (#185)

BenchmarkGrok 4.20 Multi-AgentOlmo 3.1 32b Instruct
LMArena Text14501311
LMArena Creative Writing14361264
LMArena Multi-Turn14521309

Frequently asked questions

Is Grok 4.20 Multi-Agent better than Olmo 3.1 32b Instruct?

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 39.4 on the Noometry Index.

Is Grok 4.20 Multi-Agent or Olmo 3.1 32b Instruct better for coding?

Grok 4.20 Multi-Agent scores higher on coding benchmarks: 43.0 versus 39.5 in the Noometry coding category.

How many benchmarks do Grok 4.20 Multi-Agent and Olmo 3.1 32b Instruct share?

16 benchmarks have published results for both models. Grok 4.20 Multi-Agent has 20 scored results on Noometry and Olmo 3.1 32b Instruct has 16.

Related comparisons

Go deeper