Noometry

Model comparison

Grok 4.20 Multi-Agent vs OLMo 2 Furious 13B

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 29.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

OLMo 2 Furious 13B Allen Institute for AI (Ai2)

29.7

Rank #304 Confirmed

Summary

  • The widest gap is in reasoning, where Grok 4.20 Multi-Agent leads 43.9 to 15.5.
  • OLMo 2 Furious 13B has downloadable open weights; the other is API-only.

Side by side

Grok 4.20 Multi-AgentOLMo 2 Furious 13B
ProviderxAIAllen Institute for AI (Ai2)
Noometry Index46.229.7
Released2026-03-092024-12-31
WeightsProprietaryOpen
Context window1M—
Max output30K—
Input $ / M tokens$1.25—
Output $ / M tokens$2.50—
Results tracked2012

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.0 (#92), OLMo 2 Furious 13B: 28.6 (#313)

BenchmarkGrok 4.20 Multi-AgentOLMo 2 Furious 13B
LiveBench Coding—10.4%
LMArena Coding1457—

Agentic & Tool Use Not comparable

Grok 4.20 Multi-Agent: —, OLMo 2 Furious 13B: —

BenchmarkGrok 4.20 Multi-AgentOLMo 2 Furious 13B
LMArena Search1204—

Reasoning Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.9 (#48), OLMo 2 Furious 13B: 15.5 (#314)

BenchmarkGrok 4.20 Multi-AgentOLMo 2 Furious 13B
NYT Connections (extended)89.6%—
LiveBench Reasoning—16.3%
LMArena Hard Prompts1448—
LiveBench Data Analysis—20.6%
LiveBench—22.1%

Math Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 39.4 (#104), OLMo 2 Furious 13B: 23.1 (#273)

BenchmarkGrok 4.20 Multi-AgentOLMo 2 Furious 13B
Omni-MATH—15.6%
LiveBench Math—13.6%
LMArena Math1442—

Knowledge Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 40.4 (#119), OLMo 2 Furious 13B: 18.3 (#283)

BenchmarkGrok 4.20 Multi-AgentOLMo 2 Furious 13B
MMLU-Pro—31%
GPQA (HELM)—31.6%
LMArena Expert1445—

Multimodal Not comparable

Grok 4.20 Multi-Agent: 40.5 (#48), OLMo 2 Furious 13B: —

BenchmarkGrok 4.20 Multi-AgentOLMo 2 Furious 13B
LMArena Vision1259—

Multilingual Not comparable

Grok 4.20 Multi-Agent: 54.4 (#43), OLMo 2 Furious 13B: —

BenchmarkGrok 4.20 Multi-AgentOLMo 2 Furious 13B
LMArena Non-English1440—
LMArena Chinese1475—
LMArena French1466—
LMArena German1456—
LMArena Japanese1405—
LMArena Korean1416—
LMArena Russian1457—
LMArena Spanish1447—

Instruction Following Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 74.8 (#84), OLMo 2 Furious 13B: 60.9 (#248)

BenchmarkGrok 4.20 Multi-AgentOLMo 2 Furious 13B
LiveBench Instruction Following—60.6%
IFEval—73%
LMArena Instruction Following1420—

Long Context Not comparable

Grok 4.20 Multi-Agent: 43.7 (#88), OLMo 2 Furious 13B: —

BenchmarkGrok 4.20 Multi-AgentOLMo 2 Furious 13B
LMArena Longer Query1431—

Writing & Preference Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 64.0 (#59), OLMo 2 Furious 13B: 42.9 (#230)

BenchmarkGrok 4.20 Multi-AgentOLMo 2 Furious 13B
LMArena Text1450—
LMArena Creative Writing1436—
WildBench—68.9%
LMArena Multi-Turn1452—
LiveBench Language—11.2%

Frequently asked questions

Is Grok 4.20 Multi-Agent better than OLMo 2 Furious 13B?

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 29.7 on the Noometry Index.

Is Grok 4.20 Multi-Agent or OLMo 2 Furious 13B better for coding?

Grok 4.20 Multi-Agent scores higher on coding benchmarks: 43.0 versus 28.6 in the Noometry coding category.

How many benchmarks do Grok 4.20 Multi-Agent and OLMo 2 Furious 13B share?

0 benchmarks have published results for both models. Grok 4.20 Multi-Agent has 20 scored results on Noometry and OLMo 2 Furious 13B has 12.

Related comparisons

Go deeper