Model comparison

Grok 4.20 Multi-Agent vs Qwen3 8B

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 33.7 on the Noometry Index. Qwen3 8B costs 5.0× less per token, which makes it the better buy when Grok 4.20 Multi-Agent's lead doesn't matter for your workload.

Last verified October 10, 2026. 0 shared benchmarks.

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

Qwen3 8B

Alibaba (Qwen)

33.7

Rank #238 Confirmed

Summary

The widest gap is in reasoning, where Grok 4.20 Multi-Agent leads 43.9 to 16.6.
Qwen3 8B is cheaper at $0.18 / $0.70 per million input/output tokens, against $1.25 / $2.50 for Grok 4.20 Multi-Agent.
Grok 4.20 Multi-Agent accepts more context: 1M tokens versus 131K.
Qwen3 8B has downloadable open weights; the other is API-only.

Side by side

Grok 4.20 Multi-Agent and Qwen3 8B specifications
	Grok 4.20 Multi-Agent	Qwen3 8B
Provider	xAI	Alibaba (Qwen)
Noometry Index	46.2	33.7
Released	2026-03-09	2025-04
Weights	Proprietary	Open
Context window	1M	131K
Max output	30K	8K
Input $ / M tokens	$1.25	$0.18
Output $ / M tokens	$2.50	$0.70
Results tracked	20	11

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.0 (#92), Qwen3 8B: 34.0 (#248)

Coding benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 8B
SciCode	—	22.6%
LMArena Coding	1457	—

Agentic & Tool Use Not comparable

Grok 4.20 Multi-Agent: —, Qwen3 8B: 30.2 (#78)

Agentic & Tool Use benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 8B
Berkeley Function Calling Leaderboard	—	42.6%
LMArena Search	1204	—

Reasoning Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.9 (#48), Qwen3 8B: 16.6 (#303)

Reasoning benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 8B
NYT Connections (extended)	89.6%	—
CritPt	—	0%
Chess Puzzles	—	5%
LMArena Hard Prompts	1448	—
DTBench	—	59.7%
LMCA	—	8.8%
Epoch Capabilities Index	—	136.17

Math Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 39.4 (#104), Qwen3 8B: 34.9 (#191)

Math benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 8B
OTIS Mock AIME 2024-2025	—	56.1%
LMArena Math	1442	—

Knowledge Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 40.4 (#119), Qwen3 8B: 36.1 (#173)

Knowledge benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 8B
GPQA Diamond	—	56.8%
Vectara Hallucination Rate	—	4.8%
LMArena Expert	1445	—

Multimodal Not comparable

Grok 4.20 Multi-Agent: 40.5 (#48), Qwen3 8B: —

Multimodal benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 8B
LMArena Vision	1259	—

Multilingual Not comparable

Grok 4.20 Multi-Agent: 54.4 (#43), Qwen3 8B: —

Multilingual benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 8B
LMArena Non-English	1440	—
LMArena Chinese	1475	—
LMArena French	1466	—
LMArena German	1456	—
LMArena Japanese	1405	—
LMArena Korean	1416	—
LMArena Russian	1457	—
LMArena Spanish	1447	—

Instruction Following Not comparable

Grok 4.20 Multi-Agent: 74.8 (#84), Qwen3 8B: —

Instruction Following benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 8B
LMArena Instruction Following	1420	—

Long Context Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.7 (#88), Qwen3 8B: 37.9 (#210)

Long Context benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 8B
Fiction.LiveBench	—	62.1%
LMArena Longer Query	1431	—

Writing & Preference Not comparable

Grok 4.20 Multi-Agent: 64.0 (#59), Qwen3 8B: —

Writing & Preference benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 8B
LMArena Text	1450	—
LMArena Creative Writing	1436	—
LMArena Multi-Turn	1452	—

Frequently asked questions

Is Grok 4.20 Multi-Agent better than Qwen3 8B?

Which is cheaper, Grok 4.20 Multi-Agent or Qwen3 8B?

Qwen3 8B is cheaper. It lists at $0.18 per million input tokens and $0.70 per million output tokens; Grok 4.20 Multi-Agent lists at $1.25 and $2.50.

Is Grok 4.20 Multi-Agent or Qwen3 8B better for coding?

Grok 4.20 Multi-Agent scores higher on coding benchmarks: 43.0 versus 34.0 in the Noometry coding category.

Which has the bigger context window?

Grok 4.20 Multi-Agent does, with 1M tokens against 131K.

How many benchmarks do Grok 4.20 Multi-Agent and Qwen3 8B share?

0 benchmarks have published results for both models. Grok 4.20 Multi-Agent has 20 scored results on Noometry and Qwen3 8B has 11.