Model comparison

Grok 4.20 Multi-Agent vs Qwen3 14B

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 35.5 on the Noometry Index. Qwen3 14B costs 2.6× less per token, which makes it the better buy when Grok 4.20 Multi-Agent's lead doesn't matter for your workload.

Last verified October 10, 2026. 0 shared benchmarks.

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

Qwen3 14B

Alibaba (Qwen)

35.5

Rank #225 Confirmed

Summary

The widest gap is in reasoning, where Grok 4.20 Multi-Agent leads 43.9 to 18.5.
Qwen3 14B is cheaper at $0.35 / $1.40 per million input/output tokens, against $1.25 / $2.50 for Grok 4.20 Multi-Agent.
Grok 4.20 Multi-Agent accepts more context: 1M tokens versus 131K.
Qwen3 14B has downloadable open weights; the other is API-only.

Side by side

Grok 4.20 Multi-Agent and Qwen3 14B specifications
	Grok 4.20 Multi-Agent	Qwen3 14B
Provider	xAI	Alibaba (Qwen)
Noometry Index	46.2	35.5
Released	2026-03-09	2025-04
Weights	Proprietary	Open
Context window	1M	131K
Max output	30K	8K
Input $ / M tokens	$1.25	$0.35
Output $ / M tokens	$2.50	$1.40
Results tracked	20	12

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.0 (#92), Qwen3 14B: 37.3 (#195)

Coding benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 14B
SciCode	—	31.6%
LMArena Coding	1457	—

Agentic & Tool Use Not comparable

Grok 4.20 Multi-Agent: —, Qwen3 14B: 29.6 (#83)

Agentic & Tool Use benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 14B
Berkeley Function Calling Leaderboard	—	41%
LMArena Search	1204	—

Reasoning Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.9 (#48), Qwen3 14B: 18.5 (#280)

Reasoning benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 14B
Kagi LLM Benchmark	—	49.1%
NYT Connections (extended)	89.6%	—
CritPt	—	0%
Chess Puzzles	—	4%
LMArena Hard Prompts	1448	—
DTBench	—	64%
LMCA	—	18.2%
Epoch Capabilities Index	—	138.23

Math Too close to call

Grok 4.20 Multi-Agent: 39.4 (#104), Qwen3 14B: 38.6 (#133)

Math benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 14B
OTIS Mock AIME 2024-2025	—	66.4%
LMArena Math	1442	—

Knowledge Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 40.4 (#119), Qwen3 14B: 39.3 (#134)

Knowledge benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 14B
GPQA Diamond	—	63.8%
Vectara Hallucination Rate	—	5.4%
LMArena Expert	1445	—

Multimodal Not comparable

Grok 4.20 Multi-Agent: 40.5 (#48), Qwen3 14B: —

Multimodal benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 14B
LMArena Vision	1259	—

Multilingual Not comparable

Grok 4.20 Multi-Agent: 54.4 (#43), Qwen3 14B: —

Multilingual benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 14B
LMArena Non-English	1440	—
LMArena Chinese	1475	—
LMArena French	1466	—
LMArena German	1456	—
LMArena Japanese	1405	—
LMArena Korean	1416	—
LMArena Russian	1457	—
LMArena Spanish	1447	—

Instruction Following Not comparable

Grok 4.20 Multi-Agent: 74.8 (#84), Qwen3 14B: —

Instruction Following benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 14B
LMArena Instruction Following	1420	—

Long Context Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.7 (#88), Qwen3 14B: 38.1 (#204)

Long Context benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 14B
Fiction.LiveBench	—	62.5%
LMArena Longer Query	1431	—

Writing & Preference Not comparable

Grok 4.20 Multi-Agent: 64.0 (#59), Qwen3 14B: —

Writing & Preference benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3 14B
LMArena Text	1450	—
LMArena Creative Writing	1436	—
LMArena Multi-Turn	1452	—

Frequently asked questions

Is Grok 4.20 Multi-Agent better than Qwen3 14B?

Which is cheaper, Grok 4.20 Multi-Agent or Qwen3 14B?

Qwen3 14B is cheaper. It lists at $0.35 per million input tokens and $1.40 per million output tokens; Grok 4.20 Multi-Agent lists at $1.25 and $2.50.

Is Grok 4.20 Multi-Agent or Qwen3 14B better for coding?

Grok 4.20 Multi-Agent scores higher on coding benchmarks: 43.0 versus 37.3 in the Noometry coding category.

Which has the bigger context window?

Grok 4.20 Multi-Agent does, with 1M tokens against 131K.

How many benchmarks do Grok 4.20 Multi-Agent and Qwen3 14B share?

0 benchmarks have published results for both models. Grok 4.20 Multi-Agent has 20 scored results on Noometry and Qwen3 14B has 12.