Model comparison

Grok 4.20 Multi-Agent vs Qwen2.5 7B Instruct

Grok 4.20 Multi-Agent is the stronger model overall, scoring 45.5 to 28.6 on the Noometry Index. Qwen2.5 7B Instruct costs 5.1× less per token, which makes it the better buy when Grok 4.20 Multi-Agent's lead doesn't matter for your workload.

Last verified October 10, 2026. 0 shared benchmarks.

Grok 4.20 Multi-Agent xAI

45.5

Rank #62 Confirmed

Qwen2.5 7B Instruct

Alibaba (Qwen)

28.6

Rank #314 Confirmed

Summary

The widest gap is in reasoning, where Grok 4.20 Multi-Agent leads 42.4 to 14.3.
Qwen2.5 7B Instruct is cheaper at $0.17 / $0.70 per million input/output tokens, against $1.25 / $2.50 for Grok 4.20 Multi-Agent.
Grok 4.20 Multi-Agent accepts more context: 1M tokens versus 131K.
Qwen2.5 7B Instruct has downloadable open weights; the other is API-only.

Side by side

Grok 4.20 Multi-Agent and Qwen2.5 7B Instruct specifications
	Grok 4.20 Multi-Agent	Qwen2.5 7B Instruct
Provider	xAI	Alibaba (Qwen)
Noometry Index	45.5	28.6
Released	2026-03-09	2024-09
Weights	Proprietary	Open
Context window	1M	131K
Max output	30K	8K
Input $ / M tokens	$1.25	$0.17
Output $ / M tokens	$2.50	$0.70
Results tracked	20	15

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 42.4 (#91), Qwen2.5 7B Instruct: 35.9 (#204)

Coding benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen2.5 7B Instruct
BigCodeBench Instruct	—	37.6%
LMArena Coding	1458	—
BigCodeBench Complete	—	46.1%

Agentic & Tool Use Not comparable

Grok 4.20 Multi-Agent: —, Qwen2.5 7B Instruct: 23.5 (#117)

Agentic & Tool Use benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen2.5 7B Instruct
BALROG	—	7.8%
LMArena Search	1204	—

Reasoning Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 42.4 (#44), Qwen2.5 7B Instruct: 14.3 (#317)

Reasoning benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen2.5 7B Instruct
NYT Connections (extended)	89.6%	—
Chess Puzzles	—	0%
LMArena Hard Prompts	1448	—
DTBench	—	47.7%
LMCA	—	6.4%
Epoch Capabilities Index	—	118.44

Math Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 36.6 (#106), Qwen2.5 7B Instruct: 11.8 (#300)

Math benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen2.5 7B Instruct
OTIS Mock AIME 2024-2025	—	2.5%
Omni-MATH	—	29.4%
LMArena Math	1441	—

Knowledge Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 39.7 (#116), Qwen2.5 7B Instruct: 17.0 (#281)

Knowledge benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen2.5 7B Instruct
GPQA Diamond	—	35.5%
MMLU-Pro	—	53.9%
GPQA (HELM)	—	34.1%
LMArena Expert	1445	—
MMLU	—	72.9%

Multimodal Not comparable

Grok 4.20 Multi-Agent: 39.8 (#44), Qwen2.5 7B Instruct: —

Multimodal benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen2.5 7B Instruct
LMArena Vision	1259	—

Multilingual Not comparable

Grok 4.20 Multi-Agent: 54.6 (#40), Qwen2.5 7B Instruct: —

Multilingual benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen2.5 7B Instruct
LMArena Non-English	1440	—
LMArena Chinese	1475	—
LMArena French	1467	—
LMArena German	1456	—
LMArena Japanese	1405	—
LMArena Korean	1416	—
LMArena Russian	1457	—
LMArena Spanish	1447	—

Instruction Following Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 75.0 (#80), Qwen2.5 7B Instruct: 63.4 (#226)

Instruction Following benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen2.5 7B Instruct
IFEval	—	74.1%
LMArena Instruction Following	1420	—

Long Context Not comparable

Grok 4.20 Multi-Agent: 43.7 (#84), Qwen2.5 7B Instruct: —

Long Context benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen2.5 7B Instruct
LMArena Longer Query	1430	—

Writing & Preference Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 64.1 (#57), Qwen2.5 7B Instruct: 48.8 (#194)

Writing & Preference benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen2.5 7B Instruct
LMArena Text	1450	—
LMArena Creative Writing	1435	—
WildBench	—	73.1%
LMArena Multi-Turn	1451	—

Frequently asked questions

Is Grok 4.20 Multi-Agent better than Qwen2.5 7B Instruct?

Which is cheaper, Grok 4.20 Multi-Agent or Qwen2.5 7B Instruct?

Qwen2.5 7B Instruct is cheaper. It lists at $0.17 per million input tokens and $0.70 per million output tokens; Grok 4.20 Multi-Agent lists at $1.25 and $2.50.

Is Grok 4.20 Multi-Agent or Qwen2.5 7B Instruct better for coding?

Grok 4.20 Multi-Agent scores higher on coding benchmarks: 42.4 versus 35.9 in the Noometry coding category.

Which has the bigger context window?

Grok 4.20 Multi-Agent does, with 1M tokens against 131K.

How many benchmarks do Grok 4.20 Multi-Agent and Qwen2.5 7B Instruct share?

0 benchmarks have published results for both models. Grok 4.20 Multi-Agent has 20 scored results on Noometry and Qwen2.5 7B Instruct has 15.