Model comparison

Grok 4.20 Multi-Agent vs Qwen3.7 Flash

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 39.9 on the Noometry Index. Qwen3.7 Flash costs 28× less per token, which makes it the better buy when Grok 4.20 Multi-Agent's lead doesn't matter for your workload.

Last verified October 10, 2026. 1 shared benchmarks.

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

Qwen3.7 Flash

Alibaba (Qwen)

39.9

Rank #156 Confirmed

Summary

They share 1 benchmark with published results for both. Grok 4.20 Multi-Agent scores higher in 2 categories and Qwen3.7 Flash in 1 category; 3 gaps are clear of the uncertainty.
The widest gap is in reasoning, where Grok 4.20 Multi-Agent leads 43.9 to 28.2.
The biggest single-benchmark swing is NYT Connections (extended): 89.6% for Grok 4.20 Multi-Agent and 43.8% for Qwen3.7 Flash.
Qwen3.7 Flash is cheaper at $0.03 / $0.13 per million input/output tokens, against $1.25 / $2.50 for Grok 4.20 Multi-Agent.

Side by side

Grok 4.20 Multi-Agent and Qwen3.7 Flash specifications
	Grok 4.20 Multi-Agent	Qwen3.7 Flash
Provider	xAI	Alibaba (Qwen)
Noometry Index	46.2	39.9
Released	2026-03-09	2026-07-15
Weights	Proprietary	Proprietary
Context window	1M	1M
Max output	30K	131K
Input $ / M tokens	$1.25	$0.03
Output $ / M tokens	$2.50	$0.13
Results tracked	20	7

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Grok 4.20 Multi-Agent: 43.0 (#92), Qwen3.7 Flash: —

Coding benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3.7 Flash
LMArena Coding	1457	—

Agentic & Tool Use Not comparable

Grok 4.20 Multi-Agent: —, Qwen3.7 Flash: —

Agentic & Tool Use benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3.7 Flash
LMArena Search	1204	—

Reasoning Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.9 (#48), Qwen3.7 Flash: 28.2 (#108)

Reasoning benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3.7 Flash
NYT Connections (extended)	89.6%	43.8%
Chess Puzzles	—	23%
LMArena Hard Prompts	1448	—
Mystery Game Puzzles	—	15%
Epoch Capabilities Index	—	144.64

Math Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 39.4 (#104), Qwen3.7 Flash: 38.3 (#140)

Math benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3.7 Flash
FrontierMath (Tiers 1-3)	—	19.3%
OTIS Mock AIME 2024-2025	—	86.7%
LMArena Math	1442	—

Knowledge Qwen3.7 Flash leads

Grok 4.20 Multi-Agent: 40.4 (#119), Qwen3.7 Flash: 48.9 (#75)

Knowledge benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3.7 Flash
GPQA Diamond	—	82.3%
LMArena Expert	1445	—

Multimodal Not comparable

Grok 4.20 Multi-Agent: 40.5 (#48), Qwen3.7 Flash: —

Multimodal benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3.7 Flash
LMArena Vision	1259	—

Multilingual Not comparable

Grok 4.20 Multi-Agent: 54.4 (#43), Qwen3.7 Flash: —

Multilingual benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3.7 Flash
LMArena Non-English	1440	—
LMArena Chinese	1475	—
LMArena French	1466	—
LMArena German	1456	—
LMArena Japanese	1405	—
LMArena Korean	1416	—
LMArena Russian	1457	—
LMArena Spanish	1447	—

Instruction Following Not comparable

Grok 4.20 Multi-Agent: 74.8 (#84), Qwen3.7 Flash: —

Instruction Following benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3.7 Flash
LMArena Instruction Following	1420	—

Long Context Not comparable

Grok 4.20 Multi-Agent: 43.7 (#88), Qwen3.7 Flash: —

Long Context benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3.7 Flash
LMArena Longer Query	1431	—

Writing & Preference Not comparable

Grok 4.20 Multi-Agent: 64.0 (#59), Qwen3.7 Flash: —

Writing & Preference benchmarks
Benchmark	Grok 4.20 Multi-Agent	Qwen3.7 Flash
LMArena Text	1450	—
LMArena Creative Writing	1436	—
LMArena Multi-Turn	1452	—

Frequently asked questions

Is Grok 4.20 Multi-Agent better than Qwen3.7 Flash?

Which is cheaper, Grok 4.20 Multi-Agent or Qwen3.7 Flash?

Qwen3.7 Flash is cheaper. It lists at $0.03 per million input tokens and $0.13 per million output tokens; Grok 4.20 Multi-Agent lists at $1.25 and $2.50.

Which has the bigger context window?

Both accept 1M tokens.

How many benchmarks do Grok 4.20 Multi-Agent and Qwen3.7 Flash share?

1 benchmark has published results for both models. Grok 4.20 Multi-Agent has 20 scored results on Noometry and Qwen3.7 Flash has 7.