Noometry

Model comparison

Grok 4.20 Multi-Agent vs Qwen3.5 Max Preview

Grok 4.20 Multi-Agent and Qwen3.5 Max Preview score almost the same on the Noometry Index (46.2 vs 45.3), so choose on price, context window or the category you care about most.

Last verified . 17 shared benchmarks.

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

Qwen3.5 Max Preview Alibaba (Qwen)

45.3

Rank #71 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Grok 4.20 Multi-Agent scores higher in 1 category and Qwen3.5 Max Preview in 7 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.20 Multi-Agent leads 43.9 to 30.8.

Side by side

Grok 4.20 Multi-AgentQwen3.5 Max Preview
ProviderxAIAlibaba (Qwen)
Noometry Index46.245.3
Released2026-03-09—
WeightsProprietaryProprietary
Context window1M—
Max output30K—
Input $ / M tokens$1.25—
Output $ / M tokens$2.50—
Results tracked2017

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Grok 4.20 Multi-Agent: 43.0 (#92), Qwen3.5 Max Preview: 44.0 (#77)

BenchmarkGrok 4.20 Multi-AgentQwen3.5 Max Preview
LMArena Coding14571487

Agentic & Tool Use Not comparable

Grok 4.20 Multi-Agent: —, Qwen3.5 Max Preview: —

BenchmarkGrok 4.20 Multi-AgentQwen3.5 Max Preview
LMArena Search1204—

Reasoning Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.9 (#48), Qwen3.5 Max Preview: 30.8 (#84)

BenchmarkGrok 4.20 Multi-AgentQwen3.5 Max Preview
LMArena Hard Prompts14481483
NYT Connections (extended)89.6%—

Math Too close to call

Grok 4.20 Multi-Agent: 39.4 (#104), Qwen3.5 Max Preview: 40.1 (#94)

BenchmarkGrok 4.20 Multi-AgentQwen3.5 Max Preview
LMArena Math14421474

Knowledge Qwen3.5 Max Preview leads

Grok 4.20 Multi-Agent: 40.4 (#119), Qwen3.5 Max Preview: 41.8 (#107)

BenchmarkGrok 4.20 Multi-AgentQwen3.5 Max Preview
LMArena Expert14451489

Multimodal Not comparable

Grok 4.20 Multi-Agent: 40.5 (#48), Qwen3.5 Max Preview: —

BenchmarkGrok 4.20 Multi-AgentQwen3.5 Max Preview
LMArena Vision1259—

Multilingual Qwen3.5 Max Preview leads

Grok 4.20 Multi-Agent: 54.4 (#43), Qwen3.5 Max Preview: 56.2 (#22)

BenchmarkGrok 4.20 Multi-AgentQwen3.5 Max Preview
LMArena Non-English14401465
LMArena Chinese14751534
LMArena French14661484
LMArena German14561487
LMArena Japanese14051495
LMArena Korean14161438
LMArena Russian14571471
LMArena Spanish14471470

Instruction Following Qwen3.5 Max Preview leads

Grok 4.20 Multi-Agent: 74.8 (#84), Qwen3.5 Max Preview: 77.0 (#31)

BenchmarkGrok 4.20 Multi-AgentQwen3.5 Max Preview
LMArena Instruction Following14201467

Long Context Qwen3.5 Max Preview leads

Grok 4.20 Multi-Agent: 43.7 (#88), Qwen3.5 Max Preview: 45.2 (#45)

BenchmarkGrok 4.20 Multi-AgentQwen3.5 Max Preview
LMArena Longer Query14311476

Writing & Preference Qwen3.5 Max Preview leads

Grok 4.20 Multi-Agent: 64.0 (#59), Qwen3.5 Max Preview: 66.0 (#41)

BenchmarkGrok 4.20 Multi-AgentQwen3.5 Max Preview
LMArena Text14501470
LMArena Creative Writing14361464
LMArena Multi-Turn14521478

Frequently asked questions

Is Grok 4.20 Multi-Agent better than Qwen3.5 Max Preview?

Grok 4.20 Multi-Agent and Qwen3.5 Max Preview score almost the same on the Noometry Index (46.2 vs 45.3), so choose on price, context window or the category you care about most.

Is Grok 4.20 Multi-Agent or Qwen3.5 Max Preview better for coding?

They score almost the same on coding (43.0 vs 44.0); test both on your own repository before choosing.

How many benchmarks do Grok 4.20 Multi-Agent and Qwen3.5 Max Preview share?

17 benchmarks have published results for both models. Grok 4.20 Multi-Agent has 20 scored results on Noometry and Qwen3.5 Max Preview has 17.

Related comparisons

Go deeper