Model comparison

Grok 4.20 Multi-Agent vs Solar Pro4

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 42.1 on the Noometry Index. Solar Pro4 costs 3.0× less per token, which makes it the better buy when Grok 4.20 Multi-Agent's lead doesn't matter for your workload.

Last verified October 11, 2026. 17 shared benchmarks.

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

Solar Pro4

Upstage

42.1

Rank #121 Confirmed

Summary

They share 17 benchmarks with published results for both. Grok 4.20 Multi-Agent scores higher in 8 categories and Solar Pro4 in 0 categories; 6 gaps are clear of the uncertainty.
The widest gap is in reasoning, where Grok 4.20 Multi-Agent leads 43.9 to 28.5.
Solar Pro4 is cheaper at $0.30 / $1.20 per million input/output tokens, against $1.25 / $2.50 for Grok 4.20 Multi-Agent.
Grok 4.20 Multi-Agent accepts more context: 1M tokens versus 524K.

Side by side

Grok 4.20 Multi-Agent and Solar Pro4 specifications
	Grok 4.20 Multi-Agent	Solar Pro4
Provider	xAI	Upstage
Noometry Index	46.2	42.1
Released	2026-03-09	2026-08-06
Weights	Proprietary	Proprietary
Context window	1M	524K
Max output	30K	131K
Input $ / M tokens	$1.25	$0.30
Output $ / M tokens	$2.50	$1.20
Results tracked	20	18

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.0 (#92), Solar Pro4: 40.1 (#149)

Coding benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Coding	1457	1437
LMArena WebDev	—	1371

Agentic & Tool Use Not comparable

Grok 4.20 Multi-Agent: —, Solar Pro4: —

Agentic & Tool Use benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Search	1204	—

Reasoning Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.9 (#48), Solar Pro4: 28.5 (#104)

Reasoning benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Hard Prompts	1448	1399
NYT Connections (extended)	89.6%	—

Math Too close to call

Grok 4.20 Multi-Agent: 39.4 (#104), Solar Pro4: 38.8 (#128)

Math benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Math	1442	1416

Knowledge Too close to call

Grok 4.20 Multi-Agent: 40.4 (#119), Solar Pro4: 39.8 (#129)

Knowledge benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Expert	1445	1427

Multimodal Not comparable

Grok 4.20 Multi-Agent: 40.5 (#48), Solar Pro4: —

Multimodal benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Vision	1259	—

Multilingual Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 54.4 (#43), Solar Pro4: 48.7 (#139)

Multilingual benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Non-English	1440	1361
LMArena Chinese	1475	1415
LMArena French	1466	1397
LMArena German	1456	1364
LMArena Japanese	1405	1309
LMArena Korean	1416	1382
LMArena Russian	1457	1360
LMArena Spanish	1447	1401

Instruction Following Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 74.8 (#84), Solar Pro4: 72.7 (#132)

Instruction Following benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Instruction Following	1420	1377

Long Context Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.7 (#88), Solar Pro4: 42.1 (#130)

Long Context benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Longer Query	1431	1381

Writing & Preference Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 64.0 (#59), Solar Pro4: 56.5 (#138)

Writing & Preference benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Text	1450	1386
LMArena Creative Writing	1436	1316
LMArena Multi-Turn	1452	1385

Frequently asked questions

Is Grok 4.20 Multi-Agent better than Solar Pro4?

Which is cheaper, Grok 4.20 Multi-Agent or Solar Pro4?

Solar Pro4 is cheaper. It lists at $0.30 per million input tokens and $1.20 per million output tokens; Grok 4.20 Multi-Agent lists at $1.25 and $2.50.

Is Grok 4.20 Multi-Agent or Solar Pro4 better for coding?

Grok 4.20 Multi-Agent scores higher on coding benchmarks: 43.0 versus 40.1 in the Noometry coding category.

Which has the bigger context window?

Grok 4.20 Multi-Agent does, with 1M tokens against 524K.

How many benchmarks do Grok 4.20 Multi-Agent and Solar Pro4 share?

17 benchmarks have published results for both models. Grok 4.20 Multi-Agent has 20 scored results on Noometry and Solar Pro4 has 18.