Model comparison

GPT-6.1 Sol vs Grok 4.20 Multi-Agent

Grok 4.20 Multi-Agent has enough public results to be ranked (#62); GPT-6.1 Sol does not yet, so treat this comparison as directional.

Last verified October 10, 2026. 0 shared benchmarks.

GPT-6.1 Sol OpenAI

42.1

Unranked Sparse

Grok 4.20 Multi-Agent xAI

45.5

Rank #62 Confirmed

Summary

The widest gap is in coding, where GPT-6.1 Sol leads 51.4 to 42.4.
Grok 4.20 Multi-Agent is cheaper at $1.25 / $2.50 per million input/output tokens, against $2 / $10 for GPT-6.1 Sol.
GPT-6.1 Sol accepts more context: 1.05M tokens versus 1M.

Side by side

GPT-6.1 Sol and Grok 4.20 Multi-Agent specifications
	GPT-6.1 Sol	Grok 4.20 Multi-Agent
Provider	OpenAI	xAI
Noometry Index	42.1	45.5
Released	2026-09-29	2026-03-09
Weights	Proprietary	Proprietary
Context window	1.05M	1M
Max output	128K	30K
Input $ / M tokens	$2	$1.25
Output $ / M tokens	$10	$2.50
Results tracked	2	20

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-6.1 Sol leads

GPT-6.1 Sol: 51.4, Grok 4.20 Multi-Agent: 42.4 (#91)

Coding benchmarks
Benchmark	GPT-6.1 Sol	Grok 4.20 Multi-Agent
DeepSWE	75.2%	—
LMArena Coding	—	1458

Agentic & Tool Use Not comparable

GPT-6.1 Sol: 34.3, Grok 4.20 Multi-Agent: —

Agentic & Tool Use benchmarks
Benchmark	GPT-6.1 Sol	Grok 4.20 Multi-Agent
GDP.pdf	32%	—
LMArena Search	—	1204

Reasoning Not comparable

GPT-6.1 Sol: —, Grok 4.20 Multi-Agent: 42.4 (#44)

Reasoning benchmarks
Benchmark	GPT-6.1 Sol	Grok 4.20 Multi-Agent
NYT Connections (extended)	—	89.6%
LMArena Hard Prompts	—	1448

Math Not comparable

GPT-6.1 Sol: —, Grok 4.20 Multi-Agent: 36.6 (#106)

Math benchmarks
Benchmark	GPT-6.1 Sol	Grok 4.20 Multi-Agent
LMArena Math	—	1441

Knowledge Not comparable

GPT-6.1 Sol: —, Grok 4.20 Multi-Agent: 39.7 (#116)

Knowledge benchmarks
Benchmark	GPT-6.1 Sol	Grok 4.20 Multi-Agent
LMArena Expert	—	1445

Multimodal Not comparable

GPT-6.1 Sol: —, Grok 4.20 Multi-Agent: 39.8 (#44)

Multimodal benchmarks
Benchmark	GPT-6.1 Sol	Grok 4.20 Multi-Agent
LMArena Vision	—	1259

Multilingual Not comparable

GPT-6.1 Sol: —, Grok 4.20 Multi-Agent: 54.6 (#40)

Multilingual benchmarks
Benchmark	GPT-6.1 Sol	Grok 4.20 Multi-Agent
LMArena Non-English	—	1440
LMArena Chinese	—	1475
LMArena French	—	1467
LMArena German	—	1456
LMArena Japanese	—	1405
LMArena Korean	—	1416
LMArena Russian	—	1457
LMArena Spanish	—	1447

Instruction Following Not comparable

GPT-6.1 Sol: —, Grok 4.20 Multi-Agent: 75.0 (#80)

Instruction Following benchmarks
Benchmark	GPT-6.1 Sol	Grok 4.20 Multi-Agent
LMArena Instruction Following	—	1420

Long Context Not comparable

GPT-6.1 Sol: —, Grok 4.20 Multi-Agent: 43.7 (#84)

Long Context benchmarks
Benchmark	GPT-6.1 Sol	Grok 4.20 Multi-Agent
LMArena Longer Query	—	1430

Writing & Preference Not comparable

GPT-6.1 Sol: —, Grok 4.20 Multi-Agent: 64.1 (#57)

Writing & Preference benchmarks
Benchmark	GPT-6.1 Sol	Grok 4.20 Multi-Agent
LMArena Text	—	1450
LMArena Creative Writing	—	1435
LMArena Multi-Turn	—	1451

Frequently asked questions

Is GPT-6.1 Sol better than Grok 4.20 Multi-Agent?

Grok 4.20 Multi-Agent has enough public results to be ranked (#62); GPT-6.1 Sol does not yet, so treat this comparison as directional.

Which is cheaper, GPT-6.1 Sol or Grok 4.20 Multi-Agent?

Grok 4.20 Multi-Agent is cheaper. It lists at $1.25 per million input tokens and $2.50 per million output tokens; GPT-6.1 Sol lists at $2 and $10.

Is GPT-6.1 Sol or Grok 4.20 Multi-Agent better for coding?

GPT-6.1 Sol scores higher on coding benchmarks: 51.4 versus 42.4 in the Noometry coding category.

Which has the bigger context window?

GPT-6.1 Sol does, with 1.05M tokens against 1M.

How many benchmarks do GPT-6.1 Sol and Grok 4.20 Multi-Agent share?

0 benchmarks have published results for both models. GPT-6.1 Sol has 2 scored results on Noometry and Grok 4.20 Multi-Agent has 20.