Model comparison

Amazon Nova Experimental Chat 26 02 10 vs Grok 4.20 Multi-Agent

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 44.5 on the Noometry Index.

Last verified . 12 shared benchmarks.

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Amazon Nova Experimental Chat 26 02 10 scores higher in 4 categories and Grok 4.20 Multi-Agent in 4 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.20 Multi-Agent leads 43.9 to 30.1.

Side by side

Amazon Nova Experimental Chat 26 02 10 and Grok 4.20 Multi-Agent specifications
Amazon Nova Experimental Chat 26 02 10Grok 4.20 Multi-Agent
ProviderAmazonxAI
Noometry Index44.546.2
Released—2026-03-09
WeightsProprietaryProprietary
Context window—1M
Max output—30K
Input $ / M tokens—$1.25
Output $ / M tokens—$2.50
Results tracked1220

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Amazon Nova Experimental Chat 26 02 10: 43.9 (#82), Grok 4.20 Multi-Agent: 43.0 (#92)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 4.20 Multi-Agent
LMArena Coding14831457

Agentic & Tool Use Not comparable

Amazon Nova Experimental Chat 26 02 10: —, Grok 4.20 Multi-Agent: —

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 4.20 Multi-Agent
LMArena Search—1204

Reasoning Grok 4.20 Multi-Agent leads

Amazon Nova Experimental Chat 26 02 10: 30.1 (#86), Grok 4.20 Multi-Agent: 43.9 (#48)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 4.20 Multi-Agent
LMArena Hard Prompts14581448
NYT Connections (extended)—89.6%

Math Too close to call

Amazon Nova Experimental Chat 26 02 10: 39.3 (#109), Grok 4.20 Multi-Agent: 39.4 (#104)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 4.20 Multi-Agent
LMArena Math14381442

Knowledge Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 42.3 (#97), Grok 4.20 Multi-Agent: 40.4 (#119)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 4.20 Multi-Agent
LMArena Expert15061445

Multimodal Not comparable

Amazon Nova Experimental Chat 26 02 10: —, Grok 4.20 Multi-Agent: 40.5 (#48)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 4.20 Multi-Agent
LMArena Vision—1259

Multilingual Too close to call

Amazon Nova Experimental Chat 26 02 10: 54.0 (#50), Grok 4.20 Multi-Agent: 54.4 (#43)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 4.20 Multi-Agent
LMArena Non-English14341440
LMArena Chinese14631475
LMArena Russian14231457
LMArena French—1466
LMArena German—1456
LMArena Japanese—1405
LMArena Korean—1416
LMArena Spanish—1447

Instruction Following Too close to call

Amazon Nova Experimental Chat 26 02 10: 75.2 (#69), Grok 4.20 Multi-Agent: 74.8 (#84)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 4.20 Multi-Agent
LMArena Instruction Following14271420

Long Context Too close to call

Amazon Nova Experimental Chat 26 02 10: 44.0 (#77), Grok 4.20 Multi-Agent: 43.7 (#88)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 4.20 Multi-Agent
LMArena Longer Query14411431

Writing & Preference Grok 4.20 Multi-Agent leads

Amazon Nova Experimental Chat 26 02 10: 61.8 (#84), Grok 4.20 Multi-Agent: 64.0 (#59)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 4.20 Multi-Agent
LMArena Text14481450
LMArena Creative Writing13681436
LMArena Multi-Turn14421452

Frequently asked questions

Is Amazon Nova Experimental Chat 26 02 10 better than Grok 4.20 Multi-Agent?

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 44.5 on the Noometry Index.

Is Amazon Nova Experimental Chat 26 02 10 or Grok 4.20 Multi-Agent better for coding?

They score almost the same on coding (43.9 vs 43.0); test both on your own repository before choosing.

How many benchmarks do Amazon Nova Experimental Chat 26 02 10 and Grok 4.20 Multi-Agent share?

12 benchmarks have published results for both models. Amazon Nova Experimental Chat 26 02 10 has 12 scored results on Noometry and Grok 4.20 Multi-Agent has 20.

Related comparisons

Go deeper