Model comparison

Amazon Nova Experimental Chat 11 10 vs Grok-3 mini

Amazon Nova Experimental Chat 11 10 is the stronger model overall, scoring 43.0 to 41.2 on the Noometry Index.

Last verified . 17 shared benchmarks.

Grok-3 mini xAI

41.2

Rank #141 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Experimental Chat 11 10 scores higher in 5 categories and Grok-3 mini in 3 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Amazon Nova Experimental Chat 11 10 leads 29.1 to 13.6.

Side by side

Amazon Nova Experimental Chat 11 10 and Grok-3 mini specifications
Amazon Nova Experimental Chat 11 10Grok-3 mini
ProviderAmazonxAI
Noometry Index43.041.2
Released—2025-04-09
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1735

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 42.3 (#107), Grok-3 mini: 40.8 (#131)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Grok-3 mini
LMArena Coding14331379
Aider Polyglot—49.3%
WeirdML—42.6%

Reasoning Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 29.1 (#95), Grok-3 mini: 13.6 (#334)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Grok-3 mini
LMArena Hard Prompts14221375
ARC-AGI-2—0.4%
Kagi LLM Benchmark—61.3%
ARC-AGI-1—16.5%
Epoch Capabilities Index—140.35

Math Grok-3 mini leads

Amazon Nova Experimental Chat 11 10: 39.1 (#114), Grok-3 mini: 42.1 (#85)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Grok-3 mini
LMArena Math14311386
OTIS Mock AIME 2024-2025—77.8%
Omni-MATH—31.8%
MATH Level 5—90.9%
FrontierMath (Feb 2025 set)—5.9%

Knowledge Grok-3 mini leads

Amazon Nova Experimental Chat 11 10: 39.9 (#127), Grok-3 mini: 46.4 (#81)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Grok-3 mini
LMArena Expert14311395
GPQA Diamond—76.3%
MMLU-Pro—79.9%
Confabulations—10.8%
GPQA (HELM)—67.5%

Multilingual Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 51.9 (#98), Grok-3 mini: 48.1 (#145)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Grok-3 mini
LMArena Non-English14051352
LMArena Chinese14631387
LMArena French14491357
LMArena German13951349
LMArena Japanese13831342
LMArena Korean13841335
LMArena Russian13941353
LMArena Spanish14441381

Instruction Following Grok-3 mini leads

Amazon Nova Experimental Chat 11 10: 73.2 (#122), Grok-3 mini: 78.5 (#9)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Grok-3 mini
LMArena Instruction Following13871357
IFEval—95.1%

Long Context Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 42.5 (#121), Grok-3 mini: 41.0 (#147)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Grok-3 mini
LMArena Longer Query13951372
Fiction.LiveBench—66.7%

Writing & Preference Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 58.8 (#114), Grok-3 mini: 52.5 (#169)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Grok-3 mini
LMArena Text14151370
LMArena Creative Writing13491342
LMArena Multi-Turn13801355
Short-Story Creative Writing—73.5%
WildBench—65.1%

Frequently asked questions

Is Amazon Nova Experimental Chat 11 10 better than Grok-3 mini?

Amazon Nova Experimental Chat 11 10 is the stronger model overall, scoring 43.0 to 41.2 on the Noometry Index.

Is Amazon Nova Experimental Chat 11 10 or Grok-3 mini better for coding?

Amazon Nova Experimental Chat 11 10 scores higher on coding benchmarks: 42.3 versus 40.8 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 11 10 and Grok-3 mini share?

17 benchmarks have published results for both models. Amazon Nova Experimental Chat 11 10 has 17 scored results on Noometry and Grok-3 mini has 35.

Related comparisons

Go deeper