Model comparison

Amazon Nova Experimental Chat 26 02 10 vs Grok 2 Mini 2024 08 13

Amazon Nova Experimental Chat 26 02 10 is the stronger model overall, scoring 43.8 to 37.0 on the Noometry Index.

Last verified . 12 shared benchmarks.

Grok 2 Mini 2024 08 13 xAI

37.0

Rank #196 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Amazon Nova Experimental Chat 26 02 10 scores higher in 8 categories and Grok 2 Mini 2024 08 13 in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Experimental Chat 26 02 10 leads 62.0 to 47.5.

Side by side

Amazon Nova Experimental Chat 26 02 10 and Grok 2 Mini 2024 08 13 specifications
Amazon Nova Experimental Chat 26 02 10Grok 2 Mini 2024 08 13
ProviderAmazonxAI
Noometry Index43.837.0
Released—2024-08-13
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1217

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 43.2 (#81), Grok 2 Mini 2024 08 13: 36.4 (#194)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 2 Mini 2024 08 13
LMArena Coding14831269

Reasoning Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 28.9 (#84), Grok 2 Mini 2024 08 13: 23.7 (#162)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 2 Mini 2024 08 13
LMArena Hard Prompts14581255

Math Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 36.6 (#108), Grok 2 Mini 2024 08 13: 32.8 (#185)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 2 Mini 2024 08 13
LMArena Math14401265

Knowledge Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 41.6 (#98), Grok 2 Mini 2024 08 13: 33.4 (#195)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 2 Mini 2024 08 13
LMArena Expert15051238

Multilingual Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 54.3 (#48), Grok 2 Mini 2024 08 13: 41.6 (#203)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 2 Mini 2024 08 13
LMArena Non-English14351257
LMArena Chinese14651262
LMArena Russian14231261
LMArena French—1285
LMArena German—1273
LMArena Japanese—1213
LMArena Korean—1195
LMArena Spanish—1278

Instruction Following Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 75.3 (#66), Grok 2 Mini 2024 08 13: 65.7 (#215)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 2 Mini 2024 08 13
LMArena Instruction Following14261245

Long Context Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 44.0 (#73), Grok 2 Mini 2024 08 13: 38.4 (#191)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 2 Mini 2024 08 13
LMArena Longer Query14411267

Writing & Preference Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 62.0 (#80), Grok 2 Mini 2024 08 13: 47.5 (#207)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Grok 2 Mini 2024 08 13
LMArena Text14491281
LMArena Creative Writing13691242
LMArena Multi-Turn14421265

Frequently asked questions

Is Amazon Nova Experimental Chat 26 02 10 better than Grok 2 Mini 2024 08 13?

Amazon Nova Experimental Chat 26 02 10 is the stronger model overall, scoring 43.8 to 37.0 on the Noometry Index.

Is Amazon Nova Experimental Chat 26 02 10 or Grok 2 Mini 2024 08 13 better for coding?

Amazon Nova Experimental Chat 26 02 10 scores higher on coding benchmarks: 43.2 versus 36.4 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 26 02 10 and Grok 2 Mini 2024 08 13 share?

12 benchmarks have published results for both models. Amazon Nova Experimental Chat 26 02 10 has 12 scored results on Noometry and Grok 2 Mini 2024 08 13 has 17.

Related comparisons

Go deeper