Model comparison

Amazon Nova Experimental Chat 11 10 vs Command R

Amazon Nova Experimental Chat 11 10 is the stronger model overall, scoring 43.0 to 31.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

Command R Cohere

31.4

Rank #272 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Experimental Chat 11 10 scores higher in 8 categories and Command R in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Experimental Chat 11 10 leads 58.8 to 38.2.
  • Command R has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 11 10 and Command R specifications
Amazon Nova Experimental Chat 11 10Command R
ProviderAmazonCohere
Noometry Index43.031.4
Released—2024-08-30
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.60
Results tracked1729

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 42.3 (#107), Command R: 29.3 (#306)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Command R
LMArena Coding14331169
BigCodeBench Instruct—37.1%
LiveBench Coding—17.9%
BigCodeBench Complete—45.2%

Reasoning Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 29.1 (#95), Command R: 13.8 (#331)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Command R
LMArena Hard Prompts14221164
LiveBench Reasoning—21.9%
DTBench—46.4%
LiveBench Data Analysis—33.3%
LMCA—9.2%
LiveBench—27.5%

Math Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 39.1 (#114), Command R: 28.0 (#246)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Command R
LMArena Math14311155
LiveBench Math—19.4%

Knowledge Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 39.9 (#127), Command R: 31.0 (#221)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Command R
LMArena Expert14311138
MMLU—65.2%

Multilingual Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 51.9 (#98), Command R: 35.7 (#245)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Command R
LMArena Non-English14051174
LMArena Chinese14631182
LMArena French14491162
LMArena German13951176
LMArena Japanese13831143
LMArena Korean13841163
LMArena Russian13941174
LMArena Spanish14441151

Instruction Following Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 73.2 (#122), Command R: 58.1 (#261)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Command R
LMArena Instruction Following13871167
LiveBench Instruction Following—55.6%

Long Context Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 42.5 (#121), Command R: 36.3 (#231)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Command R
LMArena Longer Query13951198

Writing & Preference Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 58.8 (#114), Command R: 38.2 (#254)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Command R
LMArena Text14151187
LMArena Creative Writing13491170
LMArena Multi-Turn13801163
LiveBench Language—16.7%

Frequently asked questions

Is Amazon Nova Experimental Chat 11 10 better than Command R?

Amazon Nova Experimental Chat 11 10 is the stronger model overall, scoring 43.0 to 31.4 on the Noometry Index.

Is Amazon Nova Experimental Chat 11 10 or Command R better for coding?

Amazon Nova Experimental Chat 11 10 scores higher on coding benchmarks: 42.3 versus 29.3 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 11 10 and Command R share?

17 benchmarks have published results for both models. Amazon Nova Experimental Chat 11 10 has 17 scored results on Noometry and Command R has 29.

Related comparisons

Go deeper