Model comparison

Amazon Nova Experimental Chat 10 09 vs Command R

Amazon Nova Experimental Chat 10 09 is the stronger model overall, scoring 41.9 to 31.4 on the Noometry Index.

Last verified . 9 shared benchmarks.

Command R Cohere

31.4

Rank #272 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Amazon Nova Experimental Chat 10 09 scores higher in 6 categories and Command R in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Experimental Chat 10 09 leads 54.7 to 38.2.
  • Command R has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 10 09 and Command R specifications
Amazon Nova Experimental Chat 10 09Command R
ProviderAmazonCohere
Noometry Index41.931.4
Released—2024-08-30
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.60
Results tracked929

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 40.2 (#145), Command R: 29.3 (#306)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Command R
LMArena Coding13701169
BigCodeBench Instruct—37.1%
LiveBench Coding—17.9%
BigCodeBench Complete—45.2%

Reasoning Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 27.3 (#120), Command R: 13.8 (#331)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Command R
LMArena Hard Prompts13561164
LiveBench Reasoning—21.9%
DTBench—46.4%
LiveBench Data Analysis—33.3%
LMCA—9.2%
LiveBench—27.5%

Math Not comparable

Amazon Nova Experimental Chat 10 09: —, Command R: 28.0 (#246)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Command R
LiveBench Math—19.4%
LMArena Math—1155

Knowledge Not comparable

Amazon Nova Experimental Chat 10 09: —, Command R: 31.0 (#221)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Command R
LMArena Expert—1138
MMLU—65.2%

Multilingual Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 47.3 (#150), Command R: 35.7 (#245)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Command R
LMArena Non-English13401174
LMArena Chinese13411182
LMArena French—1162
LMArena German—1176
LMArena Japanese—1143
LMArena Korean—1163
LMArena Russian—1174
LMArena Spanish—1151

Instruction Following Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 69.4 (#172), Command R: 58.1 (#261)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Command R
LMArena Instruction Following13151167
LiveBench Instruction Following—55.6%

Long Context Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 40.5 (#152), Command R: 36.3 (#231)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Command R
LMArena Longer Query13331198

Writing & Preference Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 54.7 (#149), Command R: 38.2 (#254)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Command R
LMArena Text13641187
LMArena Creative Writing13071170
LMArena Multi-Turn13551163
LiveBench Language—16.7%

Frequently asked questions

Is Amazon Nova Experimental Chat 10 09 better than Command R?

Amazon Nova Experimental Chat 10 09 is the stronger model overall, scoring 41.9 to 31.4 on the Noometry Index.

Is Amazon Nova Experimental Chat 10 09 or Command R better for coding?

Amazon Nova Experimental Chat 10 09 scores higher on coding benchmarks: 40.2 versus 29.3 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 10 09 and Command R share?

9 benchmarks have published results for both models. Amazon Nova Experimental Chat 10 09 has 9 scored results on Noometry and Command R has 29.

Related comparisons

Go deeper