Model comparison

C4ai Aya Expanse 8b vs Command R

C4ai Aya Expanse 8b is the stronger model overall, scoring 34.9 to 31.4 on the Noometry Index.

Last verified . 14 shared benchmarks.

C4ai Aya Expanse 8b Cohere

34.9

Rank #229 Confirmed

Command R Cohere

31.4

Rank #272 Confirmed

Summary

  • They share 14 benchmarks with published results for both. C4ai Aya Expanse 8b scores higher in 7 categories and Command R in 1 category; 5 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where C4ai Aya Expanse 8b leads 22.4 to 13.8.

Side by side

C4ai Aya Expanse 8b and Command R specifications
C4ai Aya Expanse 8bCommand R
ProviderCohereCohere
Noometry Index34.931.4
Released—2024-08-30
WeightsOpenOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.60
Results tracked1529

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding C4ai Aya Expanse 8b leads

C4ai Aya Expanse 8b: 33.8 (#252), Command R: 29.3 (#306)

Coding benchmarks
BenchmarkC4ai Aya Expanse 8bCommand R
LMArena Coding11601169
BigCodeBench Instruct—37.1%
LiveBench Coding—17.9%
BigCodeBench Complete—45.2%

Reasoning C4ai Aya Expanse 8b leads

C4ai Aya Expanse 8b: 22.4 (#197), Command R: 13.8 (#331)

Reasoning benchmarks
BenchmarkC4ai Aya Expanse 8bCommand R
LMArena Hard Prompts11561164
LiveBench Reasoning—21.9%
DTBench—46.4%
LiveBench Data Analysis—33.3%
LMCA—9.2%
LiveBench—27.5%

Math C4ai Aya Expanse 8b leads

C4ai Aya Expanse 8b: 33.3 (#203), Command R: 28.0 (#246)

Math benchmarks
BenchmarkC4ai Aya Expanse 8bCommand R
LMArena Math11681155
LiveBench Math—19.4%

Knowledge C4ai Aya Expanse 8b leads

C4ai Aya Expanse 8b: 33.6 (#201), Command R: 31.0 (#221)

Knowledge benchmarks
BenchmarkC4ai Aya Expanse 8bCommand R
LMArena Expert11531138
Vectara Hallucination Rate9.5%—
MMLU—65.2%

Multilingual Too close to call

C4ai Aya Expanse 8b: 36.1 (#242), Command R: 35.7 (#245)

Multilingual benchmarks
BenchmarkC4ai Aya Expanse 8bCommand R
LMArena Non-English11801174
LMArena Chinese11811182
LMArena German11881176
LMArena Japanese11201143
LMArena Russian11971174
LMArena French—1162
LMArena Korean—1163
LMArena Spanish—1151

Instruction Following C4ai Aya Expanse 8b leads

C4ai Aya Expanse 8b: 60.1 (#253), Command R: 58.1 (#261)

Instruction Following benchmarks
BenchmarkC4ai Aya Expanse 8bCommand R
LMArena Instruction Following11551167
LiveBench Instruction Following—55.6%

Long Context Too close to call

C4ai Aya Expanse 8b: 36.1 (#236), Command R: 36.3 (#231)

Long Context benchmarks
BenchmarkC4ai Aya Expanse 8bCommand R
LMArena Longer Query11911198

Writing & Preference Too close to call

C4ai Aya Expanse 8b: 39.0 (#250), Command R: 38.2 (#254)

Writing & Preference benchmarks
BenchmarkC4ai Aya Expanse 8bCommand R
LMArena Text11851187
LMArena Creative Writing11681170
LMArena Multi-Turn11601163
LiveBench Language—16.7%

Frequently asked questions

Is C4ai Aya Expanse 8b better than Command R?

C4ai Aya Expanse 8b is the stronger model overall, scoring 34.9 to 31.4 on the Noometry Index.

Is C4ai Aya Expanse 8b or Command R better for coding?

C4ai Aya Expanse 8b scores higher on coding benchmarks: 33.8 versus 29.3 in the Noometry coding category.

How many benchmarks do C4ai Aya Expanse 8b and Command R share?

14 benchmarks have published results for both models. C4ai Aya Expanse 8b has 15 scored results on Noometry and Command R has 29.

Related comparisons

Go deeper