Model comparison

C4ai Aya Expanse 32b vs Command R

C4ai Aya Expanse 32b is the stronger model overall, scoring 35.9 to 31.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

C4ai Aya Expanse 32b Cohere

35.9

Rank #221 Confirmed

Command R Cohere

31.4

Rank #272 Confirmed

Summary

  • They share 17 benchmarks with published results for both. C4ai Aya Expanse 32b scores higher in 8 categories and Command R in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where C4ai Aya Expanse 32b leads 23.3 to 13.8.

Side by side

C4ai Aya Expanse 32b and Command R specifications
C4ai Aya Expanse 32bCommand R
ProviderCohereCohere
Noometry Index35.931.4
Released2024-10-242024-08-30
WeightsOpenOpen
Context window128K128K
Max output4K4K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.60
Results tracked1829

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 34.8 (#231), Command R: 29.3 (#306)

Coding benchmarks
BenchmarkC4ai Aya Expanse 32bCommand R
LMArena Coding11971169
BigCodeBench Instruct—37.1%
LiveBench Coding—17.9%
BigCodeBench Complete—45.2%

Reasoning C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 23.3 (#180), Command R: 13.8 (#331)

Reasoning benchmarks
BenchmarkC4ai Aya Expanse 32bCommand R
LMArena Hard Prompts11931164
LiveBench Reasoning—21.9%
DTBench—46.4%
LiveBench Data Analysis—33.3%
LMCA—9.2%
LiveBench—27.5%

Math C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 34.0 (#197), Command R: 28.0 (#246)

Math benchmarks
BenchmarkC4ai Aya Expanse 32bCommand R
LMArena Math12001155
LiveBench Math—19.4%

Knowledge C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 33.2 (#206), Command R: 31.0 (#221)

Knowledge benchmarks
BenchmarkC4ai Aya Expanse 32bCommand R
LMArena Expert11821138
Vectara Hallucination Rate10.9%—
MMLU—65.2%

Multilingual C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 38.4 (#230), Command R: 35.7 (#245)

Multilingual benchmarks
BenchmarkC4ai Aya Expanse 32bCommand R
LMArena Non-English12131174
LMArena Chinese12111182
LMArena French12481162
LMArena German11991176
LMArena Japanese11631143
LMArena Korean11581163
LMArena Russian12271174
LMArena Spanish11931151

Instruction Following C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 62.6 (#237), Command R: 58.1 (#261)

Instruction Following benchmarks
BenchmarkC4ai Aya Expanse 32bCommand R
LMArena Instruction Following11961167
LiveBench Instruction Following—55.6%

Long Context Too close to call

C4ai Aya Expanse 32b: 37.2 (#220), Command R: 36.3 (#231)

Long Context benchmarks
BenchmarkC4ai Aya Expanse 32bCommand R
LMArena Longer Query12281198

Writing & Preference C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 42.2 (#235), Command R: 38.2 (#254)

Writing & Preference benchmarks
BenchmarkC4ai Aya Expanse 32bCommand R
LMArena Text12241187
LMArena Creative Writing12001170
LMArena Multi-Turn11901163
LiveBench Language—16.7%

Frequently asked questions

Is C4ai Aya Expanse 32b better than Command R?

C4ai Aya Expanse 32b is the stronger model overall, scoring 35.9 to 31.4 on the Noometry Index.

Is C4ai Aya Expanse 32b or Command R better for coding?

C4ai Aya Expanse 32b scores higher on coding benchmarks: 34.8 versus 29.3 in the Noometry coding category.

Which has the bigger context window?

Both accept 128K tokens.

How many benchmarks do C4ai Aya Expanse 32b and Command R share?

17 benchmarks have published results for both models. C4ai Aya Expanse 32b has 18 scored results on Noometry and Command R has 29.

Related comparisons

Go deeper