Model comparison

C4ai Aya Expanse 32b vs Codestral

C4ai Aya Expanse 32b is the stronger model overall, scoring 35.9 to 30.6 on the Noometry Index.

Last verified . 0 shared benchmarks.

C4ai Aya Expanse 32b Cohere

35.9

Rank #221 Confirmed

Codestral Mistral AI

30.6

Rank #290 Reported

Summary

  • The widest gap is in coding, where C4ai Aya Expanse 32b leads 34.8 to 27.3.
  • Codestral accepts more context: 256K tokens versus 128K.
  • C4ai Aya Expanse 32b has downloadable open weights; the other is API-only.

Side by side

C4ai Aya Expanse 32b and Codestral specifications
C4ai Aya Expanse 32bCodestral
ProviderCohereMistral AI
Noometry Index35.930.6
Released2024-10-242024-05-29
WeightsOpenProprietary
Context window128K256K
Max output4K8K
Input $ / M tokens—$0.30
Output $ / M tokens—$0.90
Results tracked187

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 34.8 (#231), Codestral: 27.3 (#321)

Coding benchmarks
BenchmarkC4ai Aya Expanse 32bCodestral
Aider Polyglot—11.1%
BigCodeBench Instruct—41.8%
LMArena Coding1197—
BigCodeBench Complete—52.5%
ALE-Bench—137.78
HumanEval+—73.8%
MBPP+—61.9%

Reasoning C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 23.3 (#180), Codestral: 19.8 (#251)

Reasoning benchmarks
BenchmarkC4ai Aya Expanse 32bCodestral
Kagi LLM Benchmark—32.5%
LMArena Hard Prompts1193—

Math Not comparable

C4ai Aya Expanse 32b: 34.0 (#197), Codestral: —

Math benchmarks
BenchmarkC4ai Aya Expanse 32bCodestral
LMArena Math1200—

Knowledge Not comparable

C4ai Aya Expanse 32b: 33.2 (#206), Codestral: —

Knowledge benchmarks
BenchmarkC4ai Aya Expanse 32bCodestral
Vectara Hallucination Rate10.9%—
LMArena Expert1182—

Multilingual Not comparable

C4ai Aya Expanse 32b: 38.4 (#230), Codestral: —

Multilingual benchmarks
BenchmarkC4ai Aya Expanse 32bCodestral
LMArena Non-English1213—
LMArena Chinese1211—
LMArena French1248—
LMArena German1199—
LMArena Japanese1163—
LMArena Korean1158—
LMArena Russian1227—
LMArena Spanish1193—

Instruction Following Not comparable

C4ai Aya Expanse 32b: 62.6 (#237), Codestral: —

Instruction Following benchmarks
BenchmarkC4ai Aya Expanse 32bCodestral
LMArena Instruction Following1196—

Long Context Not comparable

C4ai Aya Expanse 32b: 37.2 (#220), Codestral: —

Long Context benchmarks
BenchmarkC4ai Aya Expanse 32bCodestral
LMArena Longer Query1228—

Writing & Preference Not comparable

C4ai Aya Expanse 32b: 42.2 (#235), Codestral: —

Writing & Preference benchmarks
BenchmarkC4ai Aya Expanse 32bCodestral
LMArena Text1224—
LMArena Creative Writing1200—
LMArena Multi-Turn1190—

Frequently asked questions

Is C4ai Aya Expanse 32b better than Codestral?

C4ai Aya Expanse 32b is the stronger model overall, scoring 35.9 to 30.6 on the Noometry Index.

Is C4ai Aya Expanse 32b or Codestral better for coding?

C4ai Aya Expanse 32b scores higher on coding benchmarks: 34.8 versus 27.3 in the Noometry coding category.

Which has the bigger context window?

Codestral does, with 256K tokens against 128K.

How many benchmarks do C4ai Aya Expanse 32b and Codestral share?

0 benchmarks have published results for both models. C4ai Aya Expanse 32b has 18 scored results on Noometry and Codestral has 7.

Related comparisons

Go deeper