Model comparison

C4ai Aya Expanse 32b vs Mercury 2

Mercury 2 is the stronger model overall, scoring 39.1 to 35.9 on the Noometry Index.

Last verified . 12 shared benchmarks.

C4ai Aya Expanse 32b Cohere

35.9

Rank #221 Confirmed

Mercury 2 Inception

39.1

Rank #175 Confirmed

Summary

  • They share 12 benchmarks with published results for both. C4ai Aya Expanse 32b scores higher in 1 category and Mercury 2 in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Mercury 2 leads 53.8 to 42.2.
  • C4ai Aya Expanse 32b has downloadable open weights; the other is API-only.

Side by side

C4ai Aya Expanse 32b and Mercury 2 specifications
C4ai Aya Expanse 32bMercury 2
ProviderCohereInception
Noometry Index35.939.1
Released2024-10-242026-02-20
WeightsOpenProprietary
Context window128K128K
Max output4K50K
Input $ / M tokens—$0.25
Output $ / M tokens—$0.75
Results tracked1817

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 34.8 (#231), Mercury 2: 33.5 (#255)

Coding benchmarks
BenchmarkC4ai Aya Expanse 32bMercury 2
LMArena Coding11971391
LMArena WebDev—1171
SciCode—38.7%
WeirdML—43.2%
ALE-Bench—785.58

Reasoning Too close to call

C4ai Aya Expanse 32b: 23.3 (#180), Mercury 2: 23.8 (#170)

Reasoning benchmarks
BenchmarkC4ai Aya Expanse 32bMercury 2
LMArena Hard Prompts11931362
CritPt—0.8%

Math Not comparable

C4ai Aya Expanse 32b: 34.0 (#197), Mercury 2: —

Math benchmarks
BenchmarkC4ai Aya Expanse 32bMercury 2
LMArena Math1200—

Knowledge Mercury 2 leads

C4ai Aya Expanse 32b: 33.2 (#206), Mercury 2: 36.2 (#172)

Knowledge benchmarks
BenchmarkC4ai Aya Expanse 32bMercury 2
Vectara Hallucination Rate10.9%12.3%
LMArena Expert11821358

Multilingual Mercury 2 leads

C4ai Aya Expanse 32b: 38.4 (#230), Mercury 2: 46.6 (#157)

Multilingual benchmarks
BenchmarkC4ai Aya Expanse 32bMercury 2
LMArena Non-English12131331
LMArena Chinese12111417
LMArena Russian12271304
LMArena French1248—
LMArena German1199—
LMArena Japanese1163—
LMArena Korean1158—
LMArena Spanish1193—

Instruction Following Mercury 2 leads

C4ai Aya Expanse 32b: 62.6 (#237), Mercury 2: 70.2 (#165)

Instruction Following benchmarks
BenchmarkC4ai Aya Expanse 32bMercury 2
LMArena Instruction Following11961329

Long Context Mercury 2 leads

C4ai Aya Expanse 32b: 37.2 (#220), Mercury 2: 40.5 (#154)

Long Context benchmarks
BenchmarkC4ai Aya Expanse 32bMercury 2
LMArena Longer Query12281330

Writing & Preference Mercury 2 leads

C4ai Aya Expanse 32b: 42.2 (#235), Mercury 2: 53.8 (#155)

Writing & Preference benchmarks
BenchmarkC4ai Aya Expanse 32bMercury 2
LMArena Text12241355
LMArena Creative Writing12001289
LMArena Multi-Turn11901358

Frequently asked questions

Is C4ai Aya Expanse 32b better than Mercury 2?

Mercury 2 is the stronger model overall, scoring 39.1 to 35.9 on the Noometry Index.

Is C4ai Aya Expanse 32b or Mercury 2 better for coding?

C4ai Aya Expanse 32b scores higher on coding benchmarks: 34.8 versus 33.5 in the Noometry coding category.

Which has the bigger context window?

Both accept 128K tokens.

How many benchmarks do C4ai Aya Expanse 32b and Mercury 2 share?

12 benchmarks have published results for both models. C4ai Aya Expanse 32b has 18 scored results on Noometry and Mercury 2 has 17.

Related comparisons

Go deeper