Noometry

Model comparison

C4ai Aya Expanse 32b vs Gemini Advanced 0514

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 35.9 on the Noometry Index.

Last verified . 17 shared benchmarks.

C4ai Aya Expanse 32b Cohere

35.9

Rank #221 Confirmed

Gemini Advanced 0514 Google

37.7

Rank #197 Confirmed

Summary

  • They share 17 benchmarks with published results for both. C4ai Aya Expanse 32b scores higher in 0 categories and Gemini Advanced 0514 in 8 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemini Advanced 0514 leads 48.5 to 42.2.
  • C4ai Aya Expanse 32b has downloadable open weights; the other is API-only.

Side by side

C4ai Aya Expanse 32bGemini Advanced 0514
ProviderCohereGoogle
Noometry Index35.937.7
Released2024-10-24—
WeightsOpenProprietary
Context window128K—
Max output4K—
Input $ / M tokens——
Output $ / M tokens——
Results tracked1817

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini Advanced 0514 leads

C4ai Aya Expanse 32b: 34.8 (#231), Gemini Advanced 0514: 36.6 (#205)

BenchmarkC4ai Aya Expanse 32bGemini Advanced 0514
LMArena Coding11971255

Reasoning Gemini Advanced 0514 leads

C4ai Aya Expanse 32b: 23.3 (#180), Gemini Advanced 0514: 24.6 (#160)

BenchmarkC4ai Aya Expanse 32bGemini Advanced 0514
LMArena Hard Prompts11931248

Math Gemini Advanced 0514 leads

C4ai Aya Expanse 32b: 34.0 (#197), Gemini Advanced 0514: 35.5 (#181)

BenchmarkC4ai Aya Expanse 32bGemini Advanced 0514
LMArena Math12001272

Knowledge Too close to call

C4ai Aya Expanse 32b: 33.2 (#206), Gemini Advanced 0514: 33.3 (#205)

BenchmarkC4ai Aya Expanse 32bGemini Advanced 0514
LMArena Expert11821215
Vectara Hallucination Rate10.9%—

Multilingual Gemini Advanced 0514 leads

C4ai Aya Expanse 32b: 38.4 (#230), Gemini Advanced 0514: 42.6 (#192)

BenchmarkC4ai Aya Expanse 32bGemini Advanced 0514
LMArena Non-English12131274
LMArena Chinese12111274
LMArena French12481307
LMArena German11991275
LMArena Japanese11631242
LMArena Korean11581232
LMArena Russian12271283
LMArena Spanish11931242

Instruction Following Gemini Advanced 0514 leads

C4ai Aya Expanse 32b: 62.6 (#237), Gemini Advanced 0514: 66.0 (#212)

BenchmarkC4ai Aya Expanse 32bGemini Advanced 0514
LMArena Instruction Following11961253

Long Context Too close to call

C4ai Aya Expanse 32b: 37.2 (#220), Gemini Advanced 0514: 38.0 (#207)

BenchmarkC4ai Aya Expanse 32bGemini Advanced 0514
LMArena Longer Query12281253

Writing & Preference Gemini Advanced 0514 leads

C4ai Aya Expanse 32b: 42.2 (#235), Gemini Advanced 0514: 48.5 (#200)

BenchmarkC4ai Aya Expanse 32bGemini Advanced 0514
LMArena Text12241279
LMArena Creative Writing12001284
LMArena Multi-Turn11901269

Frequently asked questions

Is C4ai Aya Expanse 32b better than Gemini Advanced 0514?

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 35.9 on the Noometry Index.

Is C4ai Aya Expanse 32b or Gemini Advanced 0514 better for coding?

Gemini Advanced 0514 scores higher on coding benchmarks: 36.6 versus 34.8 in the Noometry coding category.

How many benchmarks do C4ai Aya Expanse 32b and Gemini Advanced 0514 share?

17 benchmarks have published results for both models. C4ai Aya Expanse 32b has 18 scored results on Noometry and Gemini Advanced 0514 has 17.

Related comparisons

Go deeper