Model comparison

C4ai Aya Expanse 32b vs Palm 2

C4ai Aya Expanse 32b is the stronger model overall, scoring 35.9 to 30.0 on the Noometry Index.

Last verified . 10 shared benchmarks.

C4ai Aya Expanse 32b Cohere

35.9

Rank #221 Confirmed

Palm 2 Google

30.0

Rank #298 Confirmed

Summary

  • They share 10 benchmarks with published results for both. C4ai Aya Expanse 32b scores higher in 7 categories and Palm 2 in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where C4ai Aya Expanse 32b leads 38.4 to 20.9.
  • C4ai Aya Expanse 32b has downloadable open weights; the other is API-only.

Side by side

C4ai Aya Expanse 32b and Palm 2 specifications
C4ai Aya Expanse 32bPalm 2
ProviderCohereGoogle
Noometry Index35.930.0
Released2024-10-24—
WeightsOpenProprietary
Context window128K—
Max output4K—
Input $ / M tokens——
Output $ / M tokens——
Results tracked1810

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 34.8 (#231), Palm 2: 29.0 (#311)

Coding benchmarks
BenchmarkC4ai Aya Expanse 32bPalm 2
LMArena Coding1197994

Reasoning C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 23.3 (#180), Palm 2: 19.1 (#271)

Reasoning benchmarks
BenchmarkC4ai Aya Expanse 32bPalm 2
LMArena Hard Prompts11931005

Math C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 34.0 (#197), Palm 2: 30.8 (#231)

Math benchmarks
BenchmarkC4ai Aya Expanse 32bPalm 2
LMArena Math12001049

Knowledge Not comparable

C4ai Aya Expanse 32b: 33.2 (#206), Palm 2: —

Knowledge benchmarks
BenchmarkC4ai Aya Expanse 32bPalm 2
Vectara Hallucination Rate10.9%—
LMArena Expert1182—

Multilingual C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 38.4 (#230), Palm 2: 20.9 (#295)

Multilingual benchmarks
BenchmarkC4ai Aya Expanse 32bPalm 2
LMArena Non-English1213916
LMArena Chinese1211887
LMArena French1248—
LMArena German1199—
LMArena Japanese1163—
LMArena Korean1158—
LMArena Russian1227—
LMArena Spanish1193—

Instruction Following C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 62.6 (#237), Palm 2: 51.0 (#296)

Instruction Following benchmarks
BenchmarkC4ai Aya Expanse 32bPalm 2
LMArena Instruction Following11961010

Long Context C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 37.2 (#220), Palm 2: 30.8 (#285)

Long Context benchmarks
BenchmarkC4ai Aya Expanse 32bPalm 2
LMArena Longer Query12281010

Writing & Preference C4ai Aya Expanse 32b leads

C4ai Aya Expanse 32b: 42.2 (#235), Palm 2: 25.6 (#304)

Writing & Preference benchmarks
BenchmarkC4ai Aya Expanse 32bPalm 2
LMArena Text12241027
LMArena Creative Writing1200991
LMArena Multi-Turn1190994

Frequently asked questions

Is C4ai Aya Expanse 32b better than Palm 2?

C4ai Aya Expanse 32b is the stronger model overall, scoring 35.9 to 30.0 on the Noometry Index.

Is C4ai Aya Expanse 32b or Palm 2 better for coding?

C4ai Aya Expanse 32b scores higher on coding benchmarks: 34.8 versus 29.0 in the Noometry coding category.

How many benchmarks do C4ai Aya Expanse 32b and Palm 2 share?

10 benchmarks have published results for both models. C4ai Aya Expanse 32b has 18 scored results on Noometry and Palm 2 has 10.

Related comparisons

Go deeper