Noometry

Model comparison

C4ai Aya Expanse 32b vs Phi-3.5-mini

C4ai Aya Expanse 32b has enough public results to be ranked (#216); Phi-3.5-mini does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

C4ai Aya Expanse 32b Cohere

35.3

Rank #216 Confirmed

Phi-3.5-mini Microsoft

36.4

Unranked Sparse

Side by side

C4ai Aya Expanse 32bPhi-3.5-mini
ProviderCohereMicrosoft
Noometry Index35.336.4
Released2024-10-242024-08-16
WeightsOpenOpen
Context window128K—
Max output4K—
Input $ / M tokens——
Output $ / M tokens——
Results tracked185

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

C4ai Aya Expanse 32b: 34.3 (#227), Phi-3.5-mini: 34.0 (#231)

BenchmarkC4ai Aya Expanse 32bPhi-3.5-mini
BigCodeBench Instruct—32.8%
LMArena Coding1197—
BigCodeBench Complete—38.5%

Reasoning Not comparable

C4ai Aya Expanse 32b: 22.3 (#183), Phi-3.5-mini: —

BenchmarkC4ai Aya Expanse 32bPhi-3.5-mini
LMArena Hard Prompts1193—
PIQA—81%

Math Not comparable

C4ai Aya Expanse 32b: 31.4 (#195), Phi-3.5-mini: —

BenchmarkC4ai Aya Expanse 32bPhi-3.5-mini
LMArena Math1200—
GSM8K—86.2%

Knowledge Not comparable

C4ai Aya Expanse 32b: 32.6 (#202), Phi-3.5-mini: —

BenchmarkC4ai Aya Expanse 32bPhi-3.5-mini
Vectara Hallucination Rate10.9%—
LMArena Expert1182—
BoolQ—78%

Multilingual Not comparable

C4ai Aya Expanse 32b: 38.5 (#225), Phi-3.5-mini: —

BenchmarkC4ai Aya Expanse 32bPhi-3.5-mini
LMArena Non-English1213—
LMArena Chinese1210—
LMArena French1247—
LMArena German1199—
LMArena Japanese1163—
LMArena Korean1158—
LMArena Russian1227—
LMArena Spanish1193—

Instruction Following Not comparable

C4ai Aya Expanse 32b: 62.9 (#232), Phi-3.5-mini: —

BenchmarkC4ai Aya Expanse 32bPhi-3.5-mini
LMArena Instruction Following1196—

Long Context Not comparable

C4ai Aya Expanse 32b: 37.2 (#215), Phi-3.5-mini: —

BenchmarkC4ai Aya Expanse 32bPhi-3.5-mini
LMArena Longer Query1228—

Writing & Preference Not comparable

C4ai Aya Expanse 32b: 42.4 (#230), Phi-3.5-mini: —

BenchmarkC4ai Aya Expanse 32bPhi-3.5-mini
LMArena Text1224—
LMArena Creative Writing1200—
LMArena Multi-Turn1190—

Frequently asked questions

Is C4ai Aya Expanse 32b better than Phi-3.5-mini?

C4ai Aya Expanse 32b has enough public results to be ranked (#216); Phi-3.5-mini does not yet, so treat this comparison as directional.

Is C4ai Aya Expanse 32b or Phi-3.5-mini better for coding?

They score almost the same on coding (34.3 vs 34.0); test both on your own repository before choosing.

How many benchmarks do C4ai Aya Expanse 32b and Phi-3.5-mini share?

0 benchmarks have published results for both models. C4ai Aya Expanse 32b has 18 scored results on Noometry and Phi-3.5-mini has 5.

Related comparisons

Go deeper