Model comparison

C4ai Aya Expanse 8b vs Granite 3.0 8b Instruct

C4ai Aya Expanse 8b is the stronger model overall, scoring 34.9 to 31.6 on the Noometry Index.

Last verified . 12 shared benchmarks.

C4ai Aya Expanse 8b Cohere

34.9

Rank #229 Confirmed

Granite 3.0 8b Instruct IBM

31.6

Rank #270 Confirmed

Summary

  • They share 12 benchmarks with published results for both. C4ai Aya Expanse 8b scores higher in 8 categories and Granite 3.0 8b Instruct in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where C4ai Aya Expanse 8b leads 36.1 to 27.2.

Side by side

C4ai Aya Expanse 8b and Granite 3.0 8b Instruct specifications
C4ai Aya Expanse 8bGranite 3.0 8b Instruct
ProviderCohereIBM
Noometry Index34.931.6
Released——
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1514

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding C4ai Aya Expanse 8b leads

C4ai Aya Expanse 8b: 33.8 (#252), Granite 3.0 8b Instruct: 29.7 (#301)

Coding benchmarks
BenchmarkC4ai Aya Expanse 8bGranite 3.0 8b Instruct
LMArena Coding11601112
BigCodeBench Instruct—29.3%
BigCodeBench Complete—35.4%

Reasoning C4ai Aya Expanse 8b leads

C4ai Aya Expanse 8b: 22.4 (#197), Granite 3.0 8b Instruct: 20.9 (#230)

Reasoning benchmarks
BenchmarkC4ai Aya Expanse 8bGranite 3.0 8b Instruct
LMArena Hard Prompts11561092

Math Too close to call

C4ai Aya Expanse 8b: 33.3 (#203), Granite 3.0 8b Instruct: 32.8 (#210)

Math benchmarks
BenchmarkC4ai Aya Expanse 8bGranite 3.0 8b Instruct
LMArena Math11681143

Knowledge C4ai Aya Expanse 8b leads

C4ai Aya Expanse 8b: 33.6 (#201), Granite 3.0 8b Instruct: 29.6 (#236)

Knowledge benchmarks
BenchmarkC4ai Aya Expanse 8bGranite 3.0 8b Instruct
LMArena Expert11531087
Vectara Hallucination Rate9.5%—

Multilingual C4ai Aya Expanse 8b leads

C4ai Aya Expanse 8b: 36.1 (#242), Granite 3.0 8b Instruct: 27.2 (#276)

Multilingual benchmarks
BenchmarkC4ai Aya Expanse 8bGranite 3.0 8b Instruct
LMArena Non-English11801037
LMArena Chinese11811063
LMArena Russian11971060
LMArena German1188—
LMArena Japanese1120—

Instruction Following C4ai Aya Expanse 8b leads

C4ai Aya Expanse 8b: 60.1 (#253), Granite 3.0 8b Instruct: 56.0 (#276)

Instruction Following benchmarks
BenchmarkC4ai Aya Expanse 8bGranite 3.0 8b Instruct
LMArena Instruction Following11551088

Long Context C4ai Aya Expanse 8b leads

C4ai Aya Expanse 8b: 36.1 (#236), Granite 3.0 8b Instruct: 34.0 (#252)

Long Context benchmarks
BenchmarkC4ai Aya Expanse 8bGranite 3.0 8b Instruct
LMArena Longer Query11911122

Writing & Preference C4ai Aya Expanse 8b leads

C4ai Aya Expanse 8b: 39.0 (#250), Granite 3.0 8b Instruct: 31.1 (#285)

Writing & Preference benchmarks
BenchmarkC4ai Aya Expanse 8bGranite 3.0 8b Instruct
LMArena Text11851096
LMArena Creative Writing11681071
LMArena Multi-Turn11601063

Frequently asked questions

Is C4ai Aya Expanse 8b better than Granite 3.0 8b Instruct?

C4ai Aya Expanse 8b is the stronger model overall, scoring 34.9 to 31.6 on the Noometry Index.

Is C4ai Aya Expanse 8b or Granite 3.0 8b Instruct better for coding?

C4ai Aya Expanse 8b scores higher on coding benchmarks: 33.8 versus 29.7 in the Noometry coding category.

How many benchmarks do C4ai Aya Expanse 8b and Granite 3.0 8b Instruct share?

12 benchmarks have published results for both models. C4ai Aya Expanse 8b has 15 scored results on Noometry and Granite 3.0 8b Instruct has 14.

Related comparisons

Go deeper