Model comparison

C4ai Aya Expanse 8b vs Yi-Lightning

Yi-Lightning is the stronger model overall, scoring 37.1 to 34.9 on the Noometry Index.

Last verified . 14 shared benchmarks.

C4ai Aya Expanse 8b Cohere

34.9

Rank #229 Confirmed

Yi-Lightning 01.AI

37.1

Rank #209 Confirmed

Summary

  • They share 14 benchmarks with published results for both. C4ai Aya Expanse 8b scores higher in 1 category and Yi-Lightning in 7 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Yi-Lightning leads 50.2 to 39.0.
  • C4ai Aya Expanse 8b has downloadable open weights; the other is API-only.

Side by side

C4ai Aya Expanse 8b and Yi-Lightning specifications
C4ai Aya Expanse 8bYi-Lightning
ProviderCohere01.AI
Noometry Index34.937.1
Released—2024-12-02
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1518

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding C4ai Aya Expanse 8b leads

C4ai Aya Expanse 8b: 33.8 (#252), Yi-Lightning: 27.4 (#320)

Coding benchmarks
BenchmarkC4ai Aya Expanse 8bYi-Lightning
LMArena Coding11601312
Aider Polyglot—12.9%

Reasoning Yi-Lightning leads

C4ai Aya Expanse 8b: 22.4 (#197), Yi-Lightning: 25.9 (#139)

Reasoning benchmarks
BenchmarkC4ai Aya Expanse 8bYi-Lightning
LMArena Hard Prompts11561302

Math Yi-Lightning leads

C4ai Aya Expanse 8b: 33.3 (#203), Yi-Lightning: 36.2 (#172)

Math benchmarks
BenchmarkC4ai Aya Expanse 8bYi-Lightning
LMArena Math11681300

Knowledge Yi-Lightning leads

C4ai Aya Expanse 8b: 33.6 (#201), Yi-Lightning: 35.4 (#185)

Knowledge benchmarks
BenchmarkC4ai Aya Expanse 8bYi-Lightning
LMArena Expert11531286
Vectara Hallucination Rate9.5%—

Multilingual Yi-Lightning leads

C4ai Aya Expanse 8b: 36.1 (#242), Yi-Lightning: 42.2 (#196)

Multilingual benchmarks
BenchmarkC4ai Aya Expanse 8bYi-Lightning
LMArena Non-English11801269
LMArena Chinese11811320
LMArena German11881267
LMArena Japanese11201228
LMArena Russian11971255
LMArena French—1305
LMArena Korean—1192
LMArena Spanish—1315

Instruction Following Yi-Lightning leads

C4ai Aya Expanse 8b: 60.1 (#253), Yi-Lightning: 67.4 (#196)

Instruction Following benchmarks
BenchmarkC4ai Aya Expanse 8bYi-Lightning
LMArena Instruction Following11551278

Long Context Yi-Lightning leads

C4ai Aya Expanse 8b: 36.1 (#236), Yi-Lightning: 39.4 (#181)

Long Context benchmarks
BenchmarkC4ai Aya Expanse 8bYi-Lightning
LMArena Longer Query11911297

Writing & Preference Yi-Lightning leads

C4ai Aya Expanse 8b: 39.0 (#250), Yi-Lightning: 50.2 (#184)

Writing & Preference benchmarks
BenchmarkC4ai Aya Expanse 8bYi-Lightning
LMArena Text11851302
LMArena Creative Writing11681280
LMArena Multi-Turn11601311

Frequently asked questions

Is C4ai Aya Expanse 8b better than Yi-Lightning?

Yi-Lightning is the stronger model overall, scoring 37.1 to 34.9 on the Noometry Index.

Is C4ai Aya Expanse 8b or Yi-Lightning better for coding?

C4ai Aya Expanse 8b scores higher on coding benchmarks: 33.8 versus 27.4 in the Noometry coding category.

How many benchmarks do C4ai Aya Expanse 8b and Yi-Lightning share?

14 benchmarks have published results for both models. C4ai Aya Expanse 8b has 15 scored results on Noometry and Yi-Lightning has 18.

Related comparisons

Go deeper