Model comparison

C4ai Aya Expanse 8b vs Step 3.5 Flash

Step 3.5 Flash is the stronger model overall, scoring 41.7 to 34.3 on the Noometry Index.

Last verified . 14 shared benchmarks.

C4ai Aya Expanse 8b Cohere

34.3

Rank #227 Confirmed

Step 3.5 Flash StepFun

41.7

Rank #116 Confirmed

Summary

  • They share 14 benchmarks with published results for both. C4ai Aya Expanse 8b scores higher in 1 category and Step 3.5 Flash in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Step 3.5 Flash leads 59.0 to 39.2.
  • Step 3.5 Flash accepts more context: 256K tokens versus 8K.

Side by side

C4ai Aya Expanse 8b and Step 3.5 Flash specifications
C4ai Aya Expanse 8bStep 3.5 Flash
ProviderCohereStepFun
Noometry Index34.341.7
Released2024-10-242026-01-29
WeightsOpenOpen
Context window8K256K
Max output4K256K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.30
Results tracked1519

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.5 Flash leads

C4ai Aya Expanse 8b: 33.2 (#252), Step 3.5 Flash: 41.7 (#106)

Coding benchmarks
BenchmarkC4ai Aya Expanse 8bStep 3.5 Flash
LMArena Coding11611436

Reasoning Too close to call

C4ai Aya Expanse 8b: 21.4 (#198), Step 3.5 Flash: 21.2 (#202)

Reasoning benchmarks
BenchmarkC4ai Aya Expanse 8bStep 3.5 Flash
LMArena Hard Prompts11561411
NYT Connections (extended)—28.4%

Math Step 3.5 Flash leads

C4ai Aya Expanse 8b: 30.8 (#204), Step 3.5 Flash: 40.6 (#77)

Math benchmarks
BenchmarkC4ai Aya Expanse 8bStep 3.5 Flash
LMArena Math11681408
MathArena Final-Answer Competitions—66.8%

Knowledge Step 3.5 Flash leads

C4ai Aya Expanse 8b: 33.0 (#197), Step 3.5 Flash: 39.0 (#127)

Knowledge benchmarks
BenchmarkC4ai Aya Expanse 8bStep 3.5 Flash
LMArena Expert11531422
Vectara Hallucination Rate9.5%—

Multilingual Step 3.5 Flash leads

C4ai Aya Expanse 8b: 36.3 (#237), Step 3.5 Flash: 50.7 (#115)

Multilingual benchmarks
BenchmarkC4ai Aya Expanse 8bStep 3.5 Flash
LMArena Non-English11801386
LMArena Chinese11811448
LMArena German11881404
LMArena Japanese11201353
LMArena Russian11971385
LMArena French—1421
LMArena Korean—1350
LMArena Spanish—1419

Instruction Following Step 3.5 Flash leads

C4ai Aya Expanse 8b: 60.4 (#248), Step 3.5 Flash: 73.3 (#119)

Instruction Following benchmarks
BenchmarkC4ai Aya Expanse 8bStep 3.5 Flash
LMArena Instruction Following11551385

Long Context Step 3.5 Flash leads

C4ai Aya Expanse 8b: 36.1 (#231), Step 3.5 Flash: 42.8 (#112)

Long Context benchmarks
BenchmarkC4ai Aya Expanse 8bStep 3.5 Flash
LMArena Longer Query11921402

Writing & Preference Step 3.5 Flash leads

C4ai Aya Expanse 8b: 39.2 (#245), Step 3.5 Flash: 59.0 (#108)

Writing & Preference benchmarks
BenchmarkC4ai Aya Expanse 8bStep 3.5 Flash
LMArena Text11851403
LMArena Creative Writing11681357
LMArena Multi-Turn11601405

Frequently asked questions

Is C4ai Aya Expanse 8b better than Step 3.5 Flash?

Step 3.5 Flash is the stronger model overall, scoring 41.7 to 34.3 on the Noometry Index.

Is C4ai Aya Expanse 8b or Step 3.5 Flash better for coding?

Step 3.5 Flash scores higher on coding benchmarks: 41.7 versus 33.2 in the Noometry coding category.

Which has the bigger context window?

Step 3.5 Flash does, with 256K tokens against 8K.

How many benchmarks do C4ai Aya Expanse 8b and Step 3.5 Flash share?

14 benchmarks have published results for both models. C4ai Aya Expanse 8b has 15 scored results on Noometry and Step 3.5 Flash has 19.

Related comparisons

Go deeper