Noometry

Model comparison

C4ai Aya Expanse 8b vs Molmo 2 8b

Molmo 2 8b is the stronger model overall, scoring 39.1 to 34.9 on the Noometry Index.

Last verified . 4 shared benchmarks.

C4ai Aya Expanse 8b Cohere

34.9

Rank #229 Confirmed

Molmo 2 8b Allen Institute for AI (Ai2)

39.1

Rank #174 Confirmed

Summary

  • They share 4 benchmarks with published results for both. C4ai Aya Expanse 8b scores higher in 0 categories and Molmo 2 8b in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Molmo 2 8b leads 49.4 to 39.0.

Side by side

C4ai Aya Expanse 8bMolmo 2 8b
ProviderCohereAllen Institute for AI (Ai2)
Noometry Index34.939.1
Released——
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked155

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

C4ai Aya Expanse 8b: 33.8 (#252), Molmo 2 8b: —

BenchmarkC4ai Aya Expanse 8bMolmo 2 8b
LMArena Coding1160—

Reasoning Molmo 2 8b leads

C4ai Aya Expanse 8b: 22.4 (#197), Molmo 2 8b: 25.6 (#146)

BenchmarkC4ai Aya Expanse 8bMolmo 2 8b
LMArena Hard Prompts11561287

Math Not comparable

C4ai Aya Expanse 8b: 33.3 (#203), Molmo 2 8b: —

BenchmarkC4ai Aya Expanse 8bMolmo 2 8b
LMArena Math1168—

Knowledge Not comparable

C4ai Aya Expanse 8b: 33.6 (#201), Molmo 2 8b: —

BenchmarkC4ai Aya Expanse 8bMolmo 2 8b
Vectara Hallucination Rate9.5%—
LMArena Expert1153—

Multimodal Not comparable

C4ai Aya Expanse 8b: —, Molmo 2 8b: 30.2 (#112)

BenchmarkC4ai Aya Expanse 8bMolmo 2 8b
LMArena Vision—1081

Multilingual Molmo 2 8b leads

C4ai Aya Expanse 8b: 36.1 (#242), Molmo 2 8b: 42.7 (#190)

BenchmarkC4ai Aya Expanse 8bMolmo 2 8b
LMArena Non-English11801276
LMArena Chinese1181—
LMArena German1188—
LMArena Japanese1120—
LMArena Russian1197—

Instruction Following Molmo 2 8b leads

C4ai Aya Expanse 8b: 60.1 (#253), Molmo 2 8b: 67.0 (#201)

BenchmarkC4ai Aya Expanse 8bMolmo 2 8b
LMArena Instruction Following11551270

Long Context Not comparable

C4ai Aya Expanse 8b: 36.1 (#236), Molmo 2 8b: —

BenchmarkC4ai Aya Expanse 8bMolmo 2 8b
LMArena Longer Query1191—

Writing & Preference Molmo 2 8b leads

C4ai Aya Expanse 8b: 39.0 (#250), Molmo 2 8b: 49.4 (#191)

BenchmarkC4ai Aya Expanse 8bMolmo 2 8b
LMArena Text11851288
LMArena Creative Writing1168—
LMArena Multi-Turn1160—

Frequently asked questions

Is C4ai Aya Expanse 8b better than Molmo 2 8b?

Molmo 2 8b is the stronger model overall, scoring 39.1 to 34.9 on the Noometry Index.

How many benchmarks do C4ai Aya Expanse 8b and Molmo 2 8b share?

4 benchmarks have published results for both models. C4ai Aya Expanse 8b has 15 scored results on Noometry and Molmo 2 8b has 5.

Related comparisons

Go deeper