Model comparison

Dolly 2.0-12b vs Laguna M.1

Laguna M.1 is the stronger model overall, scoring 31.9 to 24.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Dolly 2.0-12b Databricks

24.9

Rank #339 Confirmed

Laguna M.1 Poolside

31.9

Rank #252 Reported

Summary

  • The widest gap is in coding, where Laguna M.1 leads 36.4 to 23.0.

Side by side

Dolly 2.0-12b and Laguna M.1 specifications
Dolly 2.0-12bLaguna M.1
ProviderDatabricksPoolside
Noometry Index24.931.9
Released2023-04-112026-04-28
WeightsOpenOpen
Context window—262K
Max output—33K
Input $ / M tokens——
Output $ / M tokens——
Results tracked173

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Laguna M.1 leads

Dolly 2.0-12b: 23.0 (#327), Laguna M.1: 36.4 (#195)

Coding benchmarks
BenchmarkDolly 2.0-12bLaguna M.1
LMArena WebDev—1348
LMArena Coding776—

Reasoning Laguna M.1 leads

Dolly 2.0-12b: 14.6 (#315), Laguna M.1: 21.9 (#187)

Reasoning benchmarks
BenchmarkDolly 2.0-12bLaguna M.1
LMArena Hard Prompts804—
Surface Evolver Bench—15.6%
Epoch Capabilities Index88.94—
HellaSwag70.8%—
PIQA75.4%—
WinoGrande61.8%—

Math Dolly 2.0-12b leads

Dolly 2.0-12b: 25.0 (#250), Laguna M.1: 20.3 (#276)

Math benchmarks
BenchmarkDolly 2.0-12bLaguna M.1
ProofBench—0%
LMArena Math871—

Knowledge Not comparable

Dolly 2.0-12b: —, Laguna M.1: —

Knowledge benchmarks
BenchmarkDolly 2.0-12bLaguna M.1
ARC (AI2) Challenge39.6%—
BoolQ56.3%—
MMLU26.2%—
OpenBookQA39.2%—

Multilingual Not comparable

Dolly 2.0-12b: 17.4 (#291), Laguna M.1: —

Multilingual benchmarks
BenchmarkDolly 2.0-12bLaguna M.1
LMArena Non-English836—
LMArena Chinese836—

Instruction Following Not comparable

Dolly 2.0-12b: 38.9 (#299), Laguna M.1: —

Instruction Following benchmarks
BenchmarkDolly 2.0-12bLaguna M.1
LMArena Instruction Following814—

Writing & Preference Not comparable

Dolly 2.0-12b: 15.3 (#306), Laguna M.1: —

Writing & Preference benchmarks
BenchmarkDolly 2.0-12bLaguna M.1
LMArena Text851—
LMArena Creative Writing864—
LMArena Multi-Turn740—

Frequently asked questions

Is Dolly 2.0-12b better than Laguna M.1?

Laguna M.1 is the stronger model overall, scoring 31.9 to 24.9 on the Noometry Index.

Is Dolly 2.0-12b or Laguna M.1 better for coding?

Laguna M.1 scores higher on coding benchmarks: 36.4 versus 23.0 in the Noometry coding category.

How many benchmarks do Dolly 2.0-12b and Laguna M.1 share?

0 benchmarks have published results for both models. Dolly 2.0-12b has 17 scored results on Noometry and Laguna M.1 has 3.

Related comparisons

Go deeper