Model comparison

Dolly 2.0-12b vs MiMo-V2.5

MiMo-V2.5 is the stronger model overall, scoring 43.4 to 25.5 on the Noometry Index.

Last verified . 9 shared benchmarks.

Dolly 2.0-12b Databricks

25.5

Rank #342 Confirmed

MiMo-V2.5 Xiaomi

43.4

Rank #93 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Dolly 2.0-12b scores higher in 0 categories and MiMo-V2.5 in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where MiMo-V2.5 leads 61.6 to 15.2.

Side by side

Dolly 2.0-12b and MiMo-V2.5 specifications
Dolly 2.0-12bMiMo-V2.5
ProviderDatabricksXiaomi
Noometry Index25.543.4
Released2023-04-112026-04-22
WeightsOpenOpen
Context window—1.05M
Max output—131K
Input $ / M tokens—$0.14
Output $ / M tokens—$0.28
Results tracked1723

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiMo-V2.5 leads

Dolly 2.0-12b: 23.4 (#332), MiMo-V2.5: 43.9 (#81)

Coding benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5
LMArena Coding7761469
LMArena WebDev—1438
SciCode—43.1%
ALE-Bench—513.95

Reasoning MiMo-V2.5 leads

Dolly 2.0-12b: 15.3 (#316), MiMo-V2.5: 28.6 (#101)

Reasoning benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5
LMArena Hard Prompts8041450
CritPt—3.7%
Epoch Capabilities Index89.67—
HellaSwag70.8%—
PIQA75.4%—
WinoGrande61.8%—

Math MiMo-V2.5 leads

Dolly 2.0-12b: 27.3 (#251), MiMo-V2.5: 36.8 (#163)

Math benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5
LMArena Math8711436
ProofBench—16%

Knowledge Not comparable

Dolly 2.0-12b: —, MiMo-V2.5: 40.8 (#115)

Knowledge benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5
LMArena Expert—1460
ARC (AI2) Challenge39.6%—
BoolQ56.3%—
MMLU26.2%—
OpenBookQA39.2%—

Multimodal Not comparable

Dolly 2.0-12b: —, MiMo-V2.5: 39.8 (#54)

Multimodal benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5
LMArena Vision—1247

Multilingual MiMo-V2.5 leads

Dolly 2.0-12b: 17.4 (#296), MiMo-V2.5: 51.9 (#99)

Multilingual benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5
LMArena Non-English8361404
LMArena Chinese8361468
LMArena French—1447
LMArena German—1421
LMArena Japanese—1306
LMArena Korean—1363
LMArena Russian—1395
LMArena Spanish—1416

Instruction Following MiMo-V2.5 leads

Dolly 2.0-12b: 38.7 (#304), MiMo-V2.5: 75.5 (#60)

Instruction Following benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5
LMArena Instruction Following8141434

Long Context Not comparable

Dolly 2.0-12b: —, MiMo-V2.5: 44.2 (#73)

Long Context benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5
LMArena Longer Query—1445

Writing & Preference MiMo-V2.5 leads

Dolly 2.0-12b: 15.2 (#311), MiMo-V2.5: 61.6 (#86)

Writing & Preference benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5
LMArena Text8511428
LMArena Creative Writing8641393
LMArena Multi-Turn7401445

Frequently asked questions

Is Dolly 2.0-12b better than MiMo-V2.5?

MiMo-V2.5 is the stronger model overall, scoring 43.4 to 25.5 on the Noometry Index.

Is Dolly 2.0-12b or MiMo-V2.5 better for coding?

MiMo-V2.5 scores higher on coding benchmarks: 43.9 versus 23.4 in the Noometry coding category.

How many benchmarks do Dolly 2.0-12b and MiMo-V2.5 share?

9 benchmarks have published results for both models. Dolly 2.0-12b has 17 scored results on Noometry and MiMo-V2.5 has 23.

Related comparisons

Go deeper