Model comparison

Dolly 2.0-12b vs MiMo-V2.5-Pro

MiMo-V2.5-Pro is the stronger model overall, scoring 45.2 to 25.5 on the Noometry Index.

Last verified . 9 shared benchmarks.

Dolly 2.0-12b Databricks

25.5

Rank #342 Confirmed

MiMo-V2.5-Pro Xiaomi

45.2

Rank #74 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Dolly 2.0-12b scores higher in 0 categories and MiMo-V2.5-Pro in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where MiMo-V2.5-Pro leads 65.3 to 15.2.

Side by side

Dolly 2.0-12b and MiMo-V2.5-Pro specifications
Dolly 2.0-12bMiMo-V2.5-Pro
ProviderDatabricksXiaomi
Noometry Index25.545.2
Released2023-04-112026-04-22
WeightsOpenOpen
Context window—1.05M
Max output—131K
Input $ / M tokens—$0.43
Output $ / M tokens—$0.87
Results tracked1727

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiMo-V2.5-Pro leads

Dolly 2.0-12b: 23.4 (#332), MiMo-V2.5-Pro: 47.4 (#60)

Coding benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5-Pro
LMArena Coding7761503
LMArena WebDev—1479
SciCode—50.2%
ALE-Bench—899.8

Reasoning MiMo-V2.5-Pro leads

Dolly 2.0-12b: 15.3 (#316), MiMo-V2.5-Pro: 26.8 (#130)

Reasoning benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5-Pro
LMArena Hard Prompts8041488
NYT Connections (extended)—34.4%
CritPt—4%
DTBench—84.5%
LMCA—29.5%
Epoch Capabilities Index89.67—
HellaSwag70.8%—
PIQA75.4%—
WinoGrande61.8%—

Math MiMo-V2.5-Pro leads

Dolly 2.0-12b: 27.3 (#251), MiMo-V2.5-Pro: 40.0 (#96)

Math benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5-Pro
LMArena Math8711481
ProofBench—22%

Knowledge Not comparable

Dolly 2.0-12b: —, MiMo-V2.5-Pro: 42.2 (#98)

Knowledge benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5-Pro
LMArena Expert—1503
ARC (AI2) Challenge39.6%—
BoolQ56.3%—
MMLU26.2%—
OpenBookQA39.2%—

Multilingual MiMo-V2.5-Pro leads

Dolly 2.0-12b: 17.4 (#296), MiMo-V2.5-Pro: 55.1 (#34)

Multilingual benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5-Pro
LMArena Non-English8361449
LMArena Chinese8361507
LMArena French—1488
LMArena German—1458
LMArena Japanese—1412
LMArena Korean—1437
LMArena Russian—1450
LMArena Spanish—1471

Instruction Following MiMo-V2.5-Pro leads

Dolly 2.0-12b: 38.7 (#304), MiMo-V2.5-Pro: 77.5 (#21)

Instruction Following benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5-Pro
LMArena Instruction Following8141477

Long Context Not comparable

Dolly 2.0-12b: —, MiMo-V2.5-Pro: 45.4 (#37)

Long Context benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5-Pro
LMArena Longer Query—1483

Writing & Preference MiMo-V2.5-Pro leads

Dolly 2.0-12b: 15.2 (#311), MiMo-V2.5-Pro: 65.3 (#49)

Writing & Preference benchmarks
BenchmarkDolly 2.0-12bMiMo-V2.5-Pro
LMArena Text8511465
LMArena Creative Writing8641440
LMArena Multi-Turn7401477
EQ-Bench Creative Writing—1493
EQ-Bench 4—1208

Frequently asked questions

Is Dolly 2.0-12b better than MiMo-V2.5-Pro?

MiMo-V2.5-Pro is the stronger model overall, scoring 45.2 to 25.5 on the Noometry Index.

Is Dolly 2.0-12b or MiMo-V2.5-Pro better for coding?

MiMo-V2.5-Pro scores higher on coding benchmarks: 47.4 versus 23.4 in the Noometry coding category.

How many benchmarks do Dolly 2.0-12b and MiMo-V2.5-Pro share?

9 benchmarks have published results for both models. Dolly 2.0-12b has 17 scored results on Noometry and MiMo-V2.5-Pro has 27.

Related comparisons

Go deeper