Model comparison

Dolly 2.0-12b vs MiniMax-M2.1

MiniMax-M2.1 is the stronger model overall, scoring 38.9 to 25.5 on the Noometry Index.

Last verified . 9 shared benchmarks.

Dolly 2.0-12b Databricks

25.5

Rank #342 Confirmed

MiniMax-M2.1 MiniMax

38.9

Rank #178 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Dolly 2.0-12b scores higher in 0 categories and MiniMax-M2.1 in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where MiniMax-M2.1 leads 58.3 to 15.2.

Side by side

Dolly 2.0-12b and MiniMax-M2.1 specifications
Dolly 2.0-12bMiniMax-M2.1
ProviderDatabricksMiniMax
Noometry Index25.538.9
Released2023-04-112025-12-23
WeightsOpenOpen
Context window—205K
Max output—131K
Input $ / M tokens—$0.30
Output $ / M tokens—$1.20
Results tracked1722

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax-M2.1 leads

Dolly 2.0-12b: 23.4 (#332), MiniMax-M2.1: 40.4 (#143)

Coding benchmarks
BenchmarkDolly 2.0-12bMiniMax-M2.1
LMArena Coding7761421
LMArena WebDev—1384
ALE-Bench—623.83

Agentic & Tool Use Not comparable

Dolly 2.0-12b: —, MiniMax-M2.1: 27.9 (#98)

Agentic & Tool Use benchmarks
BenchmarkDolly 2.0-12bMiniMax-M2.1
Terminal-Bench—36.6%

Reasoning MiniMax-M2.1 leads

Dolly 2.0-12b: 15.3 (#316), MiniMax-M2.1: 16.6 (#302)

Reasoning benchmarks
BenchmarkDolly 2.0-12bMiniMax-M2.1
LMArena Hard Prompts8041411
NYT Connections (extended)—11.2%
Epoch Capabilities Index89.67—
HellaSwag70.8%—
PIQA75.4%—
WinoGrande61.8%—

Math MiniMax-M2.1 leads

Dolly 2.0-12b: 27.3 (#251), MiniMax-M2.1: 38.3 (#138)

Math benchmarks
BenchmarkDolly 2.0-12bMiniMax-M2.1
LMArena Math8711397

Knowledge Not comparable

Dolly 2.0-12b: —, MiniMax-M2.1: 38.3 (#147)

Knowledge benchmarks
BenchmarkDolly 2.0-12bMiniMax-M2.1
Vectara Hallucination Rate—11.8%
LMArena Expert—1431
ARC (AI2) Challenge39.6%—
BoolQ56.3%—
MMLU26.2%—
OpenBookQA39.2%—

Multilingual MiniMax-M2.1 leads

Dolly 2.0-12b: 17.4 (#296), MiniMax-M2.1: 50.0 (#128)

Multilingual benchmarks
BenchmarkDolly 2.0-12bMiniMax-M2.1
LMArena Non-English8361378
LMArena Chinese8361430
LMArena French—1404
LMArena German—1381
LMArena Japanese—1287
LMArena Korean—1298
LMArena Russian—1387
LMArena Spanish—1397

Instruction Following MiniMax-M2.1 leads

Dolly 2.0-12b: 38.7 (#304), MiniMax-M2.1: 73.8 (#112)

Instruction Following benchmarks
BenchmarkDolly 2.0-12bMiniMax-M2.1
LMArena Instruction Following8141400

Long Context Not comparable

Dolly 2.0-12b: —, MiniMax-M2.1: 43.2 (#101)

Long Context benchmarks
BenchmarkDolly 2.0-12bMiniMax-M2.1
LMArena Longer Query—1416

Writing & Preference MiniMax-M2.1 leads

Dolly 2.0-12b: 15.2 (#311), MiniMax-M2.1: 58.3 (#120)

Writing & Preference benchmarks
BenchmarkDolly 2.0-12bMiniMax-M2.1
LMArena Text8511392
LMArena Creative Writing8641361
LMArena Multi-Turn7401396

Frequently asked questions

Is Dolly 2.0-12b better than MiniMax-M2.1?

MiniMax-M2.1 is the stronger model overall, scoring 38.9 to 25.5 on the Noometry Index.

Is Dolly 2.0-12b or MiniMax-M2.1 better for coding?

MiniMax-M2.1 scores higher on coding benchmarks: 40.4 versus 23.4 in the Noometry coding category.

How many benchmarks do Dolly 2.0-12b and MiniMax-M2.1 share?

9 benchmarks have published results for both models. Dolly 2.0-12b has 17 scored results on Noometry and MiniMax-M2.1 has 22.

Related comparisons

Go deeper