Model comparison

Dolly 2.0-12b vs Granite 4.0 Micro

Granite 4.0 Micro is the stronger model overall, scoring 29.0 to 25.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

Dolly 2.0-12b Databricks

25.5

Rank #342 Confirmed

Granite 4.0 Micro IBM

29.0

Rank #318 Confirmed

Summary

  • The widest gap is in writing & preference, where Granite 4.0 Micro leads 46.7 to 15.2.

Side by side

Dolly 2.0-12b and Granite 4.0 Micro specifications
Dolly 2.0-12bGranite 4.0 Micro
ProviderDatabricksIBM
Noometry Index25.529.0
Released2023-04-112025-10-02
WeightsOpenOpen
Context window—131K
Max output—118K
Input $ / M tokens—$0.017
Output $ / M tokens—$0.11
Results tracked178

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Dolly 2.0-12b: 23.4 (#332), Granite 4.0 Micro: —

Coding benchmarks
BenchmarkDolly 2.0-12bGranite 4.0 Micro
LMArena Coding776—

Reasoning Granite 4.0 Micro leads

Dolly 2.0-12b: 15.3 (#316), Granite 4.0 Micro: 19.2 (#265)

Reasoning benchmarks
BenchmarkDolly 2.0-12bGranite 4.0 Micro
Chess Puzzles—0%
LMArena Hard Prompts804—
Epoch Capabilities Index89.67—
HellaSwag70.8%—
PIQA75.4%—
WinoGrande61.8%—

Math Dolly 2.0-12b leads

Dolly 2.0-12b: 27.3 (#251), Granite 4.0 Micro: 12.0 (#307)

Math benchmarks
BenchmarkDolly 2.0-12bGranite 4.0 Micro
OTIS Mock AIME 2024-2025—2.8%
Omni-MATH—20.9%
LMArena Math871—

Knowledge Not comparable

Dolly 2.0-12b: —, Granite 4.0 Micro: 9.9 (#304)

Knowledge benchmarks
BenchmarkDolly 2.0-12bGranite 4.0 Micro
GPQA Diamond—28.3%
MMLU-Pro—39.5%
GPQA (HELM)—30.7%
ARC (AI2) Challenge39.6%—
BoolQ56.3%—
MMLU26.2%—
OpenBookQA39.2%—

Multilingual Not comparable

Dolly 2.0-12b: 17.4 (#296), Granite 4.0 Micro: —

Multilingual benchmarks
BenchmarkDolly 2.0-12bGranite 4.0 Micro
LMArena Non-English836—
LMArena Chinese836—

Instruction Following Granite 4.0 Micro leads

Dolly 2.0-12b: 38.7 (#304), Granite 4.0 Micro: 69.9 (#169)

Instruction Following benchmarks
BenchmarkDolly 2.0-12bGranite 4.0 Micro
IFEval—84.9%
LMArena Instruction Following814—

Writing & Preference Granite 4.0 Micro leads

Dolly 2.0-12b: 15.2 (#311), Granite 4.0 Micro: 46.7 (#216)

Writing & Preference benchmarks
BenchmarkDolly 2.0-12bGranite 4.0 Micro
LMArena Text851—
LMArena Creative Writing864—
WildBench—67%
LMArena Multi-Turn740—

Frequently asked questions

Is Dolly 2.0-12b better than Granite 4.0 Micro?

Granite 4.0 Micro is the stronger model overall, scoring 29.0 to 25.5 on the Noometry Index.

How many benchmarks do Dolly 2.0-12b and Granite 4.0 Micro share?

0 benchmarks have published results for both models. Dolly 2.0-12b has 17 scored results on Noometry and Granite 4.0 Micro has 8.

Related comparisons

Go deeper