Model comparison

Dolly 2.0-12b vs GLM-4.6V

GLM-4.6V is the stronger model overall, scoring 40.9 to 24.9 on the Noometry Index.

Last verified . 8 shared benchmarks.

Dolly 2.0-12b Databricks

24.9

Rank #339 Confirmed

GLM-4.6V Z.ai (Zhipu)

40.9

Rank #133 Confirmed

Summary

  • They share 8 benchmarks with published results for both. Dolly 2.0-12b scores higher in 0 categories and GLM-4.6V in 5 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GLM-4.6V leads 56.8 to 15.3.

Side by side

Dolly 2.0-12b and GLM-4.6V specifications
Dolly 2.0-12bGLM-4.6V
ProviderDatabricksZ.ai (Zhipu)
Noometry Index24.940.9
Released2023-04-112025-12-08
WeightsOpenOpen
Context window—128K
Max output—33K
Input $ / M tokens—$0.30
Output $ / M tokens—$0.90
Results tracked1712

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.6V leads

Dolly 2.0-12b: 23.0 (#327), GLM-4.6V: 40.2 (#128)

Coding benchmarks
BenchmarkDolly 2.0-12bGLM-4.6V
LMArena Coding7761390

Reasoning GLM-4.6V leads

Dolly 2.0-12b: 14.6 (#315), GLM-4.6V: 26.5 (#117)

Reasoning benchmarks
BenchmarkDolly 2.0-12bGLM-4.6V
LMArena Hard Prompts8041368
Epoch Capabilities Index88.94—
HellaSwag70.8%—
PIQA75.4%—
WinoGrande61.8%—

Math Not comparable

Dolly 2.0-12b: 25.0 (#250), GLM-4.6V: —

Math benchmarks
BenchmarkDolly 2.0-12bGLM-4.6V
LMArena Math871—

Knowledge Not comparable

Dolly 2.0-12b: —, GLM-4.6V: 37.4 (#148)

Knowledge benchmarks
BenchmarkDolly 2.0-12bGLM-4.6V
LMArena Expert—1372
ARC (AI2) Challenge39.6%—
BoolQ56.3%—
MMLU26.2%—
OpenBookQA39.2%—

Multimodal Not comparable

Dolly 2.0-12b: —, GLM-4.6V: 34.2 (#83)

Multimodal benchmarks
BenchmarkDolly 2.0-12bGLM-4.6V
LMArena Vision—1164

Multilingual GLM-4.6V leads

Dolly 2.0-12b: 17.4 (#291), GLM-4.6V: 48.8 (#135)

Multilingual benchmarks
BenchmarkDolly 2.0-12bGLM-4.6V
LMArena Non-English8361359
LMArena Chinese8361426
LMArena Russian—1341

Instruction Following GLM-4.6V leads

Dolly 2.0-12b: 38.9 (#299), GLM-4.6V: 71.6 (#145)

Instruction Following benchmarks
BenchmarkDolly 2.0-12bGLM-4.6V
LMArena Instruction Following8141351

Long Context Not comparable

Dolly 2.0-12b: —, GLM-4.6V: 41.3 (#138)

Long Context benchmarks
BenchmarkDolly 2.0-12bGLM-4.6V
LMArena Longer Query—1358

Writing & Preference GLM-4.6V leads

Dolly 2.0-12b: 15.3 (#306), GLM-4.6V: 56.8 (#132)

Writing & Preference benchmarks
BenchmarkDolly 2.0-12bGLM-4.6V
LMArena Text8511377
LMArena Creative Writing8641347
LMArena Multi-Turn7401359

Frequently asked questions

Is Dolly 2.0-12b better than GLM-4.6V?

GLM-4.6V is the stronger model overall, scoring 40.9 to 24.9 on the Noometry Index.

Is Dolly 2.0-12b or GLM-4.6V better for coding?

GLM-4.6V scores higher on coding benchmarks: 40.2 versus 23.0 in the Noometry coding category.

How many benchmarks do Dolly 2.0-12b and GLM-4.6V share?

8 benchmarks have published results for both models. Dolly 2.0-12b has 17 scored results on Noometry and GLM-4.6V has 12.

Related comparisons

Go deeper