Noometry

Model comparison

Dolly 2.0-12b vs Qwen3.7 Plus

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 25.5 on the Noometry Index.

Last verified . 10 shared benchmarks.

Dolly 2.0-12b Databricks

25.5

Rank #342 Confirmed

Qwen3.7 Plus Alibaba (Qwen)

45.3

Rank #72 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Dolly 2.0-12b scores higher in 0 categories and Qwen3.7 Plus in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3.7 Plus leads 64.3 to 15.2.
  • Dolly 2.0-12b has downloadable open weights; the other is API-only.

Side by side

Dolly 2.0-12bQwen3.7 Plus
ProviderDatabricksAlibaba (Qwen)
Noometry Index25.545.3
Released2023-04-112026-06-02
WeightsOpenProprietary
Context window—1M
Max output—131K
Input $ / M tokens—$0.40
Output $ / M tokens—$1.60
Results tracked1732

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.7 Plus leads

Dolly 2.0-12b: 23.4 (#332), Qwen3.7 Plus: 36.6 (#206)

BenchmarkDolly 2.0-12bQwen3.7 Plus
LMArena Coding7761473
FrontierCode—10.2%
SciCode—45.5%

Agentic & Tool Use Not comparable

Dolly 2.0-12b: —, Qwen3.7 Plus: 21.4 (#138)

BenchmarkDolly 2.0-12bQwen3.7 Plus
OSWorld 2.0—2.8%

Reasoning Qwen3.7 Plus leads

Dolly 2.0-12b: 15.3 (#316), Qwen3.7 Plus: 39.3 (#59)

BenchmarkDolly 2.0-12bQwen3.7 Plus
LMArena Hard Prompts8041460
Epoch Capabilities Index89.67147.37
NYT Connections (extended)—74.8%
CritPt—9.1%
Chess Puzzles—24%
Mystery Game Puzzles—17%
DTBench—84%
LMCA—37.6%
HellaSwag70.8%—
PIQA75.4%—
WinoGrande61.8%—

Math Qwen3.7 Plus leads

Dolly 2.0-12b: 27.3 (#251), Qwen3.7 Plus: 50.5 (#56)

BenchmarkDolly 2.0-12bQwen3.7 Plus
LMArena Math8711466
FrontierMath (Tiers 1-3)—34.4%
OTIS Mock AIME 2024-2025—93.3%

Knowledge Not comparable

Dolly 2.0-12b: —, Qwen3.7 Plus: 54.9 (#51)

BenchmarkDolly 2.0-12bQwen3.7 Plus
GPQA Diamond—87.9%
LMArena Expert—1467
ARC (AI2) Challenge39.6%—
BoolQ56.3%—
MMLU26.2%—
OpenBookQA39.2%—

Multimodal Not comparable

Dolly 2.0-12b: —, Qwen3.7 Plus: 41.8 (#33)

BenchmarkDolly 2.0-12bQwen3.7 Plus
LMArena Vision—1279
LMArena Document—1444

Multilingual Qwen3.7 Plus leads

Dolly 2.0-12b: 17.4 (#296), Qwen3.7 Plus: 54.8 (#38)

BenchmarkDolly 2.0-12bQwen3.7 Plus
LMArena Non-English8361445
LMArena Chinese8361510
LMArena French—1473
LMArena German—1471
LMArena Japanese—1413
LMArena Korean—1415
LMArena Russian—1457
LMArena Spanish—1457

Instruction Following Qwen3.7 Plus leads

Dolly 2.0-12b: 38.7 (#304), Qwen3.7 Plus: 75.8 (#52)

BenchmarkDolly 2.0-12bQwen3.7 Plus
LMArena Instruction Following8141440

Long Context Not comparable

Dolly 2.0-12b: —, Qwen3.7 Plus: 44.5 (#65)

BenchmarkDolly 2.0-12bQwen3.7 Plus
LMArena Longer Query—1455

Writing & Preference Qwen3.7 Plus leads

Dolly 2.0-12b: 15.2 (#311), Qwen3.7 Plus: 64.3 (#56)

BenchmarkDolly 2.0-12bQwen3.7 Plus
LMArena Text8511455
LMArena Creative Writing8641439
LMArena Multi-Turn7401460

Frequently asked questions

Is Dolly 2.0-12b better than Qwen3.7 Plus?

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 25.5 on the Noometry Index.

Is Dolly 2.0-12b or Qwen3.7 Plus better for coding?

Qwen3.7 Plus scores higher on coding benchmarks: 36.6 versus 23.4 in the Noometry coding category.

How many benchmarks do Dolly 2.0-12b and Qwen3.7 Plus share?

10 benchmarks have published results for both models. Dolly 2.0-12b has 17 scored results on Noometry and Qwen3.7 Plus has 32.

Related comparisons

Go deeper