Noometry

Model comparison

Dolly 2.0-12b vs Qwen3-Coder 480B-A35B Instruct

Qwen3-Coder 480B-A35B Instruct is the stronger model overall, scoring 37.7 to 24.9 on the Noometry Index.

Last verified . 9 shared benchmarks.

Dolly 2.0-12b Databricks

24.9

Rank #339 Confirmed

Qwen3-Coder 480B-A35B Instruct Alibaba (Qwen)

37.7

Rank #186 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Dolly 2.0-12b scores higher in 0 categories and Qwen3-Coder 480B-A35B Instruct in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3-Coder 480B-A35B Instruct leads 55.5 to 15.3.

Side by side

Dolly 2.0-12bQwen3-Coder 480B-A35B Instruct
ProviderDatabricksAlibaba (Qwen)
Noometry Index24.937.7
Released2023-04-112025-04
WeightsOpenOpen
Context window—262K
Max output—66K
Input $ / M tokens—$1.50
Output $ / M tokens—$7.50
Results tracked1725

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3-Coder 480B-A35B Instruct leads

Dolly 2.0-12b: 23.0 (#327), Qwen3-Coder 480B-A35B Instruct: 36.2 (#199)

BenchmarkDolly 2.0-12bQwen3-Coder 480B-A35B Instruct
LMArena Coding7761413
SWE-bench Verified (bash only)—55.4%
LMArena WebDev—1275
GSO—4.9%
WeirdML—41.2%
ALE-Bench—461.45
AlgoTune—1.44

Agentic & Tool Use Not comparable

Dolly 2.0-12b: —, Qwen3-Coder 480B-A35B Instruct: 23.7 (#116)

BenchmarkDolly 2.0-12bQwen3-Coder 480B-A35B Instruct
Terminal-Bench—27.2%

Reasoning Qwen3-Coder 480B-A35B Instruct leads

Dolly 2.0-12b: 14.6 (#315), Qwen3-Coder 480B-A35B Instruct: 24.7 (#141)

BenchmarkDolly 2.0-12bQwen3-Coder 480B-A35B Instruct
LMArena Hard Prompts8041372
Kagi LLM Benchmark—49.5%
Epoch Capabilities Index88.94—
HellaSwag70.8%—
PIQA75.4%—
WinoGrande61.8%—

Math Qwen3-Coder 480B-A35B Instruct leads

Dolly 2.0-12b: 25.0 (#250), Qwen3-Coder 480B-A35B Instruct: 34.9 (#151)

BenchmarkDolly 2.0-12bQwen3-Coder 480B-A35B Instruct
LMArena Math8711364

Knowledge Not comparable

Dolly 2.0-12b: —, Qwen3-Coder 480B-A35B Instruct: 36.4 (#159)

BenchmarkDolly 2.0-12bQwen3-Coder 480B-A35B Instruct
LMArena Expert—1337
ARC (AI2) Challenge39.6%—
BoolQ56.3%—
MMLU26.2%—
OpenBookQA39.2%—

Multilingual Qwen3-Coder 480B-A35B Instruct leads

Dolly 2.0-12b: 17.4 (#291), Qwen3-Coder 480B-A35B Instruct: 47.8 (#143)

BenchmarkDolly 2.0-12bQwen3-Coder 480B-A35B Instruct
LMArena Non-English8361345
LMArena Chinese8361356
LMArena French—1394
LMArena German—1324
LMArena Japanese—1309
LMArena Korean—1307
LMArena Russian—1367
LMArena Spanish—1360

Instruction Following Qwen3-Coder 480B-A35B Instruct leads

Dolly 2.0-12b: 38.9 (#299), Qwen3-Coder 480B-A35B Instruct: 71.8 (#142)

BenchmarkDolly 2.0-12bQwen3-Coder 480B-A35B Instruct
LMArena Instruction Following8141356

Long Context Not comparable

Dolly 2.0-12b: —, Qwen3-Coder 480B-A35B Instruct: 42.0 (#126)

BenchmarkDolly 2.0-12bQwen3-Coder 480B-A35B Instruct
LMArena Longer Query—1379

Writing & Preference Qwen3-Coder 480B-A35B Instruct leads

Dolly 2.0-12b: 15.3 (#306), Qwen3-Coder 480B-A35B Instruct: 55.5 (#142)

BenchmarkDolly 2.0-12bQwen3-Coder 480B-A35B Instruct
LMArena Text8511356
LMArena Creative Writing8641333
LMArena Multi-Turn7401365

Frequently asked questions

Is Dolly 2.0-12b better than Qwen3-Coder 480B-A35B Instruct?

Qwen3-Coder 480B-A35B Instruct is the stronger model overall, scoring 37.7 to 24.9 on the Noometry Index.

Is Dolly 2.0-12b or Qwen3-Coder 480B-A35B Instruct better for coding?

Qwen3-Coder 480B-A35B Instruct scores higher on coding benchmarks: 36.2 versus 23.0 in the Noometry coding category.

How many benchmarks do Dolly 2.0-12b and Qwen3-Coder 480B-A35B Instruct share?

9 benchmarks have published results for both models. Dolly 2.0-12b has 17 scored results on Noometry and Qwen3-Coder 480B-A35B Instruct has 25.

Related comparisons

Go deeper