Model comparison

Dolly 2.0-12b vs Hy4 preview

Hy4 preview is the stronger model overall, scoring 44.6 to 24.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Dolly 2.0-12b Databricks

24.9

Rank #339 Confirmed

Hy4 preview Tencent

44.6

Rank #73 Reported

Summary

  • The widest gap is in math, where Hy4 preview leads 54.5 to 25.0.

Side by side

Dolly 2.0-12b and Hy4 preview specifications
Dolly 2.0-12bHy4 preview
ProviderDatabricksTencent
Noometry Index24.944.6
Released2023-04-112026-08-28
WeightsOpenOpen
Context window—1.05M
Max output—64K
Input $ / M tokens—$0.83
Output $ / M tokens—$2.50
Results tracked173

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hy4 preview leads

Dolly 2.0-12b: 23.0 (#327), Hy4 preview: 51.4 (#36)

Coding benchmarks
BenchmarkDolly 2.0-12bHy4 preview
LMArena WebDev—1633
LMArena Coding776—

Reasoning Hy4 preview leads

Dolly 2.0-12b: 14.6 (#315), Hy4 preview: 30.6 (#75)

Reasoning benchmarks
BenchmarkDolly 2.0-12bHy4 preview
NYT Connections (extended)—68.2%
LMArena Hard Prompts804—
Epoch Capabilities Index88.94—
HellaSwag70.8%—
PIQA75.4%—
WinoGrande61.8%—

Math Hy4 preview leads

Dolly 2.0-12b: 25.0 (#250), Hy4 preview: 54.5 (#37)

Math benchmarks
BenchmarkDolly 2.0-12bHy4 preview
ProofBench—75%
LMArena Math871—

Knowledge Not comparable

Dolly 2.0-12b: —, Hy4 preview: —

Knowledge benchmarks
BenchmarkDolly 2.0-12bHy4 preview
ARC (AI2) Challenge39.6%—
BoolQ56.3%—
MMLU26.2%—
OpenBookQA39.2%—

Multilingual Not comparable

Dolly 2.0-12b: 17.4 (#291), Hy4 preview: —

Multilingual benchmarks
BenchmarkDolly 2.0-12bHy4 preview
LMArena Non-English836—
LMArena Chinese836—

Instruction Following Not comparable

Dolly 2.0-12b: 38.9 (#299), Hy4 preview: —

Instruction Following benchmarks
BenchmarkDolly 2.0-12bHy4 preview
LMArena Instruction Following814—

Writing & Preference Not comparable

Dolly 2.0-12b: 15.3 (#306), Hy4 preview: —

Writing & Preference benchmarks
BenchmarkDolly 2.0-12bHy4 preview
LMArena Text851—
LMArena Creative Writing864—
LMArena Multi-Turn740—

Frequently asked questions

Is Dolly 2.0-12b better than Hy4 preview?

Hy4 preview is the stronger model overall, scoring 44.6 to 24.9 on the Noometry Index.

Is Dolly 2.0-12b or Hy4 preview better for coding?

Hy4 preview scores higher on coding benchmarks: 51.4 versus 23.0 in the Noometry coding category.

How many benchmarks do Dolly 2.0-12b and Hy4 preview share?

0 benchmarks have published results for both models. Dolly 2.0-12b has 17 scored results on Noometry and Hy4 preview has 3.

Related comparisons

Go deeper