Model comparison

Falcon-180B vs Hy3

Hy3 is the stronger model overall, scoring 44.2 to 32.2 on the Noometry Index.

Last verified . 6 shared benchmarks.

Hy3 Tencent

44.2

Rank #79 Confirmed

Summary

  • They share 6 benchmarks with published results for both. Falcon-180B scores higher in 0 categories and Hy3 in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Hy3 leads 62.2 to 29.1.

Side by side

Falcon-180B and Hy3 specifications
Falcon-180BHy3
ProviderTechnology Innovation InstituteTencent
Noometry Index32.244.2
Released2023-09-062026-07-06
WeightsOpenOpen
Context window—262K
Max output—128K
Input $ / M tokens—$0.0825
Output $ / M tokens—$0.33
Results tracked1619

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, Hy3: 46.8 (#63)

Coding benchmarks
BenchmarkFalcon-180BHy3
LMArena WebDev—1508
LMArena Coding—1464

Reasoning Hy3 leads

Falcon-180B: 19.1 (#269), Hy3: 26.1 (#136)

Reasoning benchmarks
BenchmarkFalcon-180BHy3
LMArena Hard Prompts10071447
NYT Connections (extended)—41.2%
Epoch Capabilities Index112.13—
HellaSwag89%—
LAMBADA79.8%—
PIQA84.9%—
WinoGrande87.1%—

Math Not comparable

Falcon-180B: —, Hy3: 40.1 (#93)

Math benchmarks
BenchmarkFalcon-180BHy3
LMArena Math—1475
GSM8K54.4%—

Knowledge Not comparable

Falcon-180B: —, Hy3: 40.8 (#114)

Knowledge benchmarks
BenchmarkFalcon-180BHy3
LMArena Expert—1460
ARC (AI2) Challenge67.8%—
BoolQ89%—
MMLU70.6%—
OpenBookQA64.2%—

Multilingual Hy3 leads

Falcon-180B: 25.2 (#286), Hy3: 53.5 (#65)

Multilingual benchmarks
BenchmarkFalcon-180BHy3
LMArena Non-English10001426
LMArena Chinese—1493
LMArena French—1461
LMArena German—1439
LMArena Japanese—1392
LMArena Korean—1395
LMArena Russian—1432
LMArena Spanish—1456

Instruction Following Hy3 leads

Falcon-180B: 53.4 (#286), Hy3: 75.1 (#70)

Instruction Following benchmarks
BenchmarkFalcon-180BHy3
LMArena Instruction Following10471426

Long Context Not comparable

Falcon-180B: —, Hy3: 44.1 (#75)

Long Context benchmarks
BenchmarkFalcon-180BHy3
LMArena Longer Query—1442

Writing & Preference Hy3 leads

Falcon-180B: 29.1 (#295), Hy3: 62.2 (#81)

Writing & Preference benchmarks
BenchmarkFalcon-180BHy3
LMArena Text10541439
LMArena Creative Writing10891402
LMArena Multi-Turn10131436

Frequently asked questions

Is Falcon-180B better than Hy3?

Hy3 is the stronger model overall, scoring 44.2 to 32.2 on the Noometry Index.

How many benchmarks do Falcon-180B and Hy3 share?

6 benchmarks have published results for both models. Falcon-180B has 16 scored results on Noometry and Hy3 has 19.

Related comparisons

Go deeper