Model comparison

Falcon-180B vs Hy4 preview

Hy4 preview is the stronger model overall, scoring 45.3 to 32.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Hy4 preview Tencent

45.3

Rank #73 Reported

Summary

  • The widest gap is in reasoning, where Hy4 preview leads 31.9 to 19.1.

Side by side

Falcon-180B and Hy4 preview specifications
Falcon-180BHy4 preview
ProviderTechnology Innovation InstituteTencent
Noometry Index32.245.3
Released2023-09-062026-08-28
WeightsOpenOpen
Context window—1.05M
Max output—64K
Input $ / M tokens—$0.75
Output $ / M tokens—$2.25
Results tracked163

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, Hy4 preview: 51.6 (#38)

Coding benchmarks
BenchmarkFalcon-180BHy4 preview
LMArena WebDev—1632

Reasoning Hy4 preview leads

Falcon-180B: 19.1 (#269), Hy4 preview: 31.9 (#79)

Reasoning benchmarks
BenchmarkFalcon-180BHy4 preview
NYT Connections (extended)—68.2%
LMArena Hard Prompts1007—
Epoch Capabilities Index112.13—
HellaSwag89%—
LAMBADA79.8%—
PIQA84.9%—
WinoGrande87.1%—

Math Not comparable

Falcon-180B: —, Hy4 preview: 55.7 (#42)

Math benchmarks
BenchmarkFalcon-180BHy4 preview
ProofBench—75%
GSM8K54.4%—

Knowledge Not comparable

Falcon-180B: —, Hy4 preview: —

Knowledge benchmarks
BenchmarkFalcon-180BHy4 preview
ARC (AI2) Challenge67.8%—
BoolQ89%—
MMLU70.6%—
OpenBookQA64.2%—

Multilingual Not comparable

Falcon-180B: 25.2 (#286), Hy4 preview: —

Multilingual benchmarks
BenchmarkFalcon-180BHy4 preview
LMArena Non-English1000—

Instruction Following Not comparable

Falcon-180B: 53.4 (#286), Hy4 preview: —

Instruction Following benchmarks
BenchmarkFalcon-180BHy4 preview
LMArena Instruction Following1047—

Writing & Preference Not comparable

Falcon-180B: 29.1 (#295), Hy4 preview: —

Writing & Preference benchmarks
BenchmarkFalcon-180BHy4 preview
LMArena Text1054—
LMArena Creative Writing1089—
LMArena Multi-Turn1013—

Frequently asked questions

Is Falcon-180B better than Hy4 preview?

Hy4 preview is the stronger model overall, scoring 45.3 to 32.2 on the Noometry Index.

How many benchmarks do Falcon-180B and Hy4 preview share?

0 benchmarks have published results for both models. Falcon-180B has 16 scored results on Noometry and Hy4 preview has 3.

Related comparisons

Go deeper