Model comparison

Gemma 2 9B vs Hy4 preview

Hy4 preview is the stronger model overall, scoring 45.3 to 25.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 2 9B Google

25.9

Rank #341 Confirmed

Hy4 preview Tencent

45.3

Rank #73 Reported

Summary

  • The widest gap is in math, where Hy4 preview leads 55.7 to 9.9.

Side by side

Gemma 2 9B and Hy4 preview specifications
Gemma 2 9BHy4 preview
ProviderGoogleTencent
Noometry Index25.945.3
Released2024-06-242026-08-28
WeightsOpenOpen
Context window—1.05M
Max output—64K
Input $ / M tokens—$0.75
Output $ / M tokens—$2.25
Results tracked353

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hy4 preview leads

Gemma 2 9B: 29.4 (#304), Hy4 preview: 51.6 (#38)

Coding benchmarks
BenchmarkGemma 2 9BHy4 preview
LMArena WebDev—1632
BigCodeBench Instruct34.7%—
LiveBench Coding22.5%—
LMArena Coding1173—
BigCodeBench Complete40.6%—

Reasoning Hy4 preview leads

Gemma 2 9B: 15.9 (#309), Hy4 preview: 31.9 (#79)

Reasoning benchmarks
BenchmarkGemma 2 9BHy4 preview
NYT Connections (extended)—68.2%
LiveBench Reasoning15.2%—
LMArena Hard Prompts1171—
LiveBench Data Analysis36.4%—
Epoch Capabilities Index119.83—
LiveBench28.7%—
PIQA83.7%—

Math Hy4 preview leads

Gemma 2 9B: 9.9 (#318), Hy4 preview: 55.7 (#42)

Math benchmarks
BenchmarkGemma 2 9BHy4 preview
OTIS Mock AIME 2024-20250.6%—
ProofBench—75%
LiveBench Math19.8%—
LMArena Math1183—
MATH Level 521%—
GSM8K84.9%—

Knowledge Not comparable

Gemma 2 9B: 9.7 (#305), Hy4 preview: —

Knowledge benchmarks
BenchmarkGemma 2 9BHy4 preview
GPQA Diamond27.5%—
LMArena Expert1147—
BoolQ85.7%—
MMLU72.1%—

Multilingual Not comparable

Gemma 2 9B: 36.6 (#238), Hy4 preview: —

Multilingual benchmarks
BenchmarkGemma 2 9BHy4 preview
LMArena Non-English1188—
LMArena Chinese1185—
LMArena French1190—
LMArena German1186—
LMArena Japanese1144—
LMArena Korean1137—
LMArena Russian1200—
LMArena Spanish1200—

Instruction Following Not comparable

Gemma 2 9B: 57.6 (#269), Hy4 preview: —

Instruction Following benchmarks
BenchmarkGemma 2 9BHy4 preview
LiveBench Instruction Following52.6%—
LMArena Instruction Following1178—

Long Context Not comparable

Gemma 2 9B: 36.3 (#233), Hy4 preview: —

Long Context benchmarks
BenchmarkGemma 2 9BHy4 preview
LMArena Longer Query1197—

Writing & Preference Not comparable

Gemma 2 9B: 32.1 (#281), Hy4 preview: —

Writing & Preference benchmarks
BenchmarkGemma 2 9BHy4 preview
LMArena Text1207—
LMArena Creative Writing1206—
EQ-Bench Creative Writing841—
LMArena Multi-Turn1193—
LiveBench Language25.5%—

Frequently asked questions

Is Gemma 2 9B better than Hy4 preview?

Hy4 preview is the stronger model overall, scoring 45.3 to 25.9 on the Noometry Index.

Is Gemma 2 9B or Hy4 preview better for coding?

Hy4 preview scores higher on coding benchmarks: 51.6 versus 29.4 in the Noometry coding category.

How many benchmarks do Gemma 2 9B and Hy4 preview share?

0 benchmarks have published results for both models. Gemma 2 9B has 35 scored results on Noometry and Hy4 preview has 3.

Related comparisons

Go deeper