Model comparison

Gemma 2 9B vs Hy3

Hy3 is the stronger model overall, scoring 44.2 to 25.9 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemma 2 9B Google

25.9

Rank #341 Confirmed

Hy3 Tencent

44.2

Rank #79 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemma 2 9B scores higher in 0 categories and Hy3 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Hy3 leads 40.8 to 9.7.

Side by side

Gemma 2 9B and Hy3 specifications
Gemma 2 9BHy3
ProviderGoogleTencent
Noometry Index25.944.2
Released2024-06-242026-07-06
WeightsOpenOpen
Context window—262K
Max output—128K
Input $ / M tokens—$0.0825
Output $ / M tokens—$0.33
Results tracked3519

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hy3 leads

Gemma 2 9B: 29.4 (#304), Hy3: 46.8 (#63)

Coding benchmarks
BenchmarkGemma 2 9BHy3
LMArena Coding11731464
LMArena WebDev—1508
BigCodeBench Instruct34.7%—
LiveBench Coding22.5%—
BigCodeBench Complete40.6%—

Reasoning Hy3 leads

Gemma 2 9B: 15.9 (#309), Hy3: 26.1 (#136)

Reasoning benchmarks
BenchmarkGemma 2 9BHy3
LMArena Hard Prompts11711447
NYT Connections (extended)—41.2%
LiveBench Reasoning15.2%—
LiveBench Data Analysis36.4%—
Epoch Capabilities Index119.83—
LiveBench28.7%—
PIQA83.7%—

Math Hy3 leads

Gemma 2 9B: 9.9 (#318), Hy3: 40.1 (#93)

Math benchmarks
BenchmarkGemma 2 9BHy3
LMArena Math11831475
OTIS Mock AIME 2024-20250.6%—
LiveBench Math19.8%—
MATH Level 521%—
GSM8K84.9%—

Knowledge Hy3 leads

Gemma 2 9B: 9.7 (#305), Hy3: 40.8 (#114)

Knowledge benchmarks
BenchmarkGemma 2 9BHy3
LMArena Expert11471460
GPQA Diamond27.5%—
BoolQ85.7%—
MMLU72.1%—

Multilingual Hy3 leads

Gemma 2 9B: 36.6 (#238), Hy3: 53.5 (#65)

Multilingual benchmarks
BenchmarkGemma 2 9BHy3
LMArena Non-English11881426
LMArena Chinese11851493
LMArena French11901461
LMArena German11861439
LMArena Japanese11441392
LMArena Korean11371395
LMArena Russian12001432
LMArena Spanish12001456

Instruction Following Hy3 leads

Gemma 2 9B: 57.6 (#269), Hy3: 75.1 (#70)

Instruction Following benchmarks
BenchmarkGemma 2 9BHy3
LMArena Instruction Following11781426
LiveBench Instruction Following52.6%—

Long Context Hy3 leads

Gemma 2 9B: 36.3 (#233), Hy3: 44.1 (#75)

Long Context benchmarks
BenchmarkGemma 2 9BHy3
LMArena Longer Query11971442

Writing & Preference Hy3 leads

Gemma 2 9B: 32.1 (#281), Hy3: 62.2 (#81)

Writing & Preference benchmarks
BenchmarkGemma 2 9BHy3
LMArena Text12071439
LMArena Creative Writing12061402
LMArena Multi-Turn11931436
EQ-Bench Creative Writing841—
LiveBench Language25.5%—

Frequently asked questions

Is Gemma 2 9B better than Hy3?

Hy3 is the stronger model overall, scoring 44.2 to 25.9 on the Noometry Index.

Is Gemma 2 9B or Hy3 better for coding?

Hy3 scores higher on coding benchmarks: 46.8 versus 29.4 in the Noometry coding category.

How many benchmarks do Gemma 2 9B and Hy3 share?

17 benchmarks have published results for both models. Gemma 2 9B has 35 scored results on Noometry and Hy3 has 19.

Related comparisons

Go deeper