Model comparison

Gemma 2B vs Hy4 preview

Hy4 preview is the stronger model overall, scoring 45.3 to 29.6 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 2B Google

29.6

Rank #307 Confirmed

Hy4 preview Tencent

45.3

Rank #73 Reported

Summary

  • The widest gap is in math, where Hy4 preview leads 55.7 to 30.0.

Side by side

Gemma 2B and Hy4 preview specifications
Gemma 2BHy4 preview
ProviderGoogleTencent
Noometry Index29.645.3
Released2024-02-212026-08-28
WeightsOpenOpen
Context window—1.05M
Max output—64K
Input $ / M tokens—$0.83
Output $ / M tokens—$2.50
Results tracked233

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hy4 preview leads

Gemma 2B: 29.4 (#305), Hy4 preview: 51.6 (#38)

Coding benchmarks
BenchmarkGemma 2BHy4 preview
LMArena WebDev—1632
LMArena Coding1010—
HumanEval+20.7%—
MBPP+34.1%—

Reasoning Hy4 preview leads

Gemma 2B: 18.8 (#275), Hy4 preview: 31.9 (#79)

Reasoning benchmarks
BenchmarkGemma 2BHy4 preview
NYT Connections (extended)—68.2%
LMArena Hard Prompts989—
BIG-Bench Hard35.2%—
Epoch Capabilities Index94.2—
HellaSwag71.4%—
PIQA77.3%—
WinoGrande65.4%—

Math Hy4 preview leads

Gemma 2B: 30.0 (#239), Hy4 preview: 55.7 (#42)

Math benchmarks
BenchmarkGemma 2BHy4 preview
ProofBench—75%
LMArena Math1009—
GSM8K17.7%—

Knowledge Not comparable

Gemma 2B: —, Hy4 preview: —

Knowledge benchmarks
BenchmarkGemma 2BHy4 preview
ARC (AI2) Challenge42.1%—
BoolQ69.4%—
MMLU42.3%—
TriviaQA53.2%—

Multilingual Not comparable

Gemma 2B: 23.0 (#294), Hy4 preview: —

Multilingual benchmarks
BenchmarkGemma 2BHy4 preview
LMArena Non-English958—
LMArena Chinese986—
LMArena Russian937—

Instruction Following Not comparable

Gemma 2B: 48.5 (#302), Hy4 preview: —

Instruction Following benchmarks
BenchmarkGemma 2BHy4 preview
LMArena Instruction Following970—

Long Context Not comparable

Gemma 2B: 29.9 (#291), Hy4 preview: —

Long Context benchmarks
BenchmarkGemma 2BHy4 preview
LMArena Longer Query981—

Writing & Preference Not comparable

Gemma 2B: 24.0 (#308), Hy4 preview: —

Writing & Preference benchmarks
BenchmarkGemma 2BHy4 preview
LMArena Text1002—
LMArena Creative Writing987—
LMArena Multi-Turn945—

Frequently asked questions

Is Gemma 2B better than Hy4 preview?

Hy4 preview is the stronger model overall, scoring 45.3 to 29.6 on the Noometry Index.

Is Gemma 2B or Hy4 preview better for coding?

Hy4 preview scores higher on coding benchmarks: 51.6 versus 29.4 in the Noometry coding category.

How many benchmarks do Gemma 2B and Hy4 preview share?

0 benchmarks have published results for both models. Gemma 2B has 23 scored results on Noometry and Hy4 preview has 3.

Related comparisons

Go deeper