Model comparison

Gemini 1.0 Pro vs Hy4 preview

Hy4 preview is the stronger model overall, scoring 44.6 to 27.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemini 1.0 Pro Google

27.1

Rank #327 Confirmed

Hy4 preview Tencent

44.6

Rank #73 Reported

Summary

  • The widest gap is in math, where Hy4 preview leads 54.5 to 8.7.
  • Hy4 preview has downloadable open weights; the other is API-only.

Side by side

Gemini 1.0 Pro and Hy4 preview specifications
Gemini 1.0 ProHy4 preview
ProviderGoogleTencent
Noometry Index27.144.6
Released2023-12-132026-08-28
WeightsProprietaryOpen
Context window—1.05M
Max output—64K
Input $ / M tokens—$0.83
Output $ / M tokens—$2.50
Results tracked243

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hy4 preview leads

Gemini 1.0 Pro: 31.6 (#270), Hy4 preview: 51.4 (#36)

Coding benchmarks
BenchmarkGemini 1.0 ProHy4 preview
LMArena WebDev—1633
LMArena Coding1108—
HumanEval+55.5%—
MBPP+61.4%—

Reasoning Hy4 preview leads

Gemini 1.0 Pro: 16.4 (#292), Hy4 preview: 30.6 (#75)

Reasoning benchmarks
BenchmarkGemini 1.0 ProHy4 preview
NYT Connections (extended)—68.2%
LMArena Hard Prompts1109—
DTBench45.9%—
Epoch Capabilities Index116.97—

Math Hy4 preview leads

Gemini 1.0 Pro: 8.7 (#315), Hy4 preview: 54.5 (#37)

Math benchmarks
BenchmarkGemini 1.0 ProHy4 preview
OTIS Mock AIME 2024-20251.1%—
ProofBench—75%
LMArena Math1132—
MATH Level 511.2%—

Knowledge Not comparable

Gemini 1.0 Pro: 15.5 (#286), Hy4 preview: —

Knowledge benchmarks
BenchmarkGemini 1.0 ProHy4 preview
GPQA Diamond34%—
LMArena Expert1059—
MMLU70%—

Multilingual Not comparable

Gemini 1.0 Pro: 33.5 (#247), Hy4 preview: —

Multilingual benchmarks
BenchmarkGemini 1.0 ProHy4 preview
LMArena Non-English1138—
LMArena Chinese1124—
LMArena French1144—
LMArena German1125—
LMArena Japanese1023—
LMArena Russian1186—
LMArena Spanish1118—

Instruction Following Not comparable

Gemini 1.0 Pro: 57.9 (#262), Hy4 preview: —

Instruction Following benchmarks
BenchmarkGemini 1.0 ProHy4 preview
LMArena Instruction Following1114—

Long Context Not comparable

Gemini 1.0 Pro: 34.3 (#244), Hy4 preview: —

Long Context benchmarks
BenchmarkGemini 1.0 ProHy4 preview
LMArena Longer Query1132—

Writing & Preference Not comparable

Gemini 1.0 Pro: 36.2 (#259), Hy4 preview: —

Writing & Preference benchmarks
BenchmarkGemini 1.0 ProHy4 preview
LMArena Text1149—
LMArena Creative Writing1130—
LMArena Multi-Turn1139—

Frequently asked questions

Is Gemini 1.0 Pro better than Hy4 preview?

Hy4 preview is the stronger model overall, scoring 44.6 to 27.1 on the Noometry Index.

Is Gemini 1.0 Pro or Hy4 preview better for coding?

Hy4 preview scores higher on coding benchmarks: 51.4 versus 31.6 in the Noometry coding category.

How many benchmarks do Gemini 1.0 Pro and Hy4 preview share?

0 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and Hy4 preview has 3.

Related comparisons

Go deeper