Model comparison

Gemini 3 Pro vs Hy4 preview

Gemini 3 Pro is the stronger model overall, scoring 54.8 to 45.3 on the Noometry Index.

Last verified . 3 shared benchmarks.

Gemini 3 Pro Google

54.8

Rank #28 Confirmed

Hy4 preview Tencent

45.3

Rank #73 Reported

Summary

  • They share 3 benchmarks with published results for both. Gemini 3 Pro scores higher in 1 category and Hy4 preview in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3 Pro leads 52.5 to 31.9.
  • The biggest single-benchmark swing is ProofBench: 20% for Gemini 3 Pro and 75% for Hy4 preview.
  • Hy4 preview has downloadable open weights; the other is API-only.

Side by side

Gemini 3 Pro and Hy4 preview specifications
Gemini 3 ProHy4 preview
ProviderGoogleTencent
Noometry Index54.845.3
Released2025-11-182026-08-28
WeightsProprietaryOpen
Context window—1.05M
Max output—64K
Input $ / M tokens—$0.75
Output $ / M tokens—$2.25
Results tracked673

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Gemini 3 Pro: 51.6 (#39), Hy4 preview: 51.6 (#38)

Coding benchmarks
BenchmarkGemini 3 ProHy4 preview
LMArena WebDev14401632
SWE-bench Verified72.9%—
SWE-bench Verified (bash only)74.2%—
SWE-bench Multilingual68.7%—
GSO18.6%—
WeirdML69.9%—
LMArena Coding1481—
ALE-Bench1,177—
AlgoTune1.83—

Agentic & Tool Use Not comparable

Gemini 3 Pro: 40.6 (#23), Hy4 preview: —

Agentic & Tool Use benchmarks
BenchmarkGemini 3 ProHy4 preview
Terminal-Bench69.4%—
Berkeley Function Calling Leaderboard72.5%—
GDPval40.3%—
Remote Labor Index1.3%—
τ²-bench Airline80.5%—
τ²-bench Banking18%—
τ²-bench Retail75.9%—
τ²-bench Telecom91%—
DeepResearch Bench46.3%—
BALROG58.1%—
LMArena Search1207—
METR Time Horizons71%—
Vending-Bench 25,478—

Reasoning Gemini 3 Pro leads

Gemini 3 Pro: 52.5 (#31), Hy4 preview: 31.9 (#79)

Reasoning benchmarks
BenchmarkGemini 3 ProHy4 preview
NYT Connections (extended)94.4%68.2%
ARC-AGI-231.1%—
SimpleBench76.4%—
Kagi LLM Benchmark80.1%—
ARC-AGI-175%—
CritPt6.9%—
Chess Puzzles31%—
EnigmaEval18.2%—
LMArena Hard Prompts1480—
Epoch Capabilities Index152.92—
ForecastBench61.2—

Math Hy4 preview leads

Gemini 3 Pro: 49.9 (#59), Hy4 preview: 55.7 (#42)

Math benchmarks
BenchmarkGemini 3 ProHy4 preview
ProofBench20%75%
MathArena Final-Answer Competitions67%—
OTIS Mock AIME 2024-202591.4%—
Omni-MATH55.5%—
LMArena Math1476—
FrontierMath (Feb 2025 set)37.6%—
FrontierMath Tier 4 (v1)18.8%—

Knowledge Not comparable

Gemini 3 Pro: 64.4 (#16), Hy4 preview: —

Knowledge benchmarks
BenchmarkGemini 3 ProHy4 preview
GPQA Diamond92.6%—
Humanity's Last Exam37.5%—
MMLU-Pro90.3%—
Vectara Hallucination Rate13.6%—
GPQA (HELM)80.3%—
LMArena Expert1475—

Multimodal Not comparable

Gemini 3 Pro: 57.6 (#2), Hy4 preview: —

Multimodal benchmarks
BenchmarkGemini 3 ProHy4 preview
LMArena Vision1305—
GeoBench84%—
VPCT91%—
LMArena Document1434—

Multilingual Not comparable

Gemini 3 Pro: 56.9 (#16), Hy4 preview: —

Multilingual benchmarks
BenchmarkGemini 3 ProHy4 preview
LMArena Non-English1474—
LMArena Chinese1523—
LMArena French1492—
LMArena German1515—
LMArena Japanese1510—
LMArena Korean1448—
LMArena Russian1493—
LMArena Spanish1470—

Instruction Following Not comparable

Gemini 3 Pro: 76.3 (#45), Hy4 preview: —

Instruction Following benchmarks
BenchmarkGemini 3 ProHy4 preview
IFEval87.7%—
LMArena Instruction Following1458—

Long Context Not comparable

Gemini 3 Pro: 44.0 (#79), Hy4 preview: —

Long Context benchmarks
BenchmarkGemini 3 ProHy4 preview
CL-bench15.8%—
LMArena Longer Query1471—

Writing & Preference Not comparable

Gemini 3 Pro: 66.4 (#35), Hy4 preview: —

Writing & Preference benchmarks
BenchmarkGemini 3 ProHy4 preview
LMArena Text1479—
LMArena Creative Writing1482—
EQ-Bench Creative Writing1525—
WildBench85.9%—
LMArena Multi-Turn1484—

Frequently asked questions

Is Gemini 3 Pro better than Hy4 preview?

Gemini 3 Pro is the stronger model overall, scoring 54.8 to 45.3 on the Noometry Index.

Is Gemini 3 Pro or Hy4 preview better for coding?

They score almost the same on coding (51.6 vs 51.6); test both on your own repository before choosing.

How many benchmarks do Gemini 3 Pro and Hy4 preview share?

3 benchmarks have published results for both models. Gemini 3 Pro has 67 scored results on Noometry and Hy4 preview has 3.

Related comparisons

Go deeper