Noometry

Model comparison

Gemma 2 9B vs Hunyuan Large Vision

Hunyuan Large Vision is the stronger model overall, scoring 37.6 to 25.9 on the Noometry Index.

Last verified . 12 shared benchmarks.

Gemma 2 9B Google

25.9

Rank #341 Confirmed

Hunyuan Large Vision Tencent

37.6

Rank #202 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Gemma 2 9B scores higher in 0 categories and Hunyuan Large Vision in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Hunyuan Large Vision leads 35.5 to 9.9.
  • Gemma 2 9B has downloadable open weights; the other is API-only.

Side by side

Gemma 2 9BHunyuan Large Vision
ProviderGoogleTencent
Noometry Index25.937.6
Released2024-06-24—
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked3513

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan Large Vision leads

Gemma 2 9B: 29.4 (#304), Hunyuan Large Vision: 38.3 (#180)

BenchmarkGemma 2 9BHunyuan Large Vision
LMArena Coding11731308
BigCodeBench Instruct34.7%—
LiveBench Coding22.5%—
BigCodeBench Complete40.6%—

Reasoning Hunyuan Large Vision leads

Gemma 2 9B: 15.9 (#309), Hunyuan Large Vision: 24.8 (#158)

BenchmarkGemma 2 9BHunyuan Large Vision
LMArena Hard Prompts11711257
LiveBench Reasoning15.2%—
LiveBench Data Analysis36.4%—
Epoch Capabilities Index119.83—
LiveBench28.7%—
PIQA83.7%—

Math Hunyuan Large Vision leads

Gemma 2 9B: 9.9 (#318), Hunyuan Large Vision: 35.5 (#183)

BenchmarkGemma 2 9BHunyuan Large Vision
LMArena Math11831268
OTIS Mock AIME 2024-20250.6%—
LiveBench Math19.8%—
MATH Level 521%—
GSM8K84.9%—

Knowledge Hunyuan Large Vision leads

Gemma 2 9B: 9.7 (#305), Hunyuan Large Vision: 34.4 (#196)

BenchmarkGemma 2 9BHunyuan Large Vision
LMArena Expert11471252
GPQA Diamond27.5%—
BoolQ85.7%—
MMLU72.1%—

Multimodal Not comparable

Gemma 2 9B: —, Hunyuan Large Vision: 35.7 (#83)

BenchmarkGemma 2 9BHunyuan Large Vision
LMArena Vision—1180

Multilingual Hunyuan Large Vision leads

Gemma 2 9B: 36.6 (#238), Hunyuan Large Vision: 39.9 (#221)

BenchmarkGemma 2 9BHunyuan Large Vision
LMArena Non-English11881236
LMArena Chinese11851287
LMArena Russian12001243
LMArena French1190—
LMArena German1186—
LMArena Japanese1144—
LMArena Korean1137—
LMArena Spanish1200—

Instruction Following Hunyuan Large Vision leads

Gemma 2 9B: 57.6 (#269), Hunyuan Large Vision: 65.8 (#215)

BenchmarkGemma 2 9BHunyuan Large Vision
LMArena Instruction Following11781251
LiveBench Instruction Following52.6%—

Long Context Hunyuan Large Vision leads

Gemma 2 9B: 36.3 (#233), Hunyuan Large Vision: 38.9 (#189)

BenchmarkGemma 2 9BHunyuan Large Vision
LMArena Longer Query11971280

Writing & Preference Hunyuan Large Vision leads

Gemma 2 9B: 32.1 (#281), Hunyuan Large Vision: 46.5 (#218)

BenchmarkGemma 2 9BHunyuan Large Vision
LMArena Text12071263
LMArena Creative Writing12061248
LMArena Multi-Turn11931254
EQ-Bench Creative Writing841—
LiveBench Language25.5%—

Frequently asked questions

Is Gemma 2 9B better than Hunyuan Large Vision?

Hunyuan Large Vision is the stronger model overall, scoring 37.6 to 25.9 on the Noometry Index.

Is Gemma 2 9B or Hunyuan Large Vision better for coding?

Hunyuan Large Vision scores higher on coding benchmarks: 38.3 versus 29.4 in the Noometry coding category.

How many benchmarks do Gemma 2 9B and Hunyuan Large Vision share?

12 benchmarks have published results for both models. Gemma 2 9B has 35 scored results on Noometry and Hunyuan Large Vision has 13.

Related comparisons

Go deeper