Noometry

Model comparison

Gemma 2 27B vs Hunyuan Large Vision

Hunyuan Large Vision is the stronger model overall, scoring 37.0 to 29.2 on the Noometry Index.

Last verified . 12 shared benchmarks.

Gemma 2 27B Google

29.2

Rank #302 Confirmed

Hunyuan Large Vision Tencent

37.0

Rank #198 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Gemma 2 27B scores higher in 0 categories and Hunyuan Large Vision in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Hunyuan Large Vision leads 32.8 to 10.0.
  • Gemma 2 27B has downloadable open weights; the other is API-only.

Side by side

Gemma 2 27BHunyuan Large Vision
ProviderGoogleTencent
Noometry Index29.237.0
Released2024-06-24—
WeightsOpenProprietary
Context window8K—
Max output2K—
Input $ / M tokens$0.65—
Output $ / M tokens$0.65—
Results tracked3413

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan Large Vision leads

Gemma 2 27B: 33.5 (#243), Hunyuan Large Vision: 37.6 (#176)

BenchmarkGemma 2 27BHunyuan Large Vision
LMArena Coding12111307
BigCodeBench Instruct42.8%—
LiveBench Coding36%—
BigCodeBench Complete52.5%—

Reasoning Hunyuan Large Vision leads

Gemma 2 27B: 14.8 (#313), Hunyuan Large Vision: 23.8 (#160)

BenchmarkGemma 2 27BHunyuan Large Vision
LMArena Hard Prompts11991257
LiveBench Reasoning28.1%—
DTBench48%—
LiveBench Data Analysis47.9%—
LMCA7.1%—
Epoch Capabilities Index122.06—
LiveBench38.2%—

Math Hunyuan Large Vision leads

Gemma 2 27B: 10.0 (#306), Hunyuan Large Vision: 32.8 (#184)

BenchmarkGemma 2 27BHunyuan Large Vision
LMArena Math12121269
OTIS Mock AIME 2024-20251.4%—
LiveBench Math26.5%—
MATH Level 527.9%—

Knowledge Hunyuan Large Vision leads

Gemma 2 27B: 18.9 (#275), Hunyuan Large Vision: 33.7 (#191)

BenchmarkGemma 2 27BHunyuan Large Vision
LMArena Expert11721250
GPQA Diamond36.5%—
Confabulations27.1%—
MMLU75.7%—

Multimodal Not comparable

Gemma 2 27B: —, Hunyuan Large Vision: 35.1 (#79)

BenchmarkGemma 2 27BHunyuan Large Vision
LMArena Vision—1180

Multilingual Hunyuan Large Vision leads

Gemma 2 27B: 38.8 (#221), Hunyuan Large Vision: 40.1 (#216)

BenchmarkGemma 2 27BHunyuan Large Vision
LMArena Non-English12171236
LMArena Chinese12211289
LMArena Russian12341243
LMArena French1246—
LMArena German1209—
LMArena Japanese1175—
LMArena Korean1174—
LMArena Spanish1228—

Instruction Following Hunyuan Large Vision leads

Gemma 2 27B: 60.7 (#244), Hunyuan Large Vision: 66.0 (#210)

BenchmarkGemma 2 27BHunyuan Large Vision
LMArena Instruction Following12061250
LiveBench Instruction Following58.1%—

Long Context Hunyuan Large Vision leads

Gemma 2 27B: 37.3 (#213), Hunyuan Large Vision: 38.8 (#184)

BenchmarkGemma 2 27BHunyuan Large Vision
LMArena Longer Query12311279

Writing & Preference Hunyuan Large Vision leads

Gemma 2 27B: 44.4 (#220), Hunyuan Large Vision: 46.7 (#211)

BenchmarkGemma 2 27BHunyuan Large Vision
LMArena Text12311263
LMArena Creative Writing12411250
LMArena Multi-Turn12241253
LiveBench Language32.6%—

Frequently asked questions

Is Gemma 2 27B better than Hunyuan Large Vision?

Hunyuan Large Vision is the stronger model overall, scoring 37.0 to 29.2 on the Noometry Index.

Is Gemma 2 27B or Hunyuan Large Vision better for coding?

Hunyuan Large Vision scores higher on coding benchmarks: 37.6 versus 33.5 in the Noometry coding category.

How many benchmarks do Gemma 2 27B and Hunyuan Large Vision share?

12 benchmarks have published results for both models. Gemma 2 27B has 34 scored results on Noometry and Hunyuan Large Vision has 13.

Related comparisons

Go deeper