Noometry

Model comparison

Hunyuan Large Vision vs Llama 3.1-8B

Hunyuan Large Vision is the stronger model overall, scoring 37.6 to 23.0 on the Noometry Index.

Last verified . 12 shared benchmarks.

Hunyuan Large Vision Tencent

37.6

Rank #202 Confirmed

Llama 3.1-8B Meta

23.0

Rank #352 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Hunyuan Large Vision scores higher in 8 categories and Llama 3.1-8B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Hunyuan Large Vision leads 34.4 to 8.0.
  • Llama 3.1-8B has downloadable open weights; the other is API-only.

Side by side

Hunyuan Large VisionLlama 3.1-8B
ProviderTencentMeta
Noometry Index37.623.0
Released—2024-07-23
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.05
Output $ / M tokens—$0.08
Results tracked1343

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan Large Vision leads

Hunyuan Large Vision: 38.3 (#180), Llama 3.1-8B: 20.2 (#340)

BenchmarkHunyuan Large VisionLlama 3.1-8B
LMArena Coding13081195
SciCode—13.2%
WeirdML—1.7%
BigCodeBench Instruct—32.8%
BigCodeBench Complete—40.5%
HumanEval+—62.8%
MBPP+—55.6%

Agentic & Tool Use Not comparable

Hunyuan Large Vision: —, Llama 3.1-8B: 22.5 (#131)

BenchmarkHunyuan Large VisionLlama 3.1-8B
Berkeley Function Calling Leaderboard—25.8%
BALROG—15.1%

Reasoning Hunyuan Large Vision leads

Hunyuan Large Vision: 24.8 (#158), Llama 3.1-8B: 14.9 (#321)

BenchmarkHunyuan Large VisionLlama 3.1-8B
LMArena Hard Prompts12571175
CritPt—0%
Chess Puzzles—0%
DTBench—50.9%
LMCA—5.4%
Epoch Capabilities Index—116.57
PIQA—81.2%

Math Hunyuan Large Vision leads

Hunyuan Large Vision: 35.5 (#183), Llama 3.1-8B: 10.2 (#317)

BenchmarkHunyuan Large VisionLlama 3.1-8B
LMArena Math12681179
OTIS Mock AIME 2024-2025—1.7%
Omni-MATH—13.7%
MATH Level 5—22.9%
GSM8K—82.4%

Knowledge Hunyuan Large Vision leads

Hunyuan Large Vision: 34.4 (#196), Llama 3.1-8B: 8.0 (#307)

BenchmarkHunyuan Large VisionLlama 3.1-8B
LMArena Expert12521144
GPQA Diamond—27%
MMLU-Pro—40.6%
GPQA (HELM)—24.7%
BoolQ—82.8%
MMLU—56.1%

Multimodal Not comparable

Hunyuan Large Vision: 35.7 (#83), Llama 3.1-8B: —

BenchmarkHunyuan Large VisionLlama 3.1-8B
LMArena Vision1180—

Multilingual Hunyuan Large Vision leads

Hunyuan Large Vision: 39.9 (#221), Llama 3.1-8B: 34.0 (#249)

BenchmarkHunyuan Large VisionLlama 3.1-8B
LMArena Non-English12361148
LMArena Chinese12871151
LMArena Russian12431158
LMArena French—1177
LMArena German—1144
LMArena Japanese—1061
LMArena Korean—1053
LMArena Spanish—1169

Instruction Following Hunyuan Large Vision leads

Hunyuan Large Vision: 65.8 (#215), Llama 3.1-8B: 58.9 (#258)

BenchmarkHunyuan Large VisionLlama 3.1-8B
LMArena Instruction Following12511159
IFEval—74.3%

Long Context Hunyuan Large Vision leads

Hunyuan Large Vision: 38.9 (#189), Llama 3.1-8B: 35.8 (#238)

BenchmarkHunyuan Large VisionLlama 3.1-8B
LMArena Longer Query12801182

Writing & Preference Hunyuan Large Vision leads

Hunyuan Large Vision: 46.5 (#218), Llama 3.1-8B: 29.7 (#290)

BenchmarkHunyuan Large VisionLlama 3.1-8B
LMArena Text12631187
LMArena Creative Writing12481154
LMArena Multi-Turn12541172
EQ-Bench Creative Writing—713
WildBench—68.7%

Frequently asked questions

Is Hunyuan Large Vision better than Llama 3.1-8B?

Hunyuan Large Vision is the stronger model overall, scoring 37.6 to 23.0 on the Noometry Index.

Is Hunyuan Large Vision or Llama 3.1-8B better for coding?

Hunyuan Large Vision scores higher on coding benchmarks: 38.3 versus 20.2 in the Noometry coding category.

How many benchmarks do Hunyuan Large Vision and Llama 3.1-8B share?

12 benchmarks have published results for both models. Hunyuan Large Vision has 13 scored results on Noometry and Llama 3.1-8B has 43.

Related comparisons

Go deeper