Noometry

Model comparison

Hunyuan T1 20250711 vs Llama 3.1-8B

Hunyuan T1 20250711 is the stronger model overall, scoring 42.5 to 23.0 on the Noometry Index.

Last verified . 13 shared benchmarks.

Hunyuan T1 20250711 Tencent

42.5

Rank #114 Confirmed

Llama 3.1-8B Meta

23.0

Rank #352 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Hunyuan T1 20250711 scores higher in 8 categories and Llama 3.1-8B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Hunyuan T1 20250711 leads 38.8 to 8.0.
  • Llama 3.1-8B has downloadable open weights; the other is API-only.

Side by side

Hunyuan T1 20250711Llama 3.1-8B
ProviderTencentMeta
Noometry Index42.523.0
Released—2024-07-23
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.05
Output $ / M tokens—$0.08
Results tracked1343

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan T1 20250711 leads

Hunyuan T1 20250711: 40.9 (#129), Llama 3.1-8B: 20.2 (#340)

BenchmarkHunyuan T1 20250711Llama 3.1-8B
LMArena Coding13901195
SciCode—13.2%
WeirdML—1.7%
BigCodeBench Instruct—32.8%
BigCodeBench Complete—40.5%
HumanEval+—62.8%
MBPP+—55.6%

Agentic & Tool Use Not comparable

Hunyuan T1 20250711: —, Llama 3.1-8B: 22.5 (#131)

BenchmarkHunyuan T1 20250711Llama 3.1-8B
Berkeley Function Calling Leaderboard—25.8%
BALROG—15.1%

Reasoning Hunyuan T1 20250711 leads

Hunyuan T1 20250711: 28.5 (#103), Llama 3.1-8B: 14.9 (#321)

BenchmarkHunyuan T1 20250711Llama 3.1-8B
LMArena Hard Prompts13991175
CritPt—0%
Chess Puzzles—0%
DTBench—50.9%
LMCA—5.4%
Epoch Capabilities Index—116.57
PIQA—81.2%

Math Hunyuan T1 20250711 leads

Hunyuan T1 20250711: 38.7 (#130), Llama 3.1-8B: 10.2 (#317)

BenchmarkHunyuan T1 20250711Llama 3.1-8B
LMArena Math14141179
OTIS Mock AIME 2024-2025—1.7%
Omni-MATH—13.7%
MATH Level 5—22.9%
GSM8K—82.4%

Knowledge Hunyuan T1 20250711 leads

Hunyuan T1 20250711: 38.8 (#141), Llama 3.1-8B: 8.0 (#307)

BenchmarkHunyuan T1 20250711Llama 3.1-8B
LMArena Expert13951144
GPQA Diamond—27%
MMLU-Pro—40.6%
GPQA (HELM)—24.7%
BoolQ—82.8%
MMLU—56.1%

Multilingual Hunyuan T1 20250711 leads

Hunyuan T1 20250711: 51.2 (#112), Llama 3.1-8B: 34.0 (#249)

BenchmarkHunyuan T1 20250711Llama 3.1-8B
LMArena Non-English13951148
LMArena Chinese14251151
LMArena Korean14061053
LMArena Russian13851158
LMArena French—1177
LMArena German—1144
LMArena Japanese—1061
LMArena Spanish—1169

Instruction Following Hunyuan T1 20250711 leads

Hunyuan T1 20250711: 72.6 (#138), Llama 3.1-8B: 58.9 (#258)

BenchmarkHunyuan T1 20250711Llama 3.1-8B
LMArena Instruction Following13741159
IFEval—74.3%

Long Context Hunyuan T1 20250711 leads

Hunyuan T1 20250711: 42.2 (#128), Llama 3.1-8B: 35.8 (#238)

BenchmarkHunyuan T1 20250711Llama 3.1-8B
LMArena Longer Query13841182

Writing & Preference Hunyuan T1 20250711 leads

Hunyuan T1 20250711: 59.5 (#109), Llama 3.1-8B: 29.7 (#290)

BenchmarkHunyuan T1 20250711Llama 3.1-8B
LMArena Text14011187
LMArena Creative Writing13921154
LMArena Multi-Turn13931172
EQ-Bench Creative Writing—713
WildBench—68.7%

Frequently asked questions

Is Hunyuan T1 20250711 better than Llama 3.1-8B?

Hunyuan T1 20250711 is the stronger model overall, scoring 42.5 to 23.0 on the Noometry Index.

Is Hunyuan T1 20250711 or Llama 3.1-8B better for coding?

Hunyuan T1 20250711 scores higher on coding benchmarks: 40.9 versus 20.2 in the Noometry coding category.

How many benchmarks do Hunyuan T1 20250711 and Llama 3.1-8B share?

13 benchmarks have published results for both models. Hunyuan T1 20250711 has 13 scored results on Noometry and Llama 3.1-8B has 43.

Related comparisons

Go deeper