Model comparison

Hunyuan T1 20250711 vs Mixtral 8x22B

Hunyuan T1 20250711 is the stronger model overall, scoring 42.5 to 27.1 on the Noometry Index.

Last verified . 13 shared benchmarks.

Hunyuan T1 20250711 Tencent

42.5

Rank #114 Confirmed

Mixtral 8x22B Mistral AI

27.1

Rank #333 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Hunyuan T1 20250711 scores higher in 8 categories and Mixtral 8x22B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Hunyuan T1 20250711 leads 38.8 to 15.1.
  • Mixtral 8x22B has downloadable open weights; the other is API-only.

Side by side

Hunyuan T1 20250711 and Mixtral 8x22B specifications
Hunyuan T1 20250711Mixtral 8x22B
ProviderTencentMistral AI
Noometry Index42.527.1
Released—2024-04-17
WeightsProprietaryOpen
Context window—64K
Max output—64K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked1334

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan T1 20250711 leads

Hunyuan T1 20250711: 40.9 (#129), Mixtral 8x22B: 24.2 (#329)

Coding benchmarks
BenchmarkHunyuan T1 20250711Mixtral 8x22B
LMArena Coding13901166
WeirdML—3.2%
BigCodeBench Instruct—40.6%
BigCodeBench Complete—50.2%
HumanEval+—72%
MBPP+—64.3%

Agentic & Tool Use Not comparable

Hunyuan T1 20250711: —, Mixtral 8x22B: 23.1 (#127)

Agentic & Tool Use benchmarks
BenchmarkHunyuan T1 20250711Mixtral 8x22B
Cybench—7.5%

Reasoning Hunyuan T1 20250711 leads

Hunyuan T1 20250711: 28.5 (#103), Mixtral 8x22B: 19.9 (#248)

Reasoning benchmarks
BenchmarkHunyuan T1 20250711Mixtral 8x22B
LMArena Hard Prompts13991150
DTBench—55.1%
Epoch Capabilities Index—122.03
ForecastBench—56.3

Math Hunyuan T1 20250711 leads

Hunyuan T1 20250711: 38.7 (#130), Mixtral 8x22B: 22.9 (#275)

Math benchmarks
BenchmarkHunyuan T1 20250711Mixtral 8x22B
LMArena Math14141184
Omni-MATH—16.3%
MATH Level 5—24.2%

Knowledge Hunyuan T1 20250711 leads

Hunyuan T1 20250711: 38.8 (#141), Mixtral 8x22B: 15.1 (#293)

Knowledge benchmarks
BenchmarkHunyuan T1 20250711Mixtral 8x22B
LMArena Expert13951113
GPQA Diamond—34.1%
MMLU-Pro—46%
GPQA (HELM)—33.4%
MMLU—77.8%

Multilingual Hunyuan T1 20250711 leads

Hunyuan T1 20250711: 51.2 (#112), Mixtral 8x22B: 32.8 (#255)

Multilingual benchmarks
BenchmarkHunyuan T1 20250711Mixtral 8x22B
LMArena Non-English13951128
LMArena Chinese14251116
LMArena Korean14061057
LMArena Russian13851158
LMArena French—1166
LMArena German—1141
LMArena Japanese—1037
LMArena Spanish—1151

Instruction Following Hunyuan T1 20250711 leads

Hunyuan T1 20250711: 72.6 (#138), Mixtral 8x22B: 57.7 (#266)

Instruction Following benchmarks
BenchmarkHunyuan T1 20250711Mixtral 8x22B
LMArena Instruction Following13741147
IFEval—72.4%

Long Context Hunyuan T1 20250711 leads

Hunyuan T1 20250711: 42.2 (#128), Mixtral 8x22B: 34.7 (#247)

Long Context benchmarks
BenchmarkHunyuan T1 20250711Mixtral 8x22B
LMArena Longer Query13841144

Writing & Preference Hunyuan T1 20250711 leads

Hunyuan T1 20250711: 59.5 (#109), Mixtral 8x22B: 36.9 (#262)

Writing & Preference benchmarks
BenchmarkHunyuan T1 20250711Mixtral 8x22B
LMArena Text14011162
LMArena Creative Writing13921141
LMArena Multi-Turn13931130
WildBench—71.1%

Frequently asked questions

Is Hunyuan T1 20250711 better than Mixtral 8x22B?

Hunyuan T1 20250711 is the stronger model overall, scoring 42.5 to 27.1 on the Noometry Index.

Is Hunyuan T1 20250711 or Mixtral 8x22B better for coding?

Hunyuan T1 20250711 scores higher on coding benchmarks: 40.9 versus 24.2 in the Noometry coding category.

How many benchmarks do Hunyuan T1 20250711 and Mixtral 8x22B share?

13 benchmarks have published results for both models. Hunyuan T1 20250711 has 13 scored results on Noometry and Mixtral 8x22B has 34.

Related comparisons

Go deeper