Noometry

Model comparison

Hunyuan Vision 1.5 vs Mixtral 8x22B

Hunyuan Vision 1.5 is the stronger model overall, scoring 43.1 to 27.1 on the Noometry Index.

Last verified . 8 shared benchmarks.

Hunyuan Vision 1.5 Tencent

43.1

Rank #98 Confirmed

Mixtral 8x22B Mistral AI

27.1

Rank #333 Confirmed

Summary

  • They share 8 benchmarks with published results for both. Hunyuan Vision 1.5 scores higher in 6 categories and Mixtral 8x22B in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Hunyuan Vision 1.5 leads 60.1 to 36.9.
  • Mixtral 8x22B has downloadable open weights; the other is API-only.

Side by side

Hunyuan Vision 1.5Mixtral 8x22B
ProviderTencentMistral AI
Noometry Index43.127.1
Released—2024-04-17
WeightsProprietaryOpen
Context window—64K
Max output—64K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked934

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 41.8 (#119), Mixtral 8x22B: 24.2 (#329)

BenchmarkHunyuan Vision 1.5Mixtral 8x22B
LMArena Coding14181166
WeirdML—3.2%
BigCodeBench Instruct—40.6%
BigCodeBench Complete—50.2%
HumanEval+—72%
MBPP+—64.3%

Agentic & Tool Use Not comparable

Hunyuan Vision 1.5: —, Mixtral 8x22B: 23.1 (#127)

BenchmarkHunyuan Vision 1.5Mixtral 8x22B
Cybench—7.5%

Reasoning Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 28.9 (#97), Mixtral 8x22B: 19.9 (#248)

BenchmarkHunyuan Vision 1.5Mixtral 8x22B
LMArena Hard Prompts14161150
DTBench—55.1%
Epoch Capabilities Index—122.03
ForecastBench—56.3

Math Not comparable

Hunyuan Vision 1.5: —, Mixtral 8x22B: 22.9 (#275)

BenchmarkHunyuan Vision 1.5Mixtral 8x22B
Omni-MATH—16.3%
LMArena Math—1184
MATH Level 5—24.2%

Knowledge Not comparable

Hunyuan Vision 1.5: —, Mixtral 8x22B: 15.1 (#293)

BenchmarkHunyuan Vision 1.5Mixtral 8x22B
GPQA Diamond—34.1%
MMLU-Pro—46%
GPQA (HELM)—33.4%
LMArena Expert—1113
MMLU—77.8%

Multimodal Not comparable

Hunyuan Vision 1.5: 35.7 (#84), Mixtral 8x22B: —

BenchmarkHunyuan Vision 1.5Mixtral 8x22B
LMArena Vision1180—

Multilingual Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 50.3 (#125), Mixtral 8x22B: 32.8 (#255)

BenchmarkHunyuan Vision 1.5Mixtral 8x22B
LMArena Non-English13821128
LMArena Chinese—1116
LMArena French—1166
LMArena German—1141
LMArena Japanese—1037
LMArena Korean—1057
LMArena Russian—1158
LMArena Spanish—1151

Instruction Following Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 73.7 (#117), Mixtral 8x22B: 57.7 (#266)

BenchmarkHunyuan Vision 1.5Mixtral 8x22B
LMArena Instruction Following13971147
IFEval—72.4%

Long Context Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 42.9 (#115), Mixtral 8x22B: 34.7 (#247)

BenchmarkHunyuan Vision 1.5Mixtral 8x22B
LMArena Longer Query14041144

Writing & Preference Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 60.1 (#100), Mixtral 8x22B: 36.9 (#262)

BenchmarkHunyuan Vision 1.5Mixtral 8x22B
LMArena Text14051162
LMArena Creative Writing13881141
LMArena Multi-Turn14221130
WildBench—71.1%

Frequently asked questions

Is Hunyuan Vision 1.5 better than Mixtral 8x22B?

Hunyuan Vision 1.5 is the stronger model overall, scoring 43.1 to 27.1 on the Noometry Index.

Is Hunyuan Vision 1.5 or Mixtral 8x22B better for coding?

Hunyuan Vision 1.5 scores higher on coding benchmarks: 41.8 versus 24.2 in the Noometry coding category.

How many benchmarks do Hunyuan Vision 1.5 and Mixtral 8x22B share?

8 benchmarks have published results for both models. Hunyuan Vision 1.5 has 9 scored results on Noometry and Mixtral 8x22B has 34.

Related comparisons

Go deeper