Noometry

Model comparison

Hunyuan Vision 1.5 vs Mistral Small

Hunyuan Vision 1.5 is the stronger model overall, scoring 43.1 to 33.4 on the Noometry Index.

Last verified . 9 shared benchmarks.

Hunyuan Vision 1.5 Tencent

43.1

Rank #98 Confirmed

Mistral Small Mistral AI

33.4

Rank #243 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Hunyuan Vision 1.5 scores higher in 7 categories and Mistral Small in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Hunyuan Vision 1.5 leads 28.9 to 19.8.
  • Mistral Small has downloadable open weights; the other is API-only.

Side by side

Hunyuan Vision 1.5Mistral Small
ProviderTencentMistral AI
Noometry Index43.133.4
Released—2024-02-26
WeightsProprietaryOpen
Context window—262K
Max output—256K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.60
Results tracked939

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 41.8 (#119), Mistral Small: 34.0 (#247)

BenchmarkHunyuan Vision 1.5Mistral Small
LMArena Coding14181362
SciCode—26.5%
BigCodeBench Instruct—36.1%
LiveBench Coding—36.2%
BigCodeBench Complete—46.6%
ALE-Bench—497.62

Agentic & Tool Use Not comparable

Hunyuan Vision 1.5: —, Mistral Small: 28.1 (#93)

BenchmarkHunyuan Vision 1.5Mistral Small
Berkeley Function Calling Leaderboard—37.1%

Reasoning Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 28.9 (#97), Mistral Small: 19.8 (#250)

BenchmarkHunyuan Vision 1.5Mistral Small
LMArena Hard Prompts14161335
Kagi LLM Benchmark—37.8%
CritPt—0%
LiveBench Reasoning—44.8%
DTBench—70.9%
LiveBench Data Analysis—53.7%
LMCA—20.6%
LiveBench—44%

Math Not comparable

Hunyuan Vision 1.5: —, Mistral Small: 16.4 (#293)

BenchmarkHunyuan Vision 1.5Mistral Small
OTIS Mock AIME 2024-2025—5.8%
LiveBench Math—39.9%
LMArena Math—1341
MATH Level 5—46.8%

Knowledge Not comparable

Hunyuan Vision 1.5: —, Mistral Small: 31.0 (#222)

BenchmarkHunyuan Vision 1.5Mistral Small
GPQA Diamond—47.5%
Vectara Hallucination Rate—5.1%
LMArena Expert—1291
MMLU—68.7%

Multimodal Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 35.7 (#84), Mistral Small: 33.5 (#96)

BenchmarkHunyuan Vision 1.5Mistral Small
LMArena Vision11801142

Multilingual Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 50.3 (#125), Mistral Small: 45.5 (#169)

BenchmarkHunyuan Vision 1.5Mistral Small
LMArena Non-English13821315
LMArena Chinese—1340
LMArena French—1337
LMArena German—1340
LMArena Japanese—1275
LMArena Korean—1259
LMArena Russian—1324
LMArena Spanish—1346

Instruction Following Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 73.7 (#117), Mistral Small: 66.4 (#209)

BenchmarkHunyuan Vision 1.5Mistral Small
LMArena Instruction Following13971310
LiveBench Instruction Following—63.7%

Long Context Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 42.9 (#115), Mistral Small: 40.4 (#156)

BenchmarkHunyuan Vision 1.5Mistral Small
LMArena Longer Query14041327

Writing & Preference Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 60.1 (#100), Mistral Small: 52.5 (#171)

BenchmarkHunyuan Vision 1.5Mistral Small
LMArena Text14051338
LMArena Creative Writing13881305
LMArena Multi-Turn14221344
LiveBench Language—30.5%

Frequently asked questions

Is Hunyuan Vision 1.5 better than Mistral Small?

Hunyuan Vision 1.5 is the stronger model overall, scoring 43.1 to 33.4 on the Noometry Index.

Is Hunyuan Vision 1.5 or Mistral Small better for coding?

Hunyuan Vision 1.5 scores higher on coding benchmarks: 41.8 versus 34.0 in the Noometry coding category.

How many benchmarks do Hunyuan Vision 1.5 and Mistral Small share?

9 benchmarks have published results for both models. Hunyuan Vision 1.5 has 9 scored results on Noometry and Mistral Small has 39.

Related comparisons

Go deeper