Model comparison

Devstral Small 2505 vs Hunyuan Vision 1.5

Hunyuan Vision 1.5 is the stronger model overall, scoring 43.1 to 34.3 on the Noometry Index.

Last verified . 0 shared benchmarks.

Devstral Small 2505 Mistral AI

34.3

Rank #233 Reported

Hunyuan Vision 1.5 Tencent

43.1

Rank #98 Confirmed

Summary

  • The widest gap is in reasoning, where Hunyuan Vision 1.5 leads 28.9 to 19.7.
  • Devstral Small 2505 has downloadable open weights; the other is API-only.

Side by side

Devstral Small 2505 and Hunyuan Vision 1.5 specifications
Devstral Small 2505Hunyuan Vision 1.5
ProviderMistral AITencent
Noometry Index34.343.1
Released2025-05-07—
WeightsOpenProprietary
Context window128K—
Max output128K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.30—
Results tracked49

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan Vision 1.5 leads

Devstral Small 2505: 38.9 (#166), Hunyuan Vision 1.5: 41.8 (#119)

Coding benchmarks
BenchmarkDevstral Small 2505Hunyuan Vision 1.5
SWE-bench Verified (bash only)56.4%—
SciCode28.8%—
LMArena Coding—1418

Reasoning Hunyuan Vision 1.5 leads

Devstral Small 2505: 19.7 (#252), Hunyuan Vision 1.5: 28.9 (#97)

Reasoning benchmarks
BenchmarkDevstral Small 2505Hunyuan Vision 1.5
Kagi LLM Benchmark37.7%—
CritPt0%—
LMArena Hard Prompts—1416

Multimodal Not comparable

Devstral Small 2505: —, Hunyuan Vision 1.5: 35.7 (#84)

Multimodal benchmarks
BenchmarkDevstral Small 2505Hunyuan Vision 1.5
LMArena Vision—1180

Multilingual Not comparable

Devstral Small 2505: —, Hunyuan Vision 1.5: 50.3 (#125)

Multilingual benchmarks
BenchmarkDevstral Small 2505Hunyuan Vision 1.5
LMArena Non-English—1382

Instruction Following Not comparable

Devstral Small 2505: —, Hunyuan Vision 1.5: 73.7 (#117)

Instruction Following benchmarks
BenchmarkDevstral Small 2505Hunyuan Vision 1.5
LMArena Instruction Following—1397

Long Context Not comparable

Devstral Small 2505: —, Hunyuan Vision 1.5: 42.9 (#115)

Long Context benchmarks
BenchmarkDevstral Small 2505Hunyuan Vision 1.5
LMArena Longer Query—1404

Writing & Preference Not comparable

Devstral Small 2505: —, Hunyuan Vision 1.5: 60.1 (#100)

Writing & Preference benchmarks
BenchmarkDevstral Small 2505Hunyuan Vision 1.5
LMArena Text—1405
LMArena Creative Writing—1388
LMArena Multi-Turn—1422

Frequently asked questions

Is Devstral Small 2505 better than Hunyuan Vision 1.5?

Hunyuan Vision 1.5 is the stronger model overall, scoring 43.1 to 34.3 on the Noometry Index.

Is Devstral Small 2505 or Hunyuan Vision 1.5 better for coding?

Hunyuan Vision 1.5 scores higher on coding benchmarks: 41.8 versus 38.9 in the Noometry coding category.

How many benchmarks do Devstral Small 2505 and Hunyuan Vision 1.5 share?

0 benchmarks have published results for both models. Devstral Small 2505 has 4 scored results on Noometry and Hunyuan Vision 1.5 has 9.

Related comparisons

Go deeper