Model comparison

Hunyuan Vision 1.5 vs Mistral Nemo

Hunyuan Vision 1.5 is the stronger model overall, scoring 42.6 to 25.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Hunyuan Vision 1.5 Tencent

42.6

Rank #95 Confirmed

Mistral Nemo Mistral AI

25.9

Rank #332 Confirmed

Summary

  • The widest gap is in writing & preference, where Hunyuan Vision 1.5 leads 60.4 to 28.6.
  • Mistral Nemo has downloadable open weights; the other is API-only.

Side by side

Hunyuan Vision 1.5 and Mistral Nemo specifications
Hunyuan Vision 1.5Mistral Nemo
ProviderTencentMistral AI
Noometry Index42.625.9
Released—2024-07-01
WeightsProprietaryOpen
Context window—128K
Max output—128K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.15
Results tracked910

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Hunyuan Vision 1.5: 41.2 (#119), Mistral Nemo: —

Coding benchmarks
BenchmarkHunyuan Vision 1.5Mistral Nemo
LMArena Coding1419—

Agentic & Tool Use Not comparable

Hunyuan Vision 1.5: —, Mistral Nemo: 23.3 (#118)

Agentic & Tool Use benchmarks
BenchmarkHunyuan Vision 1.5Mistral Nemo
Berkeley Function Calling Leaderboard—27.6%
BALROG—17.6%

Reasoning Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 27.8 (#96), Mistral Nemo: 19.9 (#230)

Reasoning benchmarks
BenchmarkHunyuan Vision 1.5Mistral Nemo
LMArena Hard Prompts1417—
DTBench—48.6%
Epoch Capabilities Index—118.63
PIQA—83.5%

Math Not comparable

Hunyuan Vision 1.5: —, Mistral Nemo: 23.5 (#263)

Math benchmarks
BenchmarkHunyuan Vision 1.5Mistral Nemo
MATH Level 5—10.8%
GSM8K—84.2%

Knowledge Not comparable

Hunyuan Vision 1.5: —, Mistral Nemo: 12.3 (#293)

Knowledge benchmarks
BenchmarkHunyuan Vision 1.5Mistral Nemo
GPQA Diamond—29.9%
BoolQ—82.5%

Multimodal Not comparable

Hunyuan Vision 1.5: 35.1 (#78), Mistral Nemo: —

Multimodal benchmarks
BenchmarkHunyuan Vision 1.5Mistral Nemo
LMArena Vision1180—

Multilingual Not comparable

Hunyuan Vision 1.5: 50.5 (#118), Mistral Nemo: —

Multilingual benchmarks
BenchmarkHunyuan Vision 1.5Mistral Nemo
LMArena Non-English1383—

Instruction Following Not comparable

Hunyuan Vision 1.5: 73.9 (#110), Mistral Nemo: —

Instruction Following benchmarks
BenchmarkHunyuan Vision 1.5Mistral Nemo
LMArena Instruction Following1398—

Long Context Not comparable

Hunyuan Vision 1.5: 42.9 (#110), Mistral Nemo: —

Long Context benchmarks
BenchmarkHunyuan Vision 1.5Mistral Nemo
LMArena Longer Query1405—

Writing & Preference Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 60.4 (#95), Mistral Nemo: 28.6 (#291)

Writing & Preference benchmarks
BenchmarkHunyuan Vision 1.5Mistral Nemo
LMArena Text1407—
LMArena Creative Writing1389—
EQ-Bench Creative Writing—881
LMArena Multi-Turn1423—

Frequently asked questions

Is Hunyuan Vision 1.5 better than Mistral Nemo?

Hunyuan Vision 1.5 is the stronger model overall, scoring 42.6 to 25.9 on the Noometry Index.

How many benchmarks do Hunyuan Vision 1.5 and Mistral Nemo share?

0 benchmarks have published results for both models. Hunyuan Vision 1.5 has 9 scored results on Noometry and Mistral Nemo has 10.

Related comparisons

Go deeper