Model comparison

Codestral vs Hunyuan Large Vision

Hunyuan Large Vision is the stronger model overall, scoring 37.0 to 30.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Codestral Mistral AI

30.1

Rank #287 Reported

Hunyuan Large Vision Tencent

37.0

Rank #198 Confirmed

Summary

  • The widest gap is in coding, where Hunyuan Large Vision leads 37.6 to 26.9.
  • Codestral has downloadable open weights; the other is API-only.

Side by side

Codestral and Hunyuan Large Vision specifications
CodestralHunyuan Large Vision
ProviderMistral AITencent
Noometry Index30.137.0
Released2024-05-29—
WeightsOpenProprietary
Context window256K—
Max output4K—
Input $ / M tokens$0.30—
Output $ / M tokens$0.90—
Results tracked713

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan Large Vision leads

Codestral: 26.9 (#316), Hunyuan Large Vision: 37.6 (#176)

Coding benchmarks
BenchmarkCodestralHunyuan Large Vision
Aider Polyglot11.1%—
BigCodeBench Instruct41.8%—
LMArena Coding—1307
BigCodeBench Complete52.5%—
ALE-Bench137.78—
HumanEval+73.8%—
MBPP+61.9%—

Reasoning Hunyuan Large Vision leads

Codestral: 19.1 (#244), Hunyuan Large Vision: 23.8 (#160)

Reasoning benchmarks
BenchmarkCodestralHunyuan Large Vision
Kagi LLM Benchmark32.5%—
LMArena Hard Prompts—1257

Math Not comparable

Codestral: —, Hunyuan Large Vision: 32.8 (#184)

Math benchmarks
BenchmarkCodestralHunyuan Large Vision
LMArena Math—1269

Knowledge Not comparable

Codestral: —, Hunyuan Large Vision: 33.7 (#191)

Knowledge benchmarks
BenchmarkCodestralHunyuan Large Vision
LMArena Expert—1250

Multimodal Not comparable

Codestral: —, Hunyuan Large Vision: 35.1 (#79)

Multimodal benchmarks
BenchmarkCodestralHunyuan Large Vision
LMArena Vision—1180

Multilingual Not comparable

Codestral: —, Hunyuan Large Vision: 40.1 (#216)

Multilingual benchmarks
BenchmarkCodestralHunyuan Large Vision
LMArena Non-English—1236
LMArena Chinese—1289
LMArena Russian—1243

Instruction Following Not comparable

Codestral: —, Hunyuan Large Vision: 66.0 (#210)

Instruction Following benchmarks
BenchmarkCodestralHunyuan Large Vision
LMArena Instruction Following—1250

Long Context Not comparable

Codestral: —, Hunyuan Large Vision: 38.8 (#184)

Long Context benchmarks
BenchmarkCodestralHunyuan Large Vision
LMArena Longer Query—1279

Writing & Preference Not comparable

Codestral: —, Hunyuan Large Vision: 46.7 (#211)

Writing & Preference benchmarks
BenchmarkCodestralHunyuan Large Vision
LMArena Text—1263
LMArena Creative Writing—1250
LMArena Multi-Turn—1253

Frequently asked questions

Is Codestral better than Hunyuan Large Vision?

Hunyuan Large Vision is the stronger model overall, scoring 37.0 to 30.1 on the Noometry Index.

Is Codestral or Hunyuan Large Vision better for coding?

Hunyuan Large Vision scores higher on coding benchmarks: 37.6 versus 26.9 in the Noometry coding category.

How many benchmarks do Codestral and Hunyuan Large Vision share?

0 benchmarks have published results for both models. Codestral has 7 scored results on Noometry and Hunyuan Large Vision has 13.

Related comparisons

Go deeper