Model comparison

Codellama 70b Instruct vs Hunyuan Vision 1.5

Hunyuan Vision 1.5 is the stronger model overall, scoring 43.1 to 33.7 on the Noometry Index.

Last verified . 4 shared benchmarks.

Codellama 70b Instruct Meta

33.7

Rank #237 Confirmed

Hunyuan Vision 1.5 Tencent

43.1

Rank #98 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Codellama 70b Instruct scores higher in 0 categories and Hunyuan Vision 1.5 in 5 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Hunyuan Vision 1.5 leads 60.1 to 33.4.
  • Codellama 70b Instruct has downloadable open weights; the other is API-only.

Side by side

Codellama 70b Instruct and Hunyuan Vision 1.5 specifications
Codellama 70b InstructHunyuan Vision 1.5
ProviderMetaTencent
Noometry Index33.743.1
Released——
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked79

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan Vision 1.5 leads

Codellama 70b Instruct: 37.6 (#193), Hunyuan Vision 1.5: 41.8 (#119)

Coding benchmarks
BenchmarkCodellama 70b InstructHunyuan Vision 1.5
BigCodeBench Instruct40.7%—
LMArena Coding—1418
BigCodeBench Complete49.6%—
HumanEval+65.9%—

Reasoning Hunyuan Vision 1.5 leads

Codellama 70b Instruct: 20.1 (#242), Hunyuan Vision 1.5: 28.9 (#97)

Reasoning benchmarks
BenchmarkCodellama 70b InstructHunyuan Vision 1.5
LMArena Hard Prompts10521416

Multimodal Not comparable

Codellama 70b Instruct: —, Hunyuan Vision 1.5: 35.7 (#84)

Multimodal benchmarks
BenchmarkCodellama 70b InstructHunyuan Vision 1.5
LMArena Vision—1180

Multilingual Hunyuan Vision 1.5 leads

Codellama 70b Instruct: 24.8 (#288), Hunyuan Vision 1.5: 50.3 (#125)

Multilingual benchmarks
BenchmarkCodellama 70b InstructHunyuan Vision 1.5
LMArena Non-English9921382

Instruction Following Hunyuan Vision 1.5 leads

Codellama 70b Instruct: 51.9 (#293), Hunyuan Vision 1.5: 73.7 (#117)

Instruction Following benchmarks
BenchmarkCodellama 70b InstructHunyuan Vision 1.5
LMArena Instruction Following10241397

Long Context Not comparable

Codellama 70b Instruct: —, Hunyuan Vision 1.5: 42.9 (#115)

Long Context benchmarks
BenchmarkCodellama 70b InstructHunyuan Vision 1.5
LMArena Longer Query—1404

Writing & Preference Hunyuan Vision 1.5 leads

Codellama 70b Instruct: 33.4 (#277), Hunyuan Vision 1.5: 60.1 (#100)

Writing & Preference benchmarks
BenchmarkCodellama 70b InstructHunyuan Vision 1.5
LMArena Text10571405
LMArena Creative Writing—1388
LMArena Multi-Turn—1422

Frequently asked questions

Is Codellama 70b Instruct better than Hunyuan Vision 1.5?

Hunyuan Vision 1.5 is the stronger model overall, scoring 43.1 to 33.7 on the Noometry Index.

Is Codellama 70b Instruct or Hunyuan Vision 1.5 better for coding?

Hunyuan Vision 1.5 scores higher on coding benchmarks: 41.8 versus 37.6 in the Noometry coding category.

How many benchmarks do Codellama 70b Instruct and Hunyuan Vision 1.5 share?

4 benchmarks have published results for both models. Codellama 70b Instruct has 7 scored results on Noometry and Hunyuan Vision 1.5 has 9.

Related comparisons

Go deeper