Model comparison

Codellama 34b Instruct vs Hunyuan Vision 1.5

Hunyuan Vision 1.5 is the stronger model overall, scoring 43.1 to 30.8 on the Noometry Index.

Last verified . 8 shared benchmarks.

Codellama 34b Instruct Meta

30.8

Rank #287 Confirmed

Hunyuan Vision 1.5 Tencent

43.1

Rank #98 Confirmed

Summary

  • They share 8 benchmarks with published results for both. Codellama 34b Instruct scores higher in 0 categories and Hunyuan Vision 1.5 in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Hunyuan Vision 1.5 leads 60.1 to 28.2.
  • Codellama 34b Instruct has downloadable open weights; the other is API-only.

Side by side

Codellama 34b Instruct and Hunyuan Vision 1.5 specifications
Codellama 34b InstructHunyuan Vision 1.5
ProviderMetaTencent
Noometry Index30.843.1
Released——
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked149

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan Vision 1.5 leads

Codellama 34b Instruct: 28.5 (#314), Hunyuan Vision 1.5: 41.8 (#119)

Coding benchmarks
BenchmarkCodellama 34b InstructHunyuan Vision 1.5
LMArena Coding10461418
BigCodeBench Instruct29%—
BigCodeBench Complete37.1%—
HumanEval+43.9%—
MBPP+56.3%—

Reasoning Hunyuan Vision 1.5 leads

Codellama 34b Instruct: 19.6 (#255), Hunyuan Vision 1.5: 28.9 (#97)

Reasoning benchmarks
BenchmarkCodellama 34b InstructHunyuan Vision 1.5
LMArena Hard Prompts10321416

Math Not comparable

Codellama 34b Instruct: 31.0 (#230), Hunyuan Vision 1.5: —

Math benchmarks
BenchmarkCodellama 34b InstructHunyuan Vision 1.5
LMArena Math1056—

Multimodal Not comparable

Codellama 34b Instruct: —, Hunyuan Vision 1.5: 35.7 (#84)

Multimodal benchmarks
BenchmarkCodellama 34b InstructHunyuan Vision 1.5
LMArena Vision—1180

Multilingual Hunyuan Vision 1.5 leads

Codellama 34b Instruct: 25.8 (#284), Hunyuan Vision 1.5: 50.3 (#125)

Multilingual benchmarks
BenchmarkCodellama 34b InstructHunyuan Vision 1.5
LMArena Non-English10111382
LMArena Chinese976—

Instruction Following Hunyuan Vision 1.5 leads

Codellama 34b Instruct: 52.2 (#291), Hunyuan Vision 1.5: 73.7 (#117)

Instruction Following benchmarks
BenchmarkCodellama 34b InstructHunyuan Vision 1.5
LMArena Instruction Following10281397

Long Context Hunyuan Vision 1.5 leads

Codellama 34b Instruct: 30.9 (#284), Hunyuan Vision 1.5: 42.9 (#115)

Long Context benchmarks
BenchmarkCodellama 34b InstructHunyuan Vision 1.5
LMArena Longer Query10131404

Writing & Preference Hunyuan Vision 1.5 leads

Codellama 34b Instruct: 28.2 (#297), Hunyuan Vision 1.5: 60.1 (#100)

Writing & Preference benchmarks
BenchmarkCodellama 34b InstructHunyuan Vision 1.5
LMArena Text10661405
LMArena Creative Writing10321388
LMArena Multi-Turn10151422

Frequently asked questions

Is Codellama 34b Instruct better than Hunyuan Vision 1.5?

Hunyuan Vision 1.5 is the stronger model overall, scoring 43.1 to 30.8 on the Noometry Index.

Is Codellama 34b Instruct or Hunyuan Vision 1.5 better for coding?

Hunyuan Vision 1.5 scores higher on coding benchmarks: 41.8 versus 28.5 in the Noometry coding category.

How many benchmarks do Codellama 34b Instruct and Hunyuan Vision 1.5 share?

8 benchmarks have published results for both models. Codellama 34b Instruct has 14 scored results on Noometry and Hunyuan Vision 1.5 has 9.

Related comparisons

Go deeper