Model comparison

Codellama 34b Instruct vs Kimi K2.5 Instant

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 30.8 on the Noometry Index.

Last verified . 10 shared benchmarks.

Codellama 34b Instruct Meta

30.8

Rank #287 Confirmed

Kimi K2.5 Instant Moonshot AI

43.6

Rank #89 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Codellama 34b Instruct scores higher in 0 categories and Kimi K2.5 Instant in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Kimi K2.5 Instant leads 60.6 to 28.2.

Side by side

Codellama 34b Instruct and Kimi K2.5 Instant specifications
Codellama 34b InstructKimi K2.5 Instant
ProviderMetaMoonshot AI
Noometry Index30.843.6
Released——
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1418

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 Instant leads

Codellama 34b Instruct: 28.5 (#314), Kimi K2.5 Instant: 42.6 (#97)

Coding benchmarks
BenchmarkCodellama 34b InstructKimi K2.5 Instant
LMArena Coding10461484
LMArena WebDev—1404
BigCodeBench Instruct29%—
BigCodeBench Complete37.1%—
HumanEval+43.9%—
MBPP+56.3%—

Reasoning Kimi K2.5 Instant leads

Codellama 34b Instruct: 19.6 (#255), Kimi K2.5 Instant: 29.7 (#90)

Reasoning benchmarks
BenchmarkCodellama 34b InstructKimi K2.5 Instant
LMArena Hard Prompts10321443

Math Kimi K2.5 Instant leads

Codellama 34b Instruct: 31.0 (#230), Kimi K2.5 Instant: 39.4 (#105)

Math benchmarks
BenchmarkCodellama 34b InstructKimi K2.5 Instant
LMArena Math10561442

Knowledge Not comparable

Codellama 34b Instruct: —, Kimi K2.5 Instant: 40.2 (#123)

Knowledge benchmarks
BenchmarkCodellama 34b InstructKimi K2.5 Instant
LMArena Expert—1440

Multimodal Not comparable

Codellama 34b Instruct: —, Kimi K2.5 Instant: 40.2 (#50)

Multimodal benchmarks
BenchmarkCodellama 34b InstructKimi K2.5 Instant
LMArena Vision—1254

Multilingual Kimi K2.5 Instant leads

Codellama 34b Instruct: 25.8 (#284), Kimi K2.5 Instant: 52.0 (#94)

Multilingual benchmarks
BenchmarkCodellama 34b InstructKimi K2.5 Instant
LMArena Non-English10111406
LMArena Chinese9761449
LMArena French—1403
LMArena German—1413
LMArena Korean—1378
LMArena Russian—1404
LMArena Spanish—1447

Instruction Following Kimi K2.5 Instant leads

Codellama 34b Instruct: 52.2 (#291), Kimi K2.5 Instant: 75.3 (#65)

Instruction Following benchmarks
BenchmarkCodellama 34b InstructKimi K2.5 Instant
LMArena Instruction Following10281430

Long Context Kimi K2.5 Instant leads

Codellama 34b Instruct: 30.9 (#284), Kimi K2.5 Instant: 43.9 (#83)

Long Context benchmarks
BenchmarkCodellama 34b InstructKimi K2.5 Instant
LMArena Longer Query10131435

Writing & Preference Kimi K2.5 Instant leads

Codellama 34b Instruct: 28.2 (#297), Kimi K2.5 Instant: 60.6 (#95)

Writing & Preference benchmarks
BenchmarkCodellama 34b InstructKimi K2.5 Instant
LMArena Text10661420
LMArena Creative Writing10321381
LMArena Multi-Turn10151427

Frequently asked questions

Is Codellama 34b Instruct better than Kimi K2.5 Instant?

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 30.8 on the Noometry Index.

Is Codellama 34b Instruct or Kimi K2.5 Instant better for coding?

Kimi K2.5 Instant scores higher on coding benchmarks: 42.6 versus 28.5 in the Noometry coding category.

How many benchmarks do Codellama 34b Instruct and Kimi K2.5 Instant share?

10 benchmarks have published results for both models. Codellama 34b Instruct has 14 scored results on Noometry and Kimi K2.5 Instant has 18.

Related comparisons

Go deeper