Model comparison

Codellama 34b Instruct vs Wizardlm 70b

Wizardlm 70b is the stronger model overall, scoring 33.0 to 30.8 on the Noometry Index.

Last verified . 10 shared benchmarks.

Codellama 34b Instruct Meta

30.8

Rank #287 Confirmed

Wizardlm 70b Microsoft

33.0

Rank #249 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Codellama 34b Instruct scores higher in 0 categories and Wizardlm 70b in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Wizardlm 70b leads 34.8 to 28.2.

Side by side

Codellama 34b Instruct and Wizardlm 70b specifications
Codellama 34b InstructWizardlm 70b
ProviderMetaMicrosoft
Noometry Index30.833.0
Released——
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1412

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Wizardlm 70b leads

Codellama 34b Instruct: 28.5 (#314), Wizardlm 70b: 31.4 (#285)

Coding benchmarks
BenchmarkCodellama 34b InstructWizardlm 70b
LMArena Coding10461081
BigCodeBench Instruct29%—
BigCodeBench Complete37.1%—
HumanEval+43.9%—
MBPP+56.3%—

Reasoning Wizardlm 70b leads

Codellama 34b Instruct: 19.6 (#255), Wizardlm 70b: 20.7 (#234)

Reasoning benchmarks
BenchmarkCodellama 34b InstructWizardlm 70b
LMArena Hard Prompts10321079

Math Wizardlm 70b leads

Codellama 34b Instruct: 31.0 (#230), Wizardlm 70b: 32.2 (#218)

Math benchmarks
BenchmarkCodellama 34b InstructWizardlm 70b
LMArena Math10561116

Multilingual Wizardlm 70b leads

Codellama 34b Instruct: 25.8 (#284), Wizardlm 70b: 29.6 (#265)

Multilingual benchmarks
BenchmarkCodellama 34b InstructWizardlm 70b
LMArena Non-English10111078
LMArena Chinese9761052
LMArena German—1083
LMArena Russian—1155

Instruction Following Wizardlm 70b leads

Codellama 34b Instruct: 52.2 (#291), Wizardlm 70b: 56.3 (#273)

Instruction Following benchmarks
BenchmarkCodellama 34b InstructWizardlm 70b
LMArena Instruction Following10281093

Long Context Wizardlm 70b leads

Codellama 34b Instruct: 30.9 (#284), Wizardlm 70b: 33.3 (#263)

Long Context benchmarks
BenchmarkCodellama 34b InstructWizardlm 70b
LMArena Longer Query10131097

Writing & Preference Wizardlm 70b leads

Codellama 34b Instruct: 28.2 (#297), Wizardlm 70b: 34.8 (#269)

Writing & Preference benchmarks
BenchmarkCodellama 34b InstructWizardlm 70b
LMArena Text10661120
LMArena Creative Writing10321149
LMArena Multi-Turn10151108

Frequently asked questions

Is Codellama 34b Instruct better than Wizardlm 70b?

Wizardlm 70b is the stronger model overall, scoring 33.0 to 30.8 on the Noometry Index.

Is Codellama 34b Instruct or Wizardlm 70b better for coding?

Wizardlm 70b scores higher on coding benchmarks: 31.4 versus 28.5 in the Noometry coding category.

How many benchmarks do Codellama 34b Instruct and Wizardlm 70b share?

10 benchmarks have published results for both models. Codellama 34b Instruct has 14 scored results on Noometry and Wizardlm 70b has 12.

Related comparisons

Go deeper