Model comparison

Llama 3.1-70B vs Wizardlm 13b

Wizardlm 13b is the stronger model overall, scoring 31.4 to 29.6 on the Noometry Index.

Last verified . 10 shared benchmarks.

Llama 3.1-70B Meta

29.6

Rank #308 Confirmed

Wizardlm 13b Microsoft

31.4

Rank #274 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Llama 3.1-70B scores higher in 6 categories and Wizardlm 13b in 1 category; 6 gaps are clear of the uncertainty.
  • The widest gap is in math, where Wizardlm 13b leads 30.2 to 13.5.

Side by side

Llama 3.1-70B and Wizardlm 13b specifications
Llama 3.1-70BWizardlm 13b
ProviderMetaMicrosoft
Noometry Index29.631.4
Released2024-07-23—
WeightsOpenOpen
Context window128K—
Max output4K—
Input $ / M tokens$0.40—
Output $ / M tokens$0.40—
Results tracked3510

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Llama 3.1-70B: 30.3 (#296), Wizardlm 13b: 30.1 (#298)

Coding benchmarks
BenchmarkLlama 3.1-70BWizardlm 13b
LMArena Coding12601035
WeirdML9%—
BigCodeBench Instruct46.1%—
BigCodeBench Complete54.8%—

Agentic & Tool Use Not comparable

Llama 3.1-70B: 25.1 (#112), Wizardlm 13b: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.1-70BWizardlm 13b
TheAgentCompany6.9%—
BALROG27.9%—

Reasoning Llama 3.1-70B leads

Llama 3.1-70B: 21.6 (#220), Wizardlm 13b: 19.4 (#259)

Reasoning benchmarks
BenchmarkLlama 3.1-70BWizardlm 13b
LMArena Hard Prompts12411018
DTBench60%—
LMCA14.8%—
Epoch Capabilities Index125.92—

Math Wizardlm 13b leads

Llama 3.1-70B: 13.5 (#304), Wizardlm 13b: 30.2 (#238)

Math benchmarks
BenchmarkLlama 3.1-70BWizardlm 13b
LMArena Math12521017
OTIS Mock AIME 2024-20253.6%—
Omni-MATH21%—
MATH Level 536.7%—

Knowledge Not comparable

Llama 3.1-70B: 24.2 (#269), Wizardlm 13b: —

Knowledge benchmarks
BenchmarkLlama 3.1-70BWizardlm 13b
GPQA Diamond44.2%—
MMLU-Pro65.3%—
GPQA (HELM)42.6%—
LMArena Expert1209—
MMLU80.1%—

Multilingual Llama 3.1-70B leads

Llama 3.1-70B: 38.8 (#225), Wizardlm 13b: 27.1 (#277)

Multilingual benchmarks
BenchmarkLlama 3.1-70BWizardlm 13b
LMArena Non-English12191034
LMArena Chinese12151023
LMArena French1261—
LMArena German1222—
LMArena Japanese1132—
LMArena Korean1140—
LMArena Russian1234—
LMArena Spanish1253—

Instruction Following Llama 3.1-70B leads

Llama 3.1-70B: 65.3 (#223), Wizardlm 13b: 53.5 (#285)

Instruction Following benchmarks
BenchmarkLlama 3.1-70BWizardlm 13b
LMArena Instruction Following12311048
IFEval82.1%—

Long Context Llama 3.1-70B leads

Llama 3.1-70B: 37.6 (#214), Wizardlm 13b: 32.0 (#273)

Long Context benchmarks
BenchmarkLlama 3.1-70BWizardlm 13b
LMArena Longer Query12411054

Writing & Preference Llama 3.1-70B leads

Llama 3.1-70B: 35.4 (#267), Wizardlm 13b: 30.5 (#287)

Writing & Preference benchmarks
BenchmarkLlama 3.1-70BWizardlm 13b
LMArena Text12611077
LMArena Creative Writing12321091
LMArena Multi-Turn12561047
EQ-Bench Creative Writing784—
WildBench75.8%—

Frequently asked questions

Is Llama 3.1-70B better than Wizardlm 13b?

Wizardlm 13b is the stronger model overall, scoring 31.4 to 29.6 on the Noometry Index.

Is Llama 3.1-70B or Wizardlm 13b better for coding?

They score almost the same on coding (30.3 vs 30.1); test both on your own repository before choosing.

How many benchmarks do Llama 3.1-70B and Wizardlm 13b share?

10 benchmarks have published results for both models. Llama 3.1-70B has 35 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper