Model comparison

Llama 3-70B vs Wizardlm 13b

Wizardlm 13b is the stronger model overall, scoring 31.4 to 28.8 on the Noometry Index.

Last verified . 10 shared benchmarks.

Llama 3-70B Meta

28.8

Rank #323 Confirmed

Wizardlm 13b Microsoft

31.4

Rank #274 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Llama 3-70B scores higher in 5 categories and Wizardlm 13b in 2 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Wizardlm 13b leads 30.2 to 12.8.

Side by side

Llama 3-70B and Wizardlm 13b specifications
Llama 3-70BWizardlm 13b
ProviderMetaMicrosoft
Noometry Index28.831.4
Released2024-04-18—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked3110

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Llama 3-70B leads

Llama 3-70B: 35.8 (#218), Wizardlm 13b: 30.1 (#298)

Coding benchmarks
BenchmarkLlama 3-70BWizardlm 13b
LMArena Coding12061035
BigCodeBench Instruct43.6%—
BigCodeBench Complete54.5%—
HumanEval+72%—
MBPP+69%—

Agentic & Tool Use Not comparable

Llama 3-70B: 21.1 (#139), Wizardlm 13b: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3-70BWizardlm 13b
Cybench5%—

Reasoning Wizardlm 13b leads

Llama 3-70B: 18.0 (#288), Wizardlm 13b: 19.4 (#259)

Reasoning benchmarks
BenchmarkLlama 3-70BWizardlm 13b
LMArena Hard Prompts11951018
Kagi LLM Benchmark35.1%—
DTBench54.2%—
Epoch Capabilities Index122.93—
ForecastBench57.1—
WinoGrande83.5%—

Math Wizardlm 13b leads

Llama 3-70B: 12.8 (#305), Wizardlm 13b: 30.2 (#238)

Math benchmarks
BenchmarkLlama 3-70BWizardlm 13b
LMArena Math12181017
OTIS Mock AIME 2024-20254.3%—
MATH Level 522.6%—

Knowledge Not comparable

Llama 3-70B: 20.8 (#277), Wizardlm 13b: —

Knowledge benchmarks
BenchmarkLlama 3-70BWizardlm 13b
GPQA Diamond40.6%—
LMArena Expert1149—
MMLU79.3%—

Multilingual Llama 3-70B leads

Llama 3-70B: 33.6 (#251), Wizardlm 13b: 27.1 (#277)

Multilingual benchmarks
BenchmarkLlama 3-70BWizardlm 13b
LMArena Non-English11421034
LMArena Chinese11141023
LMArena French1232—
LMArena German1169—
LMArena Japanese1017—
LMArena Korean1017—
LMArena Russian1159—
LMArena Spanish1241—

Instruction Following Llama 3-70B leads

Llama 3-70B: 62.5 (#238), Wizardlm 13b: 53.5 (#285)

Instruction Following benchmarks
BenchmarkLlama 3-70BWizardlm 13b
LMArena Instruction Following11941048

Long Context Llama 3-70B leads

Llama 3-70B: 35.6 (#240), Wizardlm 13b: 32.0 (#273)

Long Context benchmarks
BenchmarkLlama 3-70BWizardlm 13b
LMArena Longer Query11741054

Writing & Preference Llama 3-70B leads

Llama 3-70B: 42.8 (#231), Wizardlm 13b: 30.5 (#287)

Writing & Preference benchmarks
BenchmarkLlama 3-70BWizardlm 13b
LMArena Text12211077
LMArena Creative Writing12101091
LMArena Multi-Turn12231047

Frequently asked questions

Is Llama 3-70B better than Wizardlm 13b?

Wizardlm 13b is the stronger model overall, scoring 31.4 to 28.8 on the Noometry Index.

Is Llama 3-70B or Wizardlm 13b better for coding?

Llama 3-70B scores higher on coding benchmarks: 35.8 versus 30.1 in the Noometry coding category.

How many benchmarks do Llama 3-70B and Wizardlm 13b share?

10 benchmarks have published results for both models. Llama 3-70B has 31 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper