Model comparison

Llama 3-70B vs Wizardlm 70b

Wizardlm 70b is the stronger model overall, scoring 33.0 to 28.8 on the Noometry Index.

Last verified . 12 shared benchmarks.

Llama 3-70B Meta

28.8

Rank #323 Confirmed

Wizardlm 70b Microsoft

33.0

Rank #249 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Llama 3-70B scores higher in 5 categories and Wizardlm 70b in 2 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Wizardlm 70b leads 32.2 to 12.8.

Side by side

Llama 3-70B and Wizardlm 70b specifications
Llama 3-70BWizardlm 70b
ProviderMetaMicrosoft
Noometry Index28.833.0
Released2024-04-18—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked3112

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Llama 3-70B leads

Llama 3-70B: 35.8 (#218), Wizardlm 70b: 31.4 (#285)

Coding benchmarks
BenchmarkLlama 3-70BWizardlm 70b
LMArena Coding12061081
BigCodeBench Instruct43.6%—
BigCodeBench Complete54.5%—
HumanEval+72%—
MBPP+69%—

Agentic & Tool Use Not comparable

Llama 3-70B: 21.1 (#139), Wizardlm 70b: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3-70BWizardlm 70b
Cybench5%—

Reasoning Wizardlm 70b leads

Llama 3-70B: 18.0 (#288), Wizardlm 70b: 20.7 (#234)

Reasoning benchmarks
BenchmarkLlama 3-70BWizardlm 70b
LMArena Hard Prompts11951079
Kagi LLM Benchmark35.1%—
DTBench54.2%—
Epoch Capabilities Index122.93—
ForecastBench57.1—
WinoGrande83.5%—

Math Wizardlm 70b leads

Llama 3-70B: 12.8 (#305), Wizardlm 70b: 32.2 (#218)

Math benchmarks
BenchmarkLlama 3-70BWizardlm 70b
LMArena Math12181116
OTIS Mock AIME 2024-20254.3%—
MATH Level 522.6%—

Knowledge Not comparable

Llama 3-70B: 20.8 (#277), Wizardlm 70b: —

Knowledge benchmarks
BenchmarkLlama 3-70BWizardlm 70b
GPQA Diamond40.6%—
LMArena Expert1149—
MMLU79.3%—

Multilingual Llama 3-70B leads

Llama 3-70B: 33.6 (#251), Wizardlm 70b: 29.6 (#265)

Multilingual benchmarks
BenchmarkLlama 3-70BWizardlm 70b
LMArena Non-English11421078
LMArena Chinese11141052
LMArena German11691083
LMArena Russian11591155
LMArena French1232—
LMArena Japanese1017—
LMArena Korean1017—
LMArena Spanish1241—

Instruction Following Llama 3-70B leads

Llama 3-70B: 62.5 (#238), Wizardlm 70b: 56.3 (#273)

Instruction Following benchmarks
BenchmarkLlama 3-70BWizardlm 70b
LMArena Instruction Following11941093

Long Context Llama 3-70B leads

Llama 3-70B: 35.6 (#240), Wizardlm 70b: 33.3 (#263)

Long Context benchmarks
BenchmarkLlama 3-70BWizardlm 70b
LMArena Longer Query11741097

Writing & Preference Llama 3-70B leads

Llama 3-70B: 42.8 (#231), Wizardlm 70b: 34.8 (#269)

Writing & Preference benchmarks
BenchmarkLlama 3-70BWizardlm 70b
LMArena Text12211120
LMArena Creative Writing12101149
LMArena Multi-Turn12231108

Frequently asked questions

Is Llama 3-70B better than Wizardlm 70b?

Wizardlm 70b is the stronger model overall, scoring 33.0 to 28.8 on the Noometry Index.

Is Llama 3-70B or Wizardlm 70b better for coding?

Llama 3-70B scores higher on coding benchmarks: 35.8 versus 31.4 in the Noometry coding category.

How many benchmarks do Llama 3-70B and Wizardlm 70b share?

12 benchmarks have published results for both models. Llama 3-70B has 31 scored results on Noometry and Wizardlm 70b has 12.

Related comparisons

Go deeper