Model comparison

Llama 2-34B vs Wizardlm 13b

Wizardlm 13b has enough public results to be ranked (#272); Llama 2-34B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Llama 2-34B Meta

—

Unranked

Wizardlm 13b Microsoft

30.8

Rank #272 Confirmed

Summary

  • Wizardlm 13b has downloadable open weights; the other is API-only.

Side by side

Llama 2-34B and Wizardlm 13b specifications
Llama 2-34BWizardlm 13b
ProviderMetaMicrosoft
Noometry Index—30.8
Released2023-07-18—
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1010

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 2-34B: —, Wizardlm 13b: 29.6 (#293)

Coding benchmarks
BenchmarkLlama 2-34BWizardlm 13b
LMArena Coding—1035

Reasoning Not comparable

Llama 2-34B: —, Wizardlm 13b: 18.5 (#265)

Reasoning benchmarks
BenchmarkLlama 2-34BWizardlm 13b
LMArena Hard Prompts—1018
BIG-Bench Hard44.1%—
Epoch Capabilities Index104.81—
PIQA81.9%—
WinoGrande76.7%—

Math Not comparable

Llama 2-34B: —, Wizardlm 13b: 27.8 (#235)

Math benchmarks
BenchmarkLlama 2-34BWizardlm 13b
LMArena Math—1017
GSM8K42.2%—

Knowledge Not comparable

Llama 2-34B: —, Wizardlm 13b: —

Knowledge benchmarks
BenchmarkLlama 2-34BWizardlm 13b
ARC (AI2) Challenge54.5%—
BoolQ83.7%—
MMLU62.6%—
OpenBookQA58.2%—
TriviaQA84.6%—

Multilingual Not comparable

Llama 2-34B: —, Wizardlm 13b: 27.3 (#272)

Multilingual benchmarks
BenchmarkLlama 2-34BWizardlm 13b
LMArena Non-English—1034
LMArena Chinese—1023

Instruction Following Not comparable

Llama 2-34B: —, Wizardlm 13b: 53.7 (#280)

Instruction Following benchmarks
BenchmarkLlama 2-34BWizardlm 13b
LMArena Instruction Following—1049

Long Context Not comparable

Llama 2-34B: —, Wizardlm 13b: 32.0 (#268)

Long Context benchmarks
BenchmarkLlama 2-34BWizardlm 13b
LMArena Longer Query—1054

Writing & Preference Not comparable

Llama 2-34B: —, Wizardlm 13b: 30.7 (#282)

Writing & Preference benchmarks
BenchmarkLlama 2-34BWizardlm 13b
LMArena Text—1077
LMArena Creative Writing—1090
LMArena Multi-Turn—1047

Frequently asked questions

Is Llama 2-34B better than Wizardlm 13b?

Wizardlm 13b has enough public results to be ranked (#272); Llama 2-34B does not yet, so treat this comparison as directional.

How many benchmarks do Llama 2-34B and Wizardlm 13b share?

0 benchmarks have published results for both models. Llama 2-34B has 10 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper