Model comparison

Mistral vs Wizardlm 13b

Wizardlm 13b is the stronger model overall, scoring 30.8 to 29.4 on the Noometry Index.

Last verified . 10 shared benchmarks.

Mistral Mistral AI

29.4

Rank #297 Confirmed

Wizardlm 13b Microsoft

30.8

Rank #272 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Mistral scores higher in 5 categories and Wizardlm 13b in 2 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in math, where Wizardlm 13b leads 27.8 to 20.5.
  • Wizardlm 13b has downloadable open weights; the other is API-only.

Side by side

Mistral and Wizardlm 13b specifications
MistralWizardlm 13b
ProviderMistral AIMicrosoft
Noometry Index29.430.8
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2210

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral leads

Mistral: 33.2 (#249), Wizardlm 13b: 29.6 (#293)

Coding benchmarks
BenchmarkMistralWizardlm 13b
LMArena Coding11621035

Reasoning Mistral leads

Mistral: 21.3 (#199), Wizardlm 13b: 18.5 (#265)

Reasoning benchmarks
BenchmarkMistralWizardlm 13b
LMArena Hard Prompts11491018

Math Wizardlm 13b leads

Mistral: 20.5 (#275), Wizardlm 13b: 27.8 (#235)

Math benchmarks
BenchmarkMistralWizardlm 13b
LMArena Math11801017
Omni-MATH7.2%—

Knowledge Not comparable

Mistral: 16.3 (#283), Wizardlm 13b: —

Knowledge benchmarks
BenchmarkMistralWizardlm 13b
MMLU-Pro27.7%—
GPQA (HELM)30.3%—
LMArena Expert1125—

Multilingual Mistral leads

Mistral: 33.0 (#249), Wizardlm 13b: 27.3 (#272)

Multilingual benchmarks
BenchmarkMistralWizardlm 13b
LMArena Non-English11291034
LMArena Chinese11091023
LMArena French1179—
LMArena German1155—
LMArena Japanese1012—
LMArena Korean1032—
LMArena Russian1168—
LMArena Spanish1143—

Instruction Following Too close to call

Mistral: 52.9 (#283), Wizardlm 13b: 53.7 (#280)

Instruction Following benchmarks
BenchmarkMistralWizardlm 13b
LMArena Instruction Following11521049
IFEval56.8%—

Long Context Mistral leads

Mistral: 35.0 (#240), Wizardlm 13b: 32.0 (#268)

Long Context benchmarks
BenchmarkMistralWizardlm 13b
LMArena Longer Query11541054

Writing & Preference Mistral leads

Mistral: 37.2 (#255), Wizardlm 13b: 30.7 (#282)

Writing & Preference benchmarks
BenchmarkMistralWizardlm 13b
LMArena Text11651077
LMArena Creative Writing11581090
LMArena Multi-Turn11471047
WildBench66%—

Frequently asked questions

Is Mistral better than Wizardlm 13b?

Wizardlm 13b is the stronger model overall, scoring 30.8 to 29.4 on the Noometry Index.

Is Mistral or Wizardlm 13b better for coding?

Mistral scores higher on coding benchmarks: 33.2 versus 29.6 in the Noometry coding category.

How many benchmarks do Mistral and Wizardlm 13b share?

10 benchmarks have published results for both models. Mistral has 22 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper