Model comparison

Ministral 8B vs Wizardlm 13b

Wizardlm 13b is the stronger model overall, scoring 31.4 to 28.2 on the Noometry Index.

Last verified . 10 shared benchmarks.

Ministral 8B Mistral AI

28.2

Rank #325 Confirmed

Wizardlm 13b Microsoft

31.4

Rank #274 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Ministral 8B scores higher in 5 categories and Wizardlm 13b in 2 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Ministral 8B leads 39.6 to 30.5.

Side by side

Ministral 8B and Wizardlm 13b specifications
Ministral 8BWizardlm 13b
ProviderMistral AIMicrosoft
Noometry Index28.231.4
Released2024-10-01—
WeightsOpenOpen
Context window262K—
Max output262K—
Input $ / M tokens$0.15—
Output $ / M tokens$0.15—
Results tracked1710

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Ministral 8B leads

Ministral 8B: 35.0 (#230), Wizardlm 13b: 30.1 (#298)

Coding benchmarks
BenchmarkMinistral 8BWizardlm 13b
LMArena Coding12021035

Agentic & Tool Use Not comparable

Ministral 8B: 16.4 (#148), Wizardlm 13b: —

Agentic & Tool Use benchmarks
BenchmarkMinistral 8BWizardlm 13b
Berkeley Function Calling Leaderboard11.1%—

Reasoning Too close to call

Ministral 8B: 18.4 (#281), Wizardlm 13b: 19.4 (#259)

Reasoning benchmarks
BenchmarkMinistral 8BWizardlm 13b
LMArena Hard Prompts11911018
DTBench45.7%—

Math Wizardlm 13b leads

Ministral 8B: 25.7 (#267), Wizardlm 13b: 30.2 (#238)

Math benchmarks
BenchmarkMinistral 8BWizardlm 13b
LMArena Math11881017
MATH Level 514.9%—

Knowledge Not comparable

Ministral 8B: 12.6 (#297), Wizardlm 13b: —

Knowledge benchmarks
BenchmarkMinistral 8BWizardlm 13b
GPQA Diamond27.1%—
Vectara Hallucination Rate7.4%—
LMArena Expert1170—

Multilingual Ministral 8B leads

Ministral 8B: 35.1 (#247), Wizardlm 13b: 27.1 (#277)

Multilingual benchmarks
BenchmarkMinistral 8BWizardlm 13b
LMArena Non-English11651034
LMArena Chinese11931023
LMArena Russian1195—

Instruction Following Ministral 8B leads

Ministral 8B: 60.5 (#250), Wizardlm 13b: 53.5 (#285)

Instruction Following benchmarks
BenchmarkMinistral 8BWizardlm 13b
LMArena Instruction Following11611048

Long Context Ministral 8B leads

Ministral 8B: 36.7 (#227), Wizardlm 13b: 32.0 (#273)

Long Context benchmarks
BenchmarkMinistral 8BWizardlm 13b
LMArena Longer Query12121054

Writing & Preference Ministral 8B leads

Ministral 8B: 39.6 (#246), Wizardlm 13b: 30.5 (#287)

Writing & Preference benchmarks
BenchmarkMinistral 8BWizardlm 13b
LMArena Text11911077
LMArena Creative Writing11751091
LMArena Multi-Turn11661047

Frequently asked questions

Is Ministral 8B better than Wizardlm 13b?

Wizardlm 13b is the stronger model overall, scoring 31.4 to 28.2 on the Noometry Index.

Is Ministral 8B or Wizardlm 13b better for coding?

Ministral 8B scores higher on coding benchmarks: 35.0 versus 30.1 in the Noometry coding category.

How many benchmarks do Ministral 8B and Wizardlm 13b share?

10 benchmarks have published results for both models. Ministral 8B has 17 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper