Model comparison

Ministral 3B vs Wizardlm 70b

Wizardlm 70b is the stronger model overall, scoring 33.0 to 26.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Ministral 3B Mistral AI

26.2

Rank #338 Confirmed

Wizardlm 70b Microsoft

33.0

Rank #249 Confirmed

Summary

  • The widest gap is in math, where Wizardlm 70b leads 32.2 to 26.6.

Side by side

Ministral 3B and Wizardlm 70b specifications
Ministral 3BWizardlm 70b
ProviderMistral AIMicrosoft
Noometry Index26.233.0
Released2024-10-01—
WeightsOpenOpen
Context window131K—
Max output262K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.10—
Results tracked612

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Ministral 3B: —, Wizardlm 70b: 31.4 (#285)

Coding benchmarks
BenchmarkMinistral 3BWizardlm 70b
LMArena Coding—1081

Reasoning Wizardlm 70b leads

Ministral 3B: 18.4 (#282), Wizardlm 70b: 20.7 (#234)

Reasoning benchmarks
BenchmarkMinistral 3BWizardlm 70b
LMArena Hard Prompts—1079
DTBench51.7%—
LMCA5.5%—
Epoch Capabilities Index118.1—

Math Wizardlm 70b leads

Ministral 3B: 26.6 (#258), Wizardlm 70b: 32.2 (#218)

Math benchmarks
BenchmarkMinistral 3BWizardlm 70b
LMArena Math—1116
MATH Level 514.4%—

Knowledge Not comparable

Ministral 3B: 10.4 (#302), Wizardlm 70b: —

Knowledge benchmarks
BenchmarkMinistral 3BWizardlm 70b
GPQA Diamond25.3%—
Vectara Hallucination Rate7.3%—

Multilingual Not comparable

Ministral 3B: —, Wizardlm 70b: 29.6 (#265)

Multilingual benchmarks
BenchmarkMinistral 3BWizardlm 70b
LMArena Non-English—1078
LMArena Chinese—1052
LMArena German—1083
LMArena Russian—1155

Instruction Following Not comparable

Ministral 3B: —, Wizardlm 70b: 56.3 (#273)

Instruction Following benchmarks
BenchmarkMinistral 3BWizardlm 70b
LMArena Instruction Following—1093

Long Context Not comparable

Ministral 3B: —, Wizardlm 70b: 33.3 (#263)

Long Context benchmarks
BenchmarkMinistral 3BWizardlm 70b
LMArena Longer Query—1097

Writing & Preference Not comparable

Ministral 3B: —, Wizardlm 70b: 34.8 (#269)

Writing & Preference benchmarks
BenchmarkMinistral 3BWizardlm 70b
LMArena Text—1120
LMArena Creative Writing—1149
LMArena Multi-Turn—1108

Frequently asked questions

Is Ministral 3B better than Wizardlm 70b?

Wizardlm 70b is the stronger model overall, scoring 33.0 to 26.2 on the Noometry Index.

How many benchmarks do Ministral 3B and Wizardlm 70b share?

0 benchmarks have published results for both models. Ministral 3B has 6 scored results on Noometry and Wizardlm 70b has 12.

Related comparisons

Go deeper