Model comparison

Mistral Medium 3.5 vs Wizardlm 13b

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 31.4 on the Noometry Index.

Last verified . 10 shared benchmarks.

Mistral Medium 3.5 Mistral AI

40.2

Rank #152 Confirmed

Wizardlm 13b Microsoft

31.4

Rank #274 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Mistral Medium 3.5 scores higher in 6 categories and Wizardlm 13b in 1 category; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Mistral Medium 3.5 leads 58.5 to 30.5.

Side by side

Mistral Medium 3.5 and Wizardlm 13b specifications
Mistral Medium 3.5Wizardlm 13b
ProviderMistral AIMicrosoft
Noometry Index40.231.4
Released——
WeightsOpenOpen
Context window262K—
Max output210K—
Input $ / M tokens$1.50—
Output $ / M tokens$7.50—
Results tracked2210

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Medium 3.5 leads

Mistral Medium 3.5: 36.0 (#213), Wizardlm 13b: 30.1 (#298)

Coding benchmarks
BenchmarkMistral Medium 3.5Wizardlm 13b
LMArena Coding14611035
LMArena WebDev1264—

Reasoning Wizardlm 13b leads

Mistral Medium 3.5: 17.3 (#295), Wizardlm 13b: 19.4 (#259)

Reasoning benchmarks
BenchmarkMistral Medium 3.5Wizardlm 13b
LMArena Hard Prompts14361018
Kagi LLM Benchmark41.4%—
NYT Connections (extended)12.9%—
Epoch Capabilities Index141.35—

Math Mistral Medium 3.5 leads

Mistral Medium 3.5: 39.1 (#113), Wizardlm 13b: 30.2 (#238)

Math benchmarks
BenchmarkMistral Medium 3.5Wizardlm 13b
LMArena Math14311017

Knowledge Not comparable

Mistral Medium 3.5: 40.0 (#126), Wizardlm 13b: —

Knowledge benchmarks
BenchmarkMistral Medium 3.5Wizardlm 13b
LMArena Expert1432—

Multimodal Not comparable

Mistral Medium 3.5: 38.3 (#65), Wizardlm 13b: —

Multimodal benchmarks
BenchmarkMistral Medium 3.5Wizardlm 13b
LMArena Vision1223—

Multilingual Mistral Medium 3.5 leads

Mistral Medium 3.5: 51.9 (#100), Wizardlm 13b: 27.1 (#277)

Multilingual benchmarks
BenchmarkMistral Medium 3.5Wizardlm 13b
LMArena Non-English14041034
LMArena Chinese14421023
LMArena French1448—
LMArena German1451—
LMArena Korean1385—
LMArena Russian1395—
LMArena Spanish1409—

Instruction Following Mistral Medium 3.5 leads

Mistral Medium 3.5: 74.6 (#90), Wizardlm 13b: 53.5 (#285)

Instruction Following benchmarks
BenchmarkMistral Medium 3.5Wizardlm 13b
LMArena Instruction Following14151048

Long Context Mistral Medium 3.5 leads

Mistral Medium 3.5: 43.2 (#103), Wizardlm 13b: 32.0 (#273)

Long Context benchmarks
BenchmarkMistral Medium 3.5Wizardlm 13b
LMArena Longer Query14151054

Writing & Preference Mistral Medium 3.5 leads

Mistral Medium 3.5: 58.5 (#117), Wizardlm 13b: 30.5 (#287)

Writing & Preference benchmarks
BenchmarkMistral Medium 3.5Wizardlm 13b
LMArena Text14211077
LMArena Creative Writing13741091
LMArena Multi-Turn14231047
EQ-Bench 4993—

Frequently asked questions

Is Mistral Medium 3.5 better than Wizardlm 13b?

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 31.4 on the Noometry Index.

Is Mistral Medium 3.5 or Wizardlm 13b better for coding?

Mistral Medium 3.5 scores higher on coding benchmarks: 36.0 versus 30.1 in the Noometry coding category.

How many benchmarks do Mistral Medium 3.5 and Wizardlm 13b share?

10 benchmarks have published results for both models. Mistral Medium 3.5 has 22 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper