Noometry

Model comparison

Mistral Medium vs Qwen1.5-32B

Mistral Medium is the stronger model overall, scoring 36.3 to 30.5 on the Noometry Index.

Last verified . 18 shared benchmarks.

Mistral Medium Mistral AI

36.3

Rank #218 Confirmed

Qwen1.5-32B Alibaba (Qwen)

30.5

Rank #293 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Mistral Medium scores higher in 7 categories and Qwen1.5-32B in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Mistral Medium leads 60.0 to 34.2.
  • The biggest single-benchmark swing is GPQA Diamond: 59.5% for Mistral Medium and 30.7% for Qwen1.5-32B.

Side by side

Mistral MediumQwen1.5-32B
ProviderMistral AIAlibaba (Qwen)
Noometry Index36.330.5
Released2023-12-112024-02-04
WeightsOpenOpen
Context window262K—
Max output262K—
Input $ / M tokens$1.50—
Output $ / M tokens$7.50—
Results tracked3621

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Medium leads

Mistral Medium: 34.2 (#243), Qwen1.5-32B: 31.7 (#282)

BenchmarkMistral MediumQwen1.5-32B
LMArena Coding14341155
FrontierCode8%—
SciCode40.2%—
WeirdML43.7%—
BigCodeBench Instruct—32.3%
BigCodeBench Complete—42%
ALE-Bench763.98—

Agentic & Tool Use Not comparable

Mistral Medium: 28.3 (#90), Qwen1.5-32B: —

BenchmarkMistral MediumQwen1.5-32B
Berkeley Function Calling Leaderboard37.7%—

Reasoning Mistral Medium leads

Mistral Medium: 24.0 (#167), Qwen1.5-32B: 21.8 (#212)

BenchmarkMistral MediumQwen1.5-32B
LMArena Hard Prompts14261130
Kagi LLM Benchmark50%—
CritPt0%—
DTBench75.5%—
LMCA26.1%—
Surface Evolver Bench26.9%—

Math Qwen1.5-32B leads

Mistral Medium: 28.1 (#245), Qwen1.5-32B: 33.0 (#207)

BenchmarkMistral MediumQwen1.5-32B
LMArena Math14081155
OTIS Mock AIME 2024-202532.2%—
ProofBench9%—
MATH Level 581.6%—
FrontierMath (Feb 2025 set)0.3%—

Knowledge Mistral Medium leads

Mistral Medium: 25.0 (#265), Qwen1.5-32B: 13.5 (#296)

BenchmarkMistral MediumQwen1.5-32B
GPQA Diamond59.5%30.7%
LMArena Expert14081126
Humanity's Last Exam4.5%—
Vectara Hallucination Rate22.7%—
MMLU—74.4%

Multimodal Not comparable

Mistral Medium: 35.3 (#88), Qwen1.5-32B: —

BenchmarkMistral MediumQwen1.5-32B
LMArena Vision1172—

Multilingual Mistral Medium leads

Mistral Medium: 52.1 (#91), Qwen1.5-32B: 31.4 (#259)

BenchmarkMistral MediumQwen1.5-32B
LMArena Non-English14081106
LMArena Chinese14471177
LMArena French14591101
LMArena German14321058
LMArena Japanese13781027
LMArena Korean13801008
LMArena Russian14111073
LMArena Spanish14331089

Instruction Following Mistral Medium leads

Mistral Medium: 73.7 (#116), Qwen1.5-32B: 57.7 (#265)

BenchmarkMistral MediumQwen1.5-32B
LMArena Instruction Following13981116

Long Context Mistral Medium leads

Mistral Medium: 42.9 (#114), Qwen1.5-32B: 34.7 (#246)

BenchmarkMistral MediumQwen1.5-32B
LMArena Longer Query14061146

Writing & Preference Mistral Medium leads

Mistral Medium: 60.0 (#103), Qwen1.5-32B: 34.2 (#271)

BenchmarkMistral MediumQwen1.5-32B
LMArena Text14241137
LMArena Creative Writing13911083
LMArena Multi-Turn14181140
Short-Story Creative Writing77.3%—

Frequently asked questions

Is Mistral Medium better than Qwen1.5-32B?

Mistral Medium is the stronger model overall, scoring 36.3 to 30.5 on the Noometry Index.

Is Mistral Medium or Qwen1.5-32B better for coding?

Mistral Medium scores higher on coding benchmarks: 34.2 versus 31.7 in the Noometry coding category.

How many benchmarks do Mistral Medium and Qwen1.5-32B share?

18 benchmarks have published results for both models. Mistral Medium has 36 scored results on Noometry and Qwen1.5-32B has 21.

Related comparisons

Go deeper