Noometry

Model comparison

Mistral Large vs QwQ-32B

QwQ-32B is the stronger model overall, scoring 39.4 to 31.6 on the Noometry Index.

Last verified . 33 shared benchmarks.

Mistral Large Mistral AI

31.6

Rank #258 Confirmed

QwQ-32B Alibaba (Qwen)

39.4

Rank #153 Confirmed

Summary

  • They share 33 benchmarks with published results for both. Mistral Large scores higher in 0 categories and QwQ-32B in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where QwQ-32B leads 36.2 to 17.1.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 8.5% for Mistral Large and 59.2% for QwQ-32B.

Side by side

Mistral LargeQwQ-32B
ProviderMistral AIAlibaba (Qwen)
Noometry Index31.639.4
Released2024-02-262024-11-28
WeightsOpenOpen
Context window131K—
Max output16K—
Input $ / M tokens$2—
Output $ / M tokens$6—
Results tracked5136

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding QwQ-32B leads

Mistral Large: 33.8 (#240), QwQ-32B: 34.9 (#220)

BenchmarkMistral LargeQwQ-32B
BigCodeBench Instruct30%44.6%
LiveBench Coding47.1%72.2%
LMArena Coding12771333
BigCodeBench Complete38.3%54.4%
Aider Polyglot—20.9%
SciCode36.2%—
ALE-Bench264.7—
HumanEval+62.2%—
MBPP+59.5%—

Agentic & Tool Use Not comparable

Mistral Large: 28.4 (#83), QwQ-32B: —

BenchmarkMistral LargeQwQ-32B
Berkeley Function Calling Leaderboard38.4%—

Reasoning QwQ-32B leads

Mistral Large: 15.4 (#305), QwQ-32B: 22.9 (#171)

BenchmarkMistral LargeQwQ-32B
LiveBench Reasoning43.5%83.5%
LMArena Hard Prompts12571326
LiveBench Data Analysis50.1%65%
Epoch Capabilities Index128.52137.6
ForecastBench57.158.3
LiveBench48.4%72%
SimpleBench22.5%—
CritPt0%—
Chess Puzzles—5%
DTBench65.1%—
LMCA16.7%—

Math QwQ-32B leads

Mistral Large: 17.1 (#285), QwQ-32B: 36.2 (#123)

BenchmarkMistral LargeQwQ-32B
OTIS Mock AIME 2024-20258.5%59.2%
LiveBench Math42.5%77.8%
LMArena Math12621359
Omni-MATH28.1%—
MATH Level 550.3%—
FrontierMath (Feb 2025 set)0.3%—

Knowledge QwQ-32B leads

Mistral Large: 30.0 (#224), QwQ-32B: 37.2 (#150)

BenchmarkMistral LargeQwQ-32B
GPQA Diamond51.3%65.3%
Confabulations21.4%15.6%
LMArena Expert12321323
MMLU-Pro59.9%—
Vectara Hallucination Rate4.5%—
GPQA (HELM)43.5%—
MMLU80%—

Multilingual QwQ-32B leads

Mistral Large: 40.1 (#214), QwQ-32B: 45.0 (#171)

BenchmarkMistral LargeQwQ-32B
LMArena Non-English12371306
LMArena Chinese12401378
LMArena French13241337
LMArena German12541313
LMArena Japanese11871263
LMArena Korean12021278
LMArena Russian12571297
LMArena Spanish12681353

Instruction Following QwQ-32B leads

Mistral Large: 68.1 (#186), QwQ-32B: 72.8 (#131)

BenchmarkMistral LargeQwQ-32B
LiveBench Instruction Following67.9%81.8%
LMArena Instruction Following12491297
IFEval87.7%—

Long Context QwQ-32B leads

Mistral Large: 38.3 (#194), QwQ-32B: 49.0 (#11)

BenchmarkMistral LargeQwQ-32B
LMArena Longer Query12621308
Fiction.LiveBench—83.3%

Writing & Preference QwQ-32B leads

Mistral Large: 40.9 (#237), QwQ-32B: 50.9 (#175)

BenchmarkMistral LargeQwQ-32B
LMArena Text12661329
LMArena Creative Writing12431288
Short-Story Creative Writing69%80.2%
EQ-Bench Creative Writing9851257
LMArena Multi-Turn12601314
LiveBench Language39.4%51.4%
WildBench80.1%—

Frequently asked questions

Is Mistral Large better than QwQ-32B?

QwQ-32B is the stronger model overall, scoring 39.4 to 31.6 on the Noometry Index.

Is Mistral Large or QwQ-32B better for coding?

QwQ-32B scores higher on coding benchmarks: 34.9 versus 33.8 in the Noometry coding category.

How many benchmarks do Mistral Large and QwQ-32B share?

33 benchmarks have published results for both models. Mistral Large has 51 scored results on Noometry and QwQ-32B has 36.

Related comparisons

Go deeper