Noometry

Model comparison

Mixtral 8x22B vs QwQ-32B

QwQ-32B is the stronger model overall, scoring 39.8 to 27.1 on the Noometry Index.

Last verified . 22 shared benchmarks.

Mixtral 8x22B Mistral AI

27.1

Rank #333 Confirmed

QwQ-32B Alibaba (Qwen)

39.8

Rank #159 Confirmed

Summary

  • They share 22 benchmarks with published results for both. Mixtral 8x22B scores higher in 0 categories and QwQ-32B in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where QwQ-32B leads 37.2 to 15.1.
  • The biggest single-benchmark swing is GPQA Diamond: 34.1% for Mixtral 8x22B and 65.3% for QwQ-32B.

Side by side

Mixtral 8x22BQwQ-32B
ProviderMistral AIAlibaba (Qwen)
Noometry Index27.139.8
Released2024-04-172024-11-28
WeightsOpenOpen
Context window64K—
Max output64K—
Input $ / M tokens$2—
Output $ / M tokens$6—
Results tracked3436

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding QwQ-32B leads

Mixtral 8x22B: 24.2 (#329), QwQ-32B: 35.4 (#226)

BenchmarkMixtral 8x22BQwQ-32B
BigCodeBench Instruct40.6%44.6%
LMArena Coding11661333
BigCodeBench Complete50.2%54.4%
Aider Polyglot—20.9%
WeirdML3.2%—
LiveBench Coding—72.2%
HumanEval+72%—
MBPP+64.3%—

Agentic & Tool Use Not comparable

Mixtral 8x22B: 23.1 (#127), QwQ-32B: —

BenchmarkMixtral 8x22BQwQ-32B
Cybench7.5%—

Reasoning QwQ-32B leads

Mixtral 8x22B: 19.9 (#248), QwQ-32B: 23.7 (#174)

BenchmarkMixtral 8x22BQwQ-32B
LMArena Hard Prompts11501325
Epoch Capabilities Index122.03137.6
ForecastBench56.358.3
Chess Puzzles—5%
LiveBench Reasoning—83.5%
DTBench55.1%—
LiveBench Data Analysis—65%
LiveBench—72%

Math QwQ-32B leads

Mixtral 8x22B: 22.9 (#275), QwQ-32B: 38.0 (#143)

BenchmarkMixtral 8x22BQwQ-32B
LMArena Math11841359
OTIS Mock AIME 2024-2025—59.2%
Omni-MATH16.3%—
LiveBench Math—77.8%
MATH Level 524.2%—

Knowledge QwQ-32B leads

Mixtral 8x22B: 15.1 (#293), QwQ-32B: 37.2 (#158)

BenchmarkMixtral 8x22BQwQ-32B
GPQA Diamond34.1%65.3%
LMArena Expert11131324
MMLU-Pro46%—
Confabulations—15.6%
GPQA (HELM)33.4%—
MMLU77.8%—

Multilingual QwQ-32B leads

Mixtral 8x22B: 32.8 (#255), QwQ-32B: 44.8 (#176)

BenchmarkMixtral 8x22BQwQ-32B
LMArena Non-English11281305
LMArena Chinese11161378
LMArena French11661336
LMArena German11411313
LMArena Japanese10371262
LMArena Korean10571279
LMArena Russian11581297
LMArena Spanish11511354

Instruction Following QwQ-32B leads

Mixtral 8x22B: 57.7 (#266), QwQ-32B: 72.6 (#137)

BenchmarkMixtral 8x22BQwQ-32B
LMArena Instruction Following11471297
LiveBench Instruction Following—81.8%
IFEval72.4%—

Long Context QwQ-32B leads

Mixtral 8x22B: 34.7 (#247), QwQ-32B: 49.0 (#11)

BenchmarkMixtral 8x22BQwQ-32B
LMArena Longer Query11441308
Fiction.LiveBench—83.3%

Writing & Preference QwQ-32B leads

Mixtral 8x22B: 36.9 (#262), QwQ-32B: 50.6 (#180)

BenchmarkMixtral 8x22BQwQ-32B
LMArena Text11621329
LMArena Creative Writing11411288
LMArena Multi-Turn11301314
Short-Story Creative Writing—80.2%
EQ-Bench Creative Writing—1257
WildBench71.1%—
LiveBench Language—51.4%

Frequently asked questions

Is Mixtral 8x22B better than QwQ-32B?

QwQ-32B is the stronger model overall, scoring 39.8 to 27.1 on the Noometry Index.

Is Mixtral 8x22B or QwQ-32B better for coding?

QwQ-32B scores higher on coding benchmarks: 35.4 versus 24.2 in the Noometry coding category.

How many benchmarks do Mixtral 8x22B and QwQ-32B share?

22 benchmarks have published results for both models. Mixtral 8x22B has 34 scored results on Noometry and QwQ-32B has 36.

Related comparisons

Go deeper