Noometry

Model comparison

Mixtral 8x22B vs Qwen Plus

Qwen Plus is the stronger model overall, scoring 36.7 to 26.7 on the Noometry Index.

Last verified . 16 shared benchmarks.

Mixtral 8x22B Mistral AI

26.7

Rank #330 Confirmed

Qwen Plus Alibaba (Qwen)

36.7

Rank #204 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Mixtral 8x22B scores higher in 0 categories and Qwen Plus in 8 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen Plus leads 52.4 to 37.1.
  • The biggest single-benchmark swing is MATH Level 5: 24.2% for Mixtral 8x22B and 65.3% for Qwen Plus.
  • Qwen Plus is cheaper at $0.40 / $1.20 per million input/output tokens, against $2 / $6 for Mixtral 8x22B.
  • Qwen Plus accepts more context: 1M tokens versus 64K.
  • Mixtral 8x22B has downloadable open weights; the other is API-only.

Side by side

Mixtral 8x22BQwen Plus
ProviderMistral AIAlibaba (Qwen)
Noometry Index26.736.7
Released2024-04-172024-01-25
WeightsOpenProprietary
Context window64K1M
Max output64K33K
Input $ / M tokens$2$0.40
Output $ / M tokens$6$1.20
Results tracked3420

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen Plus leads

Mixtral 8x22B: 23.8 (#324), Qwen Plus: 38.3 (#163)

BenchmarkMixtral 8x22BQwen Plus
LMArena Coding11661328
WeirdML3.2%—
BigCodeBench Instruct40.6%—
BigCodeBench Complete50.2%—
HumanEval+72%—
MBPP+64.3%—

Agentic & Tool Use Not comparable

Mixtral 8x22B: 22.8 (#119), Qwen Plus: —

BenchmarkMixtral 8x22BQwen Plus
Cybench7.5%—

Reasoning Qwen Plus leads

Mixtral 8x22B: 19.1 (#246), Qwen Plus: 27.6 (#101)

BenchmarkMixtral 8x22BQwen Plus
LMArena Hard Prompts11501317
DTBench55.1%81.1%
Kagi LLM Benchmark—63.3%
LMCA—24%
Epoch Capabilities Index122—
ForecastBench56.3—

Math Too close to call

Mixtral 8x22B: 21.2 (#271), Qwen Plus: 22.0 (#266)

BenchmarkMixtral 8x22BQwen Plus
LMArena Math11841326
MATH Level 524.2%65.3%
OTIS Mock AIME 2024-2025—17.8%
Omni-MATH16.3%—
FrontierMath (Feb 2025 set)—1.7%

Knowledge Qwen Plus leads

Mixtral 8x22B: 15.1 (#288), Qwen Plus: 27.4 (#245)

BenchmarkMixtral 8x22BQwen Plus
GPQA Diamond34.1%48.1%
LMArena Expert11131328
MMLU-Pro46%—
GPQA (HELM)33.4%—
MMLU77.8%—

Multilingual Qwen Plus leads

Mixtral 8x22B: 32.9 (#250), Qwen Plus: 45.3 (#170)

BenchmarkMixtral 8x22BQwen Plus
LMArena Non-English11281310
LMArena Chinese11161347
LMArena Japanese10371251
LMArena Russian11581323
LMArena French1165—
LMArena German1141—
LMArena Korean1056—
LMArena Spanish1150—

Instruction Following Qwen Plus leads

Mixtral 8x22B: 57.9 (#261), Qwen Plus: 69.0 (#176)

BenchmarkMixtral 8x22BQwen Plus
LMArena Instruction Following11471303
IFEval72.4%—

Long Context Qwen Plus leads

Mixtral 8x22B: 34.6 (#242), Qwen Plus: 40.3 (#153)

BenchmarkMixtral 8x22BQwen Plus
LMArena Longer Query11441325

Writing & Preference Qwen Plus leads

Mixtral 8x22B: 37.1 (#257), Qwen Plus: 52.4 (#171)

BenchmarkMixtral 8x22BQwen Plus
LMArena Text11621326
LMArena Creative Writing11411293
LMArena Multi-Turn11301336
WildBench71.1%—

Frequently asked questions

Is Mixtral 8x22B better than Qwen Plus?

Qwen Plus is the stronger model overall, scoring 36.7 to 26.7 on the Noometry Index.

Which is cheaper, Mixtral 8x22B or Qwen Plus?

Qwen Plus is cheaper. It lists at $0.40 per million input tokens and $1.20 per million output tokens; Mixtral 8x22B lists at $2 and $6.

Is Mixtral 8x22B or Qwen Plus better for coding?

Qwen Plus scores higher on coding benchmarks: 38.3 versus 23.8 in the Noometry coding category.

Which has the bigger context window?

Qwen Plus does, with 1M tokens against 64K.

How many benchmarks do Mixtral 8x22B and Qwen Plus share?

16 benchmarks have published results for both models. Mixtral 8x22B has 34 scored results on Noometry and Qwen Plus has 20.

Related comparisons

Go deeper