Model comparison

Mixtral 8x22B vs Qwen3.7 Plus

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 27.1 on the Noometry Index.

Last verified . 20 shared benchmarks.

Mixtral 8x22B Mistral AI

27.1

Rank #333 Confirmed

Qwen3.7 Plus Alibaba (Qwen)

45.3

Rank #72 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Mixtral 8x22B scores higher in 1 category and Qwen3.7 Plus in 8 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.7 Plus leads 54.9 to 15.1.
  • The biggest single-benchmark swing is GPQA Diamond: 34.1% for Mixtral 8x22B and 87.9% for Qwen3.7 Plus.
  • Qwen3.7 Plus is cheaper at $0.40 / $1.60 per million input/output tokens, against $2 / $6 for Mixtral 8x22B.
  • Qwen3.7 Plus accepts more context: 1M tokens versus 64K.
  • Mixtral 8x22B has downloadable open weights; the other is API-only.

Side by side

Mixtral 8x22B and Qwen3.7 Plus specifications
Mixtral 8x22BQwen3.7 Plus
ProviderMistral AIAlibaba (Qwen)
Noometry Index27.145.3
Released2024-04-172026-06-02
WeightsOpenProprietary
Context window64K1M
Max output64K131K
Input $ / M tokens$2$0.40
Output $ / M tokens$6$1.60
Results tracked3432

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.7 Plus leads

Mixtral 8x22B: 24.2 (#329), Qwen3.7 Plus: 36.6 (#206)

Coding benchmarks
BenchmarkMixtral 8x22BQwen3.7 Plus
LMArena Coding11661473
FrontierCode—10.2%
SciCode—45.5%
WeirdML3.2%—
BigCodeBench Instruct40.6%—
BigCodeBench Complete50.2%—
HumanEval+72%—
MBPP+64.3%—

Agentic & Tool Use Mixtral 8x22B leads

Mixtral 8x22B: 23.1 (#127), Qwen3.7 Plus: 21.4 (#138)

Agentic & Tool Use benchmarks
BenchmarkMixtral 8x22BQwen3.7 Plus
OSWorld 2.0—2.8%
Cybench7.5%—

Reasoning Qwen3.7 Plus leads

Mixtral 8x22B: 19.9 (#248), Qwen3.7 Plus: 39.3 (#59)

Reasoning benchmarks
BenchmarkMixtral 8x22BQwen3.7 Plus
LMArena Hard Prompts11501460
DTBench55.1%84%
Epoch Capabilities Index122.03147.37
NYT Connections (extended)—74.8%
CritPt—9.1%
Chess Puzzles—24%
Mystery Game Puzzles—17%
LMCA—37.6%
ForecastBench56.3—

Math Qwen3.7 Plus leads

Mixtral 8x22B: 22.9 (#275), Qwen3.7 Plus: 50.5 (#56)

Math benchmarks
BenchmarkMixtral 8x22BQwen3.7 Plus
LMArena Math11841466
FrontierMath (Tiers 1-3)—34.4%
OTIS Mock AIME 2024-2025—93.3%
Omni-MATH16.3%—
MATH Level 524.2%—

Knowledge Qwen3.7 Plus leads

Mixtral 8x22B: 15.1 (#293), Qwen3.7 Plus: 54.9 (#51)

Knowledge benchmarks
BenchmarkMixtral 8x22BQwen3.7 Plus
GPQA Diamond34.1%87.9%
LMArena Expert11131467
MMLU-Pro46%—
GPQA (HELM)33.4%—
MMLU77.8%—

Multimodal Not comparable

Mixtral 8x22B: —, Qwen3.7 Plus: 41.8 (#33)

Multimodal benchmarks
BenchmarkMixtral 8x22BQwen3.7 Plus
LMArena Vision—1279
LMArena Document—1444

Multilingual Qwen3.7 Plus leads

Mixtral 8x22B: 32.8 (#255), Qwen3.7 Plus: 54.8 (#38)

Multilingual benchmarks
BenchmarkMixtral 8x22BQwen3.7 Plus
LMArena Non-English11281445
LMArena Chinese11161510
LMArena French11661473
LMArena German11411471
LMArena Japanese10371413
LMArena Korean10571415
LMArena Russian11581457
LMArena Spanish11511457

Instruction Following Qwen3.7 Plus leads

Mixtral 8x22B: 57.7 (#266), Qwen3.7 Plus: 75.8 (#52)

Instruction Following benchmarks
BenchmarkMixtral 8x22BQwen3.7 Plus
LMArena Instruction Following11471440
IFEval72.4%—

Long Context Qwen3.7 Plus leads

Mixtral 8x22B: 34.7 (#247), Qwen3.7 Plus: 44.5 (#65)

Long Context benchmarks
BenchmarkMixtral 8x22BQwen3.7 Plus
LMArena Longer Query11441455

Writing & Preference Qwen3.7 Plus leads

Mixtral 8x22B: 36.9 (#262), Qwen3.7 Plus: 64.3 (#56)

Writing & Preference benchmarks
BenchmarkMixtral 8x22BQwen3.7 Plus
LMArena Text11621455
LMArena Creative Writing11411439
LMArena Multi-Turn11301460
WildBench71.1%—

Frequently asked questions

Is Mixtral 8x22B better than Qwen3.7 Plus?

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 27.1 on the Noometry Index.

Which is cheaper, Mixtral 8x22B or Qwen3.7 Plus?

Qwen3.7 Plus is cheaper. It lists at $0.40 per million input tokens and $1.60 per million output tokens; Mixtral 8x22B lists at $2 and $6.

Is Mixtral 8x22B or Qwen3.7 Plus better for coding?

Qwen3.7 Plus scores higher on coding benchmarks: 36.6 versus 24.2 in the Noometry coding category.

Which has the bigger context window?

Qwen3.7 Plus does, with 1M tokens against 64K.

How many benchmarks do Mixtral 8x22B and Qwen3.7 Plus share?

20 benchmarks have published results for both models. Mixtral 8x22B has 34 scored results on Noometry and Qwen3.7 Plus has 32.

Related comparisons

Go deeper