Noometry

Model comparison

Mixtral 8x7B vs Qwen3.7 Plus

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 27.1 on the Noometry Index.

Last verified . 20 shared benchmarks.

Mixtral 8x7B Mistral AI

27.1

Rank #334 Confirmed

Qwen3.7 Plus Alibaba (Qwen)

45.3

Rank #72 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Mixtral 8x7B scores higher in 0 categories and Qwen3.7 Plus in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.7 Plus leads 54.9 to 11.0.
  • The biggest single-benchmark swing is GPQA Diamond: 30.6% for Mixtral 8x7B and 87.9% for Qwen3.7 Plus.
  • Both cost about the same: $0.70 input and $0.70 output per million tokens.
  • Qwen3.7 Plus accepts more context: 1M tokens versus 32K.
  • Mixtral 8x7B has downloadable open weights; the other is API-only.

Side by side

Mixtral 8x7BQwen3.7 Plus
ProviderMistral AIAlibaba (Qwen)
Noometry Index27.145.3
Released2023-12-112026-06-02
WeightsOpenProprietary
Context window32K1M
Max output32K131K
Input $ / M tokens$0.70$0.40
Output $ / M tokens$0.70$1.60
Results tracked3832

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.7 Plus leads

Mixtral 8x7B: 32.8 (#269), Qwen3.7 Plus: 36.6 (#206)

BenchmarkMixtral 8x7BQwen3.7 Plus
LMArena Coding11261473
FrontierCode—10.2%
SciCode—45.5%
HumanEval+39.6%—
MBPP+49.7%—

Agentic & Tool Use Not comparable

Mixtral 8x7B: —, Qwen3.7 Plus: 21.4 (#138)

BenchmarkMixtral 8x7BQwen3.7 Plus
OSWorld 2.0—2.8%

Reasoning Qwen3.7 Plus leads

Mixtral 8x7B: 18.2 (#285), Qwen3.7 Plus: 39.3 (#59)

BenchmarkMixtral 8x7BQwen3.7 Plus
LMArena Hard Prompts11151460
DTBench49.6%84%
Epoch Capabilities Index118.47147.37
NYT Connections (extended)—74.8%
CritPt—9.1%
Chess Puzzles—24%
Mystery Game Puzzles—17%
LMCA—37.6%
Adversarial NLI55.2%—
ForecastBench56.3—
HellaSwag86.7%—
PIQA83.6%—
WinoGrande77.2%—

Math Qwen3.7 Plus leads

Mixtral 8x7B: 18.8 (#289), Qwen3.7 Plus: 50.5 (#56)

BenchmarkMixtral 8x7BQwen3.7 Plus
LMArena Math11471466
FrontierMath (Tiers 1-3)—34.4%
OTIS Mock AIME 2024-2025—93.3%
Omni-MATH10.5%—
MATH Level 510%—
GSM8K74.4%—

Knowledge Qwen3.7 Plus leads

Mixtral 8x7B: 11.0 (#301), Qwen3.7 Plus: 54.9 (#51)

BenchmarkMixtral 8x7BQwen3.7 Plus
GPQA Diamond30.6%87.9%
LMArena Expert10881467
MMLU-Pro33.5%—
GPQA (HELM)29.6%—
ARC (AI2) Challenge87.3%—
MMLU70.6%—
OpenBookQA85.8%—
TriviaQA82.2%—

Multimodal Not comparable

Mixtral 8x7B: —, Qwen3.7 Plus: 41.8 (#33)

BenchmarkMixtral 8x7BQwen3.7 Plus
LMArena Vision—1279
LMArena Document—1444

Multilingual Qwen3.7 Plus leads

Mixtral 8x7B: 29.6 (#266), Qwen3.7 Plus: 54.8 (#38)

BenchmarkMixtral 8x7BQwen3.7 Plus
LMArena Non-English10771445
LMArena Chinese10551510
LMArena French11661473
LMArena German11141471
LMArena Japanese9311413
LMArena Korean9681415
LMArena Russian10901457
LMArena Spanish11111457

Instruction Following Qwen3.7 Plus leads

Mixtral 8x7B: 51.0 (#297), Qwen3.7 Plus: 75.8 (#52)

BenchmarkMixtral 8x7BQwen3.7 Plus
LMArena Instruction Following11091440
IFEval57.5%—

Long Context Qwen3.7 Plus leads

Mixtral 8x7B: 33.4 (#260), Qwen3.7 Plus: 44.5 (#65)

BenchmarkMixtral 8x7BQwen3.7 Plus
LMArena Longer Query11031455

Writing & Preference Qwen3.7 Plus leads

Mixtral 8x7B: 34.2 (#270), Qwen3.7 Plus: 64.3 (#56)

BenchmarkMixtral 8x7BQwen3.7 Plus
LMArena Text11321455
LMArena Creative Writing11091439
LMArena Multi-Turn11151460
WildBench67.3%—

Frequently asked questions

Is Mixtral 8x7B better than Qwen3.7 Plus?

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 27.1 on the Noometry Index.

Which is cheaper, Mixtral 8x7B or Qwen3.7 Plus?

Mixtral 8x7B is cheaper. It lists at $0.70 per million input tokens and $0.70 per million output tokens; Qwen3.7 Plus lists at $0.40 and $1.60.

Is Mixtral 8x7B or Qwen3.7 Plus better for coding?

Qwen3.7 Plus scores higher on coding benchmarks: 36.6 versus 32.8 in the Noometry coding category.

Which has the bigger context window?

Qwen3.7 Plus does, with 1M tokens against 32K.

How many benchmarks do Mixtral 8x7B and Qwen3.7 Plus share?

20 benchmarks have published results for both models. Mixtral 8x7B has 38 scored results on Noometry and Qwen3.7 Plus has 32.

Related comparisons

Go deeper