Noometry

Model comparison

Mixtral 8x7B vs Qwen3.5-Flash

Qwen3.5-Flash is the stronger model overall, scoring 42.5 to 27.1 on the Noometry Index.

Last verified . 20 shared benchmarks.

Mixtral 8x7B Mistral AI

27.1

Rank #334 Confirmed

Qwen3.5-Flash Alibaba (Qwen)

42.5

Rank #112 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Mixtral 8x7B scores higher in 0 categories and Qwen3.5-Flash in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.5-Flash leads 43.2 to 11.0.
  • The biggest single-benchmark swing is GPQA Diamond: 30.6% for Mixtral 8x7B and 82.3% for Qwen3.5-Flash.
  • Qwen3.5-Flash is cheaper at $0.10 / $0.40 per million input/output tokens, against $0.70 / $0.70 for Mixtral 8x7B.
  • Qwen3.5-Flash accepts more context: 1M tokens versus 32K.
  • Mixtral 8x7B has downloadable open weights; the other is API-only.

Side by side

Mixtral 8x7BQwen3.5-Flash
ProviderMistral AIAlibaba (Qwen)
Noometry Index27.142.5
Released2023-12-112026-02-23
WeightsOpenProprietary
Context window32K1M
Max output32K66K
Input $ / M tokens$0.70$0.10
Output $ / M tokens$0.70$0.40
Results tracked3832

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5-Flash leads

Mixtral 8x7B: 32.8 (#269), Qwen3.5-Flash: 34.2 (#242)

BenchmarkMixtral 8x7BQwen3.5-Flash
LMArena Coding11261412
LMArena WebDev—1244
ALE-Bench—221.8
HumanEval+39.6%—
MBPP+49.7%—

Agentic & Tool Use Not comparable

Mixtral 8x7B: —, Qwen3.5-Flash: —

BenchmarkMixtral 8x7BQwen3.5-Flash
Vending-Bench 2—462.69

Reasoning Qwen3.5-Flash leads

Mixtral 8x7B: 18.2 (#285), Qwen3.5-Flash: 33.7 (#72)

BenchmarkMixtral 8x7BQwen3.5-Flash
LMArena Hard Prompts11151403
DTBench49.6%82.9%
Epoch Capabilities Index118.47143.98
Chess Puzzles—21%
Mystery Game Puzzles—20%
LMCA—29.1%
Adversarial NLI55.2%—
ForecastBench56.3—
HellaSwag86.7%—
PIQA83.6%—
WinoGrande77.2%—

Math Qwen3.5-Flash leads

Mixtral 8x7B: 18.8 (#289), Qwen3.5-Flash: 37.4 (#158)

BenchmarkMixtral 8x7BQwen3.5-Flash
LMArena Math11471407
FrontierMath (Tiers 1-3)—18.2%
OTIS Mock AIME 2024-2025—84.4%
Omni-MATH10.5%—
MATH Level 510%—
FrontierMath (Feb 2025 set)—6.2%
FrontierMath Tier 4 (v1)—0%
GSM8K74.4%—

Knowledge Qwen3.5-Flash leads

Mixtral 8x7B: 11.0 (#301), Qwen3.5-Flash: 43.2 (#93)

BenchmarkMixtral 8x7BQwen3.5-Flash
GPQA Diamond30.6%82.3%
LMArena Expert10881407
SimpleQA Verified—20.3%
MMLU-Pro33.5%—
Vectara Hallucination Rate—10.5%
GPQA (HELM)29.6%—
ARC (AI2) Challenge87.3%—
MMLU70.6%—
OpenBookQA85.8%—
TriviaQA82.2%—

Multilingual Qwen3.5-Flash leads

Mixtral 8x7B: 29.6 (#266), Qwen3.5-Flash: 50.5 (#121)

BenchmarkMixtral 8x7BQwen3.5-Flash
LMArena Non-English10771385
LMArena Chinese10551446
LMArena French11661412
LMArena German11141390
LMArena Japanese9311368
LMArena Korean9681344
LMArena Russian10901379
LMArena Spanish11111400

Instruction Following Qwen3.5-Flash leads

Mixtral 8x7B: 51.0 (#297), Qwen3.5-Flash: 72.6 (#139)

BenchmarkMixtral 8x7BQwen3.5-Flash
LMArena Instruction Following11091374
IFEval57.5%—

Long Context Qwen3.5-Flash leads

Mixtral 8x7B: 33.4 (#260), Qwen3.5-Flash: 42.4 (#124)

BenchmarkMixtral 8x7BQwen3.5-Flash
LMArena Longer Query11031392

Writing & Preference Qwen3.5-Flash leads

Mixtral 8x7B: 34.2 (#270), Qwen3.5-Flash: 57.9 (#122)

BenchmarkMixtral 8x7BQwen3.5-Flash
LMArena Text11321397
LMArena Creative Writing11091343
LMArena Multi-Turn11151393
WildBench67.3%—

Frequently asked questions

Is Mixtral 8x7B better than Qwen3.5-Flash?

Qwen3.5-Flash is the stronger model overall, scoring 42.5 to 27.1 on the Noometry Index.

Which is cheaper, Mixtral 8x7B or Qwen3.5-Flash?

Qwen3.5-Flash is cheaper. It lists at $0.10 per million input tokens and $0.40 per million output tokens; Mixtral 8x7B lists at $0.70 and $0.70.

Is Mixtral 8x7B or Qwen3.5-Flash better for coding?

Qwen3.5-Flash scores higher on coding benchmarks: 34.2 versus 32.8 in the Noometry coding category.

Which has the bigger context window?

Qwen3.5-Flash does, with 1M tokens against 32K.

How many benchmarks do Mixtral 8x7B and Qwen3.5-Flash share?

20 benchmarks have published results for both models. Mixtral 8x7B has 38 scored results on Noometry and Qwen3.5-Flash has 32.

Related comparisons

Go deeper