Noometry

Model comparison

Mixtral 8x7B vs Qwen3.5 27B

Qwen3.5 27B is the stronger model overall, scoring 41.4 to 26.8 on the Noometry Index.

Last verified . 18 shared benchmarks.

Mixtral 8x7B Mistral AI

26.8

Rank #328 Confirmed

Qwen3.5 27B Alibaba (Qwen)

41.4

Rank #127 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Mixtral 8x7B scores higher in 0 categories and Qwen3.5 27B in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.5 27B leads 37.4 to 11.0.
  • The biggest single-benchmark swing is DTBench: 49.6% for Mixtral 8x7B and 82.4% for Qwen3.5 27B.
  • Mixtral 8x7B is cheaper at $0.70 / $0.70 per million input/output tokens, against $0.30 / $2.40 for Qwen3.5 27B.
  • Qwen3.5 27B accepts more context: 262K tokens versus 32K.

Side by side

Mixtral 8x7BQwen3.5 27B
ProviderMistral AIAlibaba (Qwen)
Noometry Index26.841.4
Released2023-12-112026-02-23
WeightsOpenOpen
Context window32K262K
Max output32K66K
Input $ / M tokens$0.70$0.30
Output $ / M tokens$0.70$2.40
Results tracked3828

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5 27B leads

Mixtral 8x7B: 32.2 (#265), Qwen3.5 27B: 38.6 (#159)

BenchmarkMixtral 8x7BQwen3.5 27B
LMArena Coding11271427
LMArena WebDev—1357
WeirdML—39.5%
ALE-Bench—349.45
HumanEval+39.6%—
MBPP+49.7%—

Agentic & Tool Use Not comparable

Mixtral 8x7B: —, Qwen3.5 27B: —

BenchmarkMixtral 8x7BQwen3.5 27B
Vending-Bench 2—201.98

Reasoning Qwen3.5 27B leads

Mixtral 8x7B: 17.4 (#283), Qwen3.5 27B: 26.6 (#116)

BenchmarkMixtral 8x7BQwen3.5 27B
LMArena Hard Prompts11151414
DTBench49.6%82.4%
NYT Connections (extended)—47.9%
Thematic Generalization—45.5%
LMCA—34%
Adversarial NLI55.2%—
Epoch Capabilities Index118.38—
ForecastBench56.3—
HellaSwag86.7%—
PIQA83.6%—
WinoGrande77.2%—

Math Qwen3.5 27B leads

Mixtral 8x7B: 17.2 (#284), Qwen3.5 27B: 36.8 (#103)

BenchmarkMixtral 8x7BQwen3.5 27B
LMArena Math11471428
MathArena Final-Answer Competitions—56.7%
Omni-MATH10.5%—
MATH Level 510%—
GSM8K74.4%—

Knowledge Qwen3.5 27B leads

Mixtral 8x7B: 11.0 (#296), Qwen3.5 27B: 37.4 (#149)

BenchmarkMixtral 8x7BQwen3.5 27B
LMArena Expert10881428
GPQA Diamond30.6%—
MMLU-Pro33.5%—
Vectara Hallucination Rate—12.1%
GPQA (HELM)29.6%—
ARC (AI2) Challenge87.3%—
MMLU70.6%—
OpenBookQA85.8%—
TriviaQA82.2%—

Multimodal Not comparable

Mixtral 8x7B: —, Qwen3.5 27B: 38.7 (#56)

BenchmarkMixtral 8x7BQwen3.5 27B
LMArena Vision—1240

Multilingual Qwen3.5 27B leads

Mixtral 8x7B: 29.8 (#261), Qwen3.5 27B: 51.0 (#112)

BenchmarkMixtral 8x7BQwen3.5 27B
LMArena Non-English10771390
LMArena Chinese10551478
LMArena French11651409
LMArena German11141393
LMArena Japanese9311345
LMArena Korean9681359
LMArena Russian10901389
LMArena Spanish11101408

Instruction Following Qwen3.5 27B leads

Mixtral 8x7B: 51.2 (#292), Qwen3.5 27B: 73.7 (#114)

BenchmarkMixtral 8x7BQwen3.5 27B
LMArena Instruction Following11101393
IFEval57.5%—

Long Context Qwen3.5 27B leads

Mixtral 8x7B: 33.4 (#255), Qwen3.5 27B: 43.1 (#103)

BenchmarkMixtral 8x7BQwen3.5 27B
LMArena Longer Query11031413

Writing & Preference Qwen3.5 27B leads

Mixtral 8x7B: 34.4 (#265), Qwen3.5 27B: 59.5 (#106)

BenchmarkMixtral 8x7BQwen3.5 27B
LMArena Text11321409
LMArena Creative Writing11091362
LMArena Multi-Turn11151410
WildBench67.3%—

Frequently asked questions

Is Mixtral 8x7B better than Qwen3.5 27B?

Qwen3.5 27B is the stronger model overall, scoring 41.4 to 26.8 on the Noometry Index.

Which is cheaper, Mixtral 8x7B or Qwen3.5 27B?

Mixtral 8x7B is cheaper. It lists at $0.70 per million input tokens and $0.70 per million output tokens; Qwen3.5 27B lists at $0.30 and $2.40.

Is Mixtral 8x7B or Qwen3.5 27B better for coding?

Qwen3.5 27B scores higher on coding benchmarks: 38.6 versus 32.2 in the Noometry coding category.

Which has the bigger context window?

Qwen3.5 27B does, with 262K tokens against 32K.

How many benchmarks do Mixtral 8x7B and Qwen3.5 27B share?

18 benchmarks have published results for both models. Mixtral 8x7B has 38 scored results on Noometry and Qwen3.5 27B has 28.

Related comparisons

Go deeper