Model comparison

Mixtral 8x22B vs Qwen3.8 27B

Qwen3.8 27B is the stronger model overall, scoring 45.3 to 26.7 on the Noometry Index.

Last verified . 19 shared benchmarks.

Mixtral 8x22B Mistral AI

26.7

Rank #330 Confirmed

Qwen3.8 27B Alibaba (Qwen)

45.3

Rank #64 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Mixtral 8x22B scores higher in 0 categories and Qwen3.8 27B in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3.8 27B leads 65.9 to 37.1.
  • The biggest single-benchmark swing is DTBench: 55.1% for Mixtral 8x22B and 88% for Qwen3.8 27B.
  • Qwen3.8 27B is cheaper at $0.99 / $1.49 per million input/output tokens, against $2 / $6 for Mixtral 8x22B.
  • Qwen3.8 27B accepts more context: 262K tokens versus 64K.

Side by side

Mixtral 8x22B and Qwen3.8 27B specifications
Mixtral 8x22BQwen3.8 27B
ProviderMistral AIAlibaba (Qwen)
Noometry Index26.745.3
Released2024-04-172026-08-14
WeightsOpenOpen
Context window64K262K
Max output64K33K
Input $ / M tokens$2$0.99
Output $ / M tokens$6$1.49
Results tracked3428

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.8 27B leads

Mixtral 8x22B: 23.8 (#324), Qwen3.8 27B: 50.3 (#42)

Coding benchmarks
BenchmarkMixtral 8x22BQwen3.8 27B
LMArena Coding11661487
LMArena WebDev—1592
SciCode—46.6%
WeirdML3.2%—
BigCodeBench Instruct40.6%—
BigCodeBench Complete50.2%—
HumanEval+72%—
MBPP+64.3%—

Agentic & Tool Use Not comparable

Mixtral 8x22B: 22.8 (#119), Qwen3.8 27B: —

Agentic & Tool Use benchmarks
BenchmarkMixtral 8x22BQwen3.8 27B
Cybench7.5%—

Reasoning Qwen3.8 27B leads

Mixtral 8x22B: 19.1 (#246), Qwen3.8 27B: 31.5 (#71)

Reasoning benchmarks
BenchmarkMixtral 8x22BQwen3.8 27B
LMArena Hard Prompts11501459
DTBench55.1%88%
Epoch Capabilities Index122149.38
NYT Connections (extended)—54.5%
CritPt—5.4%
LMCA—41.4%
Surface Evolver Bench—45%
ForecastBench56.3—

Math Qwen3.8 27B leads

Mixtral 8x22B: 21.2 (#271), Qwen3.8 27B: 35.7 (#139)

Math benchmarks
BenchmarkMixtral 8x22BQwen3.8 27B
LMArena Math11841453
ProofBench—16%
Omni-MATH16.3%—
MATH Level 524.2%—

Knowledge Qwen3.8 27B leads

Mixtral 8x22B: 15.1 (#288), Qwen3.8 27B: 40.9 (#105)

Knowledge benchmarks
BenchmarkMixtral 8x22BQwen3.8 27B
LMArena Expert11131482
GPQA Diamond34.1%—
MMLU-Pro46%—
GPQA (HELM)33.4%—
MMLU77.8%—

Multimodal Not comparable

Mixtral 8x22B: —, Qwen3.8 27B: 40.5 (#36)

Multimodal benchmarks
BenchmarkMixtral 8x22BQwen3.8 27B
LMArena Vision—1270

Multilingual Qwen3.8 27B leads

Mixtral 8x22B: 32.9 (#250), Qwen3.8 27B: 54.0 (#54)

Multilingual benchmarks
BenchmarkMixtral 8x22BQwen3.8 27B
LMArena Non-English11281431
LMArena Chinese11161504
LMArena French11651468
LMArena German11411435
LMArena Japanese10371392
LMArena Korean10561389
LMArena Russian11581421
LMArena Spanish11501444

Instruction Following Qwen3.8 27B leads

Mixtral 8x22B: 57.9 (#261), Qwen3.8 27B: 75.8 (#54)

Instruction Following benchmarks
BenchmarkMixtral 8x22BQwen3.8 27B
LMArena Instruction Following11471436
IFEval72.4%—

Long Context Qwen3.8 27B leads

Mixtral 8x22B: 34.6 (#242), Qwen3.8 27B: 44.3 (#66)

Long Context benchmarks
BenchmarkMixtral 8x22BQwen3.8 27B
LMArena Longer Query11441448

Writing & Preference Qwen3.8 27B leads

Mixtral 8x22B: 37.1 (#257), Qwen3.8 27B: 65.9 (#41)

Writing & Preference benchmarks
BenchmarkMixtral 8x22BQwen3.8 27B
LMArena Text11621441
LMArena Creative Writing11411382
LMArena Multi-Turn11301443
EQ-Bench Creative Writing—1671
WildBench71.1%—

Frequently asked questions

Is Mixtral 8x22B better than Qwen3.8 27B?

Qwen3.8 27B is the stronger model overall, scoring 45.3 to 26.7 on the Noometry Index.

Which is cheaper, Mixtral 8x22B or Qwen3.8 27B?

Qwen3.8 27B is cheaper. It lists at $0.99 per million input tokens and $1.49 per million output tokens; Mixtral 8x22B lists at $2 and $6.

Is Mixtral 8x22B or Qwen3.8 27B better for coding?

Qwen3.8 27B scores higher on coding benchmarks: 50.3 versus 23.8 in the Noometry coding category.

Which has the bigger context window?

Qwen3.8 27B does, with 262K tokens against 64K.

How many benchmarks do Mixtral 8x22B and Qwen3.8 27B share?

19 benchmarks have published results for both models. Mixtral 8x22B has 34 scored results on Noometry and Qwen3.8 27B has 28.

Related comparisons

Go deeper