Noometry

Model comparison

Mixtral 8x22B vs Qwen3 8B

Qwen3 8B is the stronger model overall, scoring 33.7 to 27.1 on the Noometry Index.

Last verified . 3 shared benchmarks.

Mixtral 8x22B Mistral AI

27.1

Rank #333 Confirmed

Qwen3 8B Alibaba (Qwen)

33.7

Rank #238 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Mixtral 8x22B scores higher in 1 category and Qwen3 8B in 5 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3 8B leads 36.1 to 15.1.
  • The biggest single-benchmark swing is GPQA Diamond: 34.1% for Mixtral 8x22B and 56.8% for Qwen3 8B.
  • Qwen3 8B is cheaper at $0.18 / $0.70 per million input/output tokens, against $2 / $6 for Mixtral 8x22B.
  • Qwen3 8B accepts more context: 131K tokens versus 64K.

Side by side

Mixtral 8x22BQwen3 8B
ProviderMistral AIAlibaba (Qwen)
Noometry Index27.133.7
Released2024-04-172025-04
WeightsOpenOpen
Context window64K131K
Max output64K8K
Input $ / M tokens$2$0.18
Output $ / M tokens$6$0.70
Results tracked3411

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3 8B leads

Mixtral 8x22B: 24.2 (#329), Qwen3 8B: 34.0 (#248)

BenchmarkMixtral 8x22BQwen3 8B
SciCode—22.6%
WeirdML3.2%—
BigCodeBench Instruct40.6%—
LMArena Coding1166—
BigCodeBench Complete50.2%—
HumanEval+72%—
MBPP+64.3%—

Agentic & Tool Use Qwen3 8B leads

Mixtral 8x22B: 23.1 (#127), Qwen3 8B: 30.2 (#78)

BenchmarkMixtral 8x22BQwen3 8B
Berkeley Function Calling Leaderboard—42.6%
Cybench7.5%—

Reasoning Mixtral 8x22B leads

Mixtral 8x22B: 19.9 (#248), Qwen3 8B: 16.6 (#303)

BenchmarkMixtral 8x22BQwen3 8B
DTBench55.1%59.7%
Epoch Capabilities Index122.03136.17
CritPt—0%
Chess Puzzles—5%
LMArena Hard Prompts1150—
LMCA—8.8%
ForecastBench56.3—

Math Qwen3 8B leads

Mixtral 8x22B: 22.9 (#275), Qwen3 8B: 34.9 (#191)

BenchmarkMixtral 8x22BQwen3 8B
OTIS Mock AIME 2024-2025—56.1%
Omni-MATH16.3%—
LMArena Math1184—
MATH Level 524.2%—

Knowledge Qwen3 8B leads

Mixtral 8x22B: 15.1 (#293), Qwen3 8B: 36.1 (#173)

BenchmarkMixtral 8x22BQwen3 8B
GPQA Diamond34.1%56.8%
MMLU-Pro46%—
Vectara Hallucination Rate—4.8%
GPQA (HELM)33.4%—
LMArena Expert1113—
MMLU77.8%—

Multilingual Not comparable

Mixtral 8x22B: 32.8 (#255), Qwen3 8B: —

BenchmarkMixtral 8x22BQwen3 8B
LMArena Non-English1128—
LMArena Chinese1116—
LMArena French1166—
LMArena German1141—
LMArena Japanese1037—
LMArena Korean1057—
LMArena Russian1158—
LMArena Spanish1151—

Instruction Following Not comparable

Mixtral 8x22B: 57.7 (#266), Qwen3 8B: —

BenchmarkMixtral 8x22BQwen3 8B
IFEval72.4%—
LMArena Instruction Following1147—

Long Context Qwen3 8B leads

Mixtral 8x22B: 34.7 (#247), Qwen3 8B: 37.9 (#210)

BenchmarkMixtral 8x22BQwen3 8B
Fiction.LiveBench—62.1%
LMArena Longer Query1144—

Writing & Preference Not comparable

Mixtral 8x22B: 36.9 (#262), Qwen3 8B: —

BenchmarkMixtral 8x22BQwen3 8B
LMArena Text1162—
LMArena Creative Writing1141—
WildBench71.1%—
LMArena Multi-Turn1130—

Frequently asked questions

Is Mixtral 8x22B better than Qwen3 8B?

Qwen3 8B is the stronger model overall, scoring 33.7 to 27.1 on the Noometry Index.

Which is cheaper, Mixtral 8x22B or Qwen3 8B?

Qwen3 8B is cheaper. It lists at $0.18 per million input tokens and $0.70 per million output tokens; Mixtral 8x22B lists at $2 and $6.

Is Mixtral 8x22B or Qwen3 8B better for coding?

Qwen3 8B scores higher on coding benchmarks: 34.0 versus 24.2 in the Noometry coding category.

Which has the bigger context window?

Qwen3 8B does, with 131K tokens against 64K.

How many benchmarks do Mixtral 8x22B and Qwen3 8B share?

3 benchmarks have published results for both models. Mixtral 8x22B has 34 scored results on Noometry and Qwen3 8B has 11.

Related comparisons

Go deeper