Model comparison

Mistral Medium 3.1 vs Qwen3 8B

Qwen3 8B is the stronger model overall, scoring 33.7 to 31.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Mistral Medium 3.1 Mistral AI

31.9

Rank #266 Reported

Qwen3 8B Alibaba (Qwen)

33.7

Rank #238 Confirmed

Summary

  • The widest gap is in reasoning, where Qwen3 8B leads 16.6 to 10.6.
  • Qwen3 8B is cheaper at $0.18 / $0.70 per million input/output tokens, against $0.40 / $2 for Mistral Medium 3.1.
  • Qwen3 8B has downloadable open weights; the other is API-only.

Side by side

Mistral Medium 3.1 and Qwen3 8B specifications
Mistral Medium 3.1Qwen3 8B
ProviderMistral AIAlibaba (Qwen)
Noometry Index31.933.7
Released—2025-04
WeightsProprietaryOpen
Context window131K131K
Max output105K8K
Input $ / M tokens$0.40$0.18
Output $ / M tokens$2$0.70
Results tracked311

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Medium 3.1: —, Qwen3 8B: 34.0 (#248)

Coding benchmarks
BenchmarkMistral Medium 3.1Qwen3 8B
SciCode—22.6%

Agentic & Tool Use Not comparable

Mistral Medium 3.1: —, Qwen3 8B: 30.2 (#78)

Agentic & Tool Use benchmarks
BenchmarkMistral Medium 3.1Qwen3 8B
Berkeley Function Calling Leaderboard—42.6%

Reasoning Qwen3 8B leads

Mistral Medium 3.1: 10.6 (#341), Qwen3 8B: 16.6 (#303)

Reasoning benchmarks
BenchmarkMistral Medium 3.1Qwen3 8B
NYT Connections (extended)6.5%—
CritPt—0%
Chess Puzzles—5%
Thematic Generalization20.3%—
DTBench—59.7%
LMCA—8.8%
Epoch Capabilities Index—136.17

Math Not comparable

Mistral Medium 3.1: —, Qwen3 8B: 34.9 (#191)

Math benchmarks
BenchmarkMistral Medium 3.1Qwen3 8B
OTIS Mock AIME 2024-2025—56.1%

Knowledge Not comparable

Mistral Medium 3.1: —, Qwen3 8B: 36.1 (#173)

Knowledge benchmarks
BenchmarkMistral Medium 3.1Qwen3 8B
GPQA Diamond—56.8%
Vectara Hallucination Rate—4.8%

Long Context Not comparable

Mistral Medium 3.1: —, Qwen3 8B: 37.9 (#210)

Long Context benchmarks
BenchmarkMistral Medium 3.1Qwen3 8B
Fiction.LiveBench—62.1%

Writing & Preference Not comparable

Mistral Medium 3.1: 55.5 (#145), Qwen3 8B: —

Writing & Preference benchmarks
BenchmarkMistral Medium 3.1Qwen3 8B
EQ-Bench Creative Writing1476—

Frequently asked questions

Is Mistral Medium 3.1 better than Qwen3 8B?

Qwen3 8B is the stronger model overall, scoring 33.7 to 31.9 on the Noometry Index.

Which is cheaper, Mistral Medium 3.1 or Qwen3 8B?

Qwen3 8B is cheaper. It lists at $0.18 per million input tokens and $0.70 per million output tokens; Mistral Medium 3.1 lists at $0.40 and $2.

Which has the bigger context window?

Both accept 131K tokens.

How many benchmarks do Mistral Medium 3.1 and Qwen3 8B share?

0 benchmarks have published results for both models. Mistral Medium 3.1 has 3 scored results on Noometry and Qwen3 8B has 11.

Related comparisons

Go deeper