Model comparison

Mistral vs Qwen Turbo

Mistral is the stronger model overall, scoring 29.9 to 27.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Mistral Mistral AI

29.9

Rank #303 Confirmed

Qwen Turbo Alibaba (Qwen)

27.1

Rank #335 Reported

Summary

  • The widest gap is in math, where Mistral leads 22.3 to 15.3.

Side by side

Mistral and Qwen Turbo specifications
MistralQwen Turbo
ProviderMistral AIAlibaba (Qwen)
Noometry Index29.927.1
Released—2024-11-01
WeightsProprietaryProprietary
Context window—1M
Max output—16K
Input $ / M tokens—$0.05
Output $ / M tokens—$0.20
Results tracked223

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral: 33.8 (#250), Qwen Turbo: —

Coding benchmarks
BenchmarkMistralQwen Turbo
LMArena Coding1162—

Reasoning Not comparable

Mistral: 22.2 (#200), Qwen Turbo: —

Reasoning benchmarks
BenchmarkMistralQwen Turbo
LMArena Hard Prompts1149—

Math Mistral leads

Mistral: 22.3 (#278), Qwen Turbo: 15.3 (#297)

Math benchmarks
BenchmarkMistralQwen Turbo
OTIS Mock AIME 2024-2025—6.1%
Omni-MATH7.2%—
LMArena Math1180—
MATH Level 5—56.2%

Knowledge Qwen Turbo leads

Mistral: 16.6 (#288), Qwen Turbo: 22.2 (#272)

Knowledge benchmarks
BenchmarkMistralQwen Turbo
GPQA Diamond—41.8%
MMLU-Pro27.7%—
GPQA (HELM)30.3%—
LMArena Expert1125—

Multilingual Not comparable

Mistral: 32.8 (#254), Qwen Turbo: —

Multilingual benchmarks
BenchmarkMistralQwen Turbo
LMArena Non-English1129—
LMArena Chinese1109—
LMArena French1180—
LMArena German1155—
LMArena Japanese1013—
LMArena Korean1032—
LMArena Russian1168—
LMArena Spanish1143—

Instruction Following Not comparable

Mistral: 52.6 (#288), Qwen Turbo: —

Instruction Following benchmarks
BenchmarkMistralQwen Turbo
IFEval56.8%—
LMArena Instruction Following1152—

Long Context Not comparable

Mistral: 35.0 (#245), Qwen Turbo: —

Long Context benchmarks
BenchmarkMistralQwen Turbo
LMArena Longer Query1153—

Writing & Preference Not comparable

Mistral: 37.0 (#260), Qwen Turbo: —

Writing & Preference benchmarks
BenchmarkMistralQwen Turbo
LMArena Text1165—
LMArena Creative Writing1158—
WildBench66%—
LMArena Multi-Turn1147—

Frequently asked questions

Is Mistral better than Qwen Turbo?

Mistral is the stronger model overall, scoring 29.9 to 27.1 on the Noometry Index.

How many benchmarks do Mistral and Qwen Turbo share?

0 benchmarks have published results for both models. Mistral has 22 scored results on Noometry and Qwen Turbo has 3.

Related comparisons

Go deeper