Model comparison

Mistral Medium 3.1 vs Qwen2.5 Plus 1127

Qwen2.5 Plus 1127 is the stronger model overall, scoring 38.8 to 31.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Mistral Medium 3.1 Mistral AI

31.9

Rank #266 Reported

Qwen2.5 Plus 1127 Alibaba (Qwen)

38.8

Rank #181 Confirmed

Summary

  • The widest gap is in reasoning, where Qwen2.5 Plus 1127 leads 25.9 to 10.6.

Side by side

Mistral Medium 3.1 and Qwen2.5 Plus 1127 specifications
Mistral Medium 3.1Qwen2.5 Plus 1127
ProviderMistral AIAlibaba (Qwen)
Noometry Index31.938.8
Released——
WeightsProprietaryProprietary
Context window131K—
Max output105K—
Input $ / M tokens$0.40—
Output $ / M tokens$2—
Results tracked314

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Medium 3.1: —, Qwen2.5 Plus 1127: 38.5 (#175)

Coding benchmarks
BenchmarkMistral Medium 3.1Qwen2.5 Plus 1127
LMArena Coding—1314

Reasoning Qwen2.5 Plus 1127 leads

Mistral Medium 3.1: 10.6 (#341), Qwen2.5 Plus 1127: 25.9 (#141)

Reasoning benchmarks
BenchmarkMistral Medium 3.1Qwen2.5 Plus 1127
NYT Connections (extended)6.5%—
Thematic Generalization20.3%—
LMArena Hard Prompts—1299

Math Not comparable

Mistral Medium 3.1: —, Qwen2.5 Plus 1127: 36.1 (#174)

Math benchmarks
BenchmarkMistral Medium 3.1Qwen2.5 Plus 1127
LMArena Math—1298

Knowledge Not comparable

Mistral Medium 3.1: —, Qwen2.5 Plus 1127: 35.5 (#183)

Knowledge benchmarks
BenchmarkMistral Medium 3.1Qwen2.5 Plus 1127
LMArena Expert—1289

Multilingual Not comparable

Mistral Medium 3.1: —, Qwen2.5 Plus 1127: 41.9 (#201)

Multilingual benchmarks
BenchmarkMistral Medium 3.1Qwen2.5 Plus 1127
LMArena Non-English—1265
LMArena Chinese—1314
LMArena German—1231
LMArena Japanese—1207
LMArena Russian—1271

Instruction Following Not comparable

Mistral Medium 3.1: —, Qwen2.5 Plus 1127: 67.2 (#199)

Instruction Following benchmarks
BenchmarkMistral Medium 3.1Qwen2.5 Plus 1127
LMArena Instruction Following—1275

Long Context Not comparable

Mistral Medium 3.1: —, Qwen2.5 Plus 1127: 39.2 (#184)

Long Context benchmarks
BenchmarkMistral Medium 3.1Qwen2.5 Plus 1127
LMArena Longer Query—1292

Writing & Preference Mistral Medium 3.1 leads

Mistral Medium 3.1: 55.5 (#145), Qwen2.5 Plus 1127: 49.4 (#192)

Writing & Preference benchmarks
BenchmarkMistral Medium 3.1Qwen2.5 Plus 1127
LMArena Text—1299
LMArena Creative Writing—1262
EQ-Bench Creative Writing1476—
LMArena Multi-Turn—1299

Frequently asked questions

Is Mistral Medium 3.1 better than Qwen2.5 Plus 1127?

Qwen2.5 Plus 1127 is the stronger model overall, scoring 38.8 to 31.9 on the Noometry Index.

How many benchmarks do Mistral Medium 3.1 and Qwen2.5 Plus 1127 share?

0 benchmarks have published results for both models. Mistral Medium 3.1 has 3 scored results on Noometry and Qwen2.5 Plus 1127 has 14.

Related comparisons

Go deeper