Model comparison

Pixtral Large vs Qwen2.5 Plus 1127

Qwen2.5 Plus 1127 is the stronger model overall, scoring 38.1 to 31.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Pixtral Large Mistral AI

31.7

Rank #257 Reported

Qwen2.5 Plus 1127 Alibaba (Qwen)

38.1

Rank #179 Confirmed

Summary

  • The widest gap is in writing & preference, where Qwen2.5 Plus 1127 leads 49.5 to 32.9.
  • Pixtral Large has downloadable open weights; the other is API-only.

Side by side

Pixtral Large and Qwen2.5 Plus 1127 specifications
Pixtral LargeQwen2.5 Plus 1127
ProviderMistral AIAlibaba (Qwen)
Noometry Index31.738.1
Released2024-11-01—
WeightsOpenProprietary
Context window128K—
Max output128K—
Input $ / M tokens$2—
Output $ / M tokens$6—
Results tracked314

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Pixtral Large: —, Qwen2.5 Plus 1127: 37.9 (#171)

Coding benchmarks
BenchmarkPixtral LargeQwen2.5 Plus 1127
LMArena Coding—1314

Reasoning Qwen2.5 Plus 1127 leads

Pixtral Large: 20.9 (#208), Qwen2.5 Plus 1127: 24.8 (#139)

Reasoning benchmarks
BenchmarkPixtral LargeQwen2.5 Plus 1127
EnigmaEval0.8%—
LMArena Hard Prompts—1299

Math Not comparable

Pixtral Large: —, Qwen2.5 Plus 1127: 33.5 (#175)

Math benchmarks
BenchmarkPixtral LargeQwen2.5 Plus 1127
LMArena Math—1298

Knowledge Not comparable

Pixtral Large: —, Qwen2.5 Plus 1127: 34.9 (#179)

Knowledge benchmarks
BenchmarkPixtral LargeQwen2.5 Plus 1127
LMArena Expert—1289

Multimodal Not comparable

Pixtral Large: 30.0 (#105), Qwen2.5 Plus 1127: —

Multimodal benchmarks
BenchmarkPixtral LargeQwen2.5 Plus 1127
LMArena Vision1089—

Multilingual Not comparable

Pixtral Large: —, Qwen2.5 Plus 1127: 42.1 (#196)

Multilingual benchmarks
BenchmarkPixtral LargeQwen2.5 Plus 1127
LMArena Non-English—1265
LMArena Chinese—1314
LMArena German—1231
LMArena Japanese—1207
LMArena Russian—1271

Instruction Following Not comparable

Pixtral Large: —, Qwen2.5 Plus 1127: 67.4 (#194)

Instruction Following benchmarks
BenchmarkPixtral LargeQwen2.5 Plus 1127
LMArena Instruction Following—1275

Long Context Not comparable

Pixtral Large: —, Qwen2.5 Plus 1127: 39.2 (#180)

Long Context benchmarks
BenchmarkPixtral LargeQwen2.5 Plus 1127
LMArena Longer Query—1292

Writing & Preference Qwen2.5 Plus 1127 leads

Pixtral Large: 32.9 (#273), Qwen2.5 Plus 1127: 49.5 (#186)

Writing & Preference benchmarks
BenchmarkPixtral LargeQwen2.5 Plus 1127
LMArena Text—1299
LMArena Creative Writing—1262
EQ-Bench Creative Writing988—
LMArena Multi-Turn—1299

Frequently asked questions

Is Pixtral Large better than Qwen2.5 Plus 1127?

Qwen2.5 Plus 1127 is the stronger model overall, scoring 38.1 to 31.7 on the Noometry Index.

How many benchmarks do Pixtral Large and Qwen2.5 Plus 1127 share?

0 benchmarks have published results for both models. Pixtral Large has 3 scored results on Noometry and Qwen2.5 Plus 1127 has 14.

Related comparisons

Go deeper