Model comparison

Pixtral Large vs Qwen2.5 14B Instruct

Pixtral Large has enough public results to be ranked (#259); Qwen2.5 14B Instruct does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Pixtral Large Mistral AI

32.2

Rank #259 Reported

Summary

  • Qwen2.5 14B Instruct is cheaper at $0.35 / $1.40 per million input/output tokens, against $2 / $6 for Pixtral Large.
  • Qwen2.5 14B Instruct accepts more context: 131K tokens versus 128K.

Side by side

Pixtral Large and Qwen2.5 14B Instruct specifications
Pixtral LargeQwen2.5 14B Instruct
ProviderMistral AIAlibaba (Qwen)
Noometry Index32.238.7
Released2024-11-012024-09
WeightsOpenOpen
Context window128K131K
Max output128K8K
Input $ / M tokens$2$0.35
Output $ / M tokens$6$1.40
Results tracked33

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Pixtral Large: —, Qwen2.5 14B Instruct: 37.7 (#191)

Coding benchmarks
BenchmarkPixtral LargeQwen2.5 14B Instruct
BigCodeBench Instruct—39.8%
BigCodeBench Complete—52.2%

Reasoning Not comparable

Pixtral Large: 21.7 (#218), Qwen2.5 14B Instruct: —

Reasoning benchmarks
BenchmarkPixtral LargeQwen2.5 14B Instruct
EnigmaEval0.8%—

Knowledge Not comparable

Pixtral Large: —, Qwen2.5 14B Instruct: —

Knowledge benchmarks
BenchmarkPixtral LargeQwen2.5 14B Instruct
MMLU—79.9%

Multimodal Not comparable

Pixtral Large: 30.6 (#111), Qwen2.5 14B Instruct: —

Multimodal benchmarks
BenchmarkPixtral LargeQwen2.5 14B Instruct
LMArena Vision1089—

Writing & Preference Not comparable

Pixtral Large: 32.9 (#278), Qwen2.5 14B Instruct: —

Writing & Preference benchmarks
BenchmarkPixtral LargeQwen2.5 14B Instruct
EQ-Bench Creative Writing988—

Frequently asked questions

Is Pixtral Large better than Qwen2.5 14B Instruct?

Pixtral Large has enough public results to be ranked (#259); Qwen2.5 14B Instruct does not yet, so treat this comparison as directional.

Which is cheaper, Pixtral Large or Qwen2.5 14B Instruct?

Qwen2.5 14B Instruct is cheaper. It lists at $0.35 per million input tokens and $1.40 per million output tokens; Pixtral Large lists at $2 and $6.

Which has the bigger context window?

Qwen2.5 14B Instruct does, with 131K tokens against 128K.

How many benchmarks do Pixtral Large and Qwen2.5 14B Instruct share?

0 benchmarks have published results for both models. Pixtral Large has 3 scored results on Noometry and Qwen2.5 14B Instruct has 3.

Related comparisons

Go deeper