Noometry

Model comparison

Mistral Small 3.1 vs Qwen Plus

Qwen Plus is the stronger model overall, scoring 36.7 to 31.4 on the Noometry Index.

Last verified . 15 shared benchmarks.

Mistral Small 3.1 Mistral AI

31.4

Rank #263 Confirmed

Qwen Plus Alibaba (Qwen)

36.7

Rank #204 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Mistral Small 3.1 scores higher in 0 categories and Qwen Plus in 8 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen Plus leads 52.4 to 37.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 3.9% for Mistral Small 3.1 and 17.8% for Qwen Plus.
  • Mistral Small 3.1 is cheaper at $0.35 / $0.56 per million input/output tokens, against $0.40 / $1.20 for Qwen Plus.
  • Qwen Plus accepts more context: 1M tokens versus 128K.
  • Mistral Small 3.1 has downloadable open weights; the other is API-only.

Side by side

Mistral Small 3.1Qwen Plus
ProviderMistral AIAlibaba (Qwen)
Noometry Index31.436.7
Released2025-03-172024-01-25
WeightsOpenProprietary
Context window128K1M
Max output102K33K
Input $ / M tokens$0.35$0.40
Output $ / M tokens$0.56$1.20
Results tracked2820

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Mistral Small 3.1: 37.7 (#175), Qwen Plus: 38.3 (#163)

BenchmarkMistral Small 3.1Qwen Plus
LMArena Coding13091328

Reasoning Qwen Plus leads

Mistral Small 3.1: 18.9 (#249), Qwen Plus: 27.6 (#101)

BenchmarkMistral Small 3.1Qwen Plus
LMArena Hard Prompts12781317
Kagi LLM Benchmark—63.3%
Chess Puzzles1%—
DTBench—81.1%
LMCA—24%
Epoch Capabilities Index127.48—

Math Qwen Plus leads

Mistral Small 3.1: 13.7 (#295), Qwen Plus: 22.0 (#266)

BenchmarkMistral Small 3.1Qwen Plus
OTIS Mock AIME 2024-20253.9%17.8%
LMArena Math12611326
Omni-MATH24.8%—
MATH Level 5—65.3%
FrontierMath (Feb 2025 set)—1.7%

Knowledge Qwen Plus leads

Mistral Small 3.1: 22.6 (#266), Qwen Plus: 27.4 (#245)

BenchmarkMistral Small 3.1Qwen Plus
GPQA Diamond41.9%48.1%
LMArena Expert12581328
MMLU-Pro61%—
GPQA (HELM)39.2%—

Multimodal Not comparable

Mistral Small 3.1: 32.6 (#93), Qwen Plus: —

BenchmarkMistral Small 3.1Qwen Plus
LMArena Vision1136—

Multilingual Qwen Plus leads

Mistral Small 3.1: 41.4 (#204), Qwen Plus: 45.3 (#170)

BenchmarkMistral Small 3.1Qwen Plus
LMArena Non-English12551310
LMArena Chinese12541347
LMArena Japanese12101251
LMArena Russian12631323
LMArena French1270—
LMArena German1266—
LMArena Korean1206—
LMArena Spanish1283—

Instruction Following Qwen Plus leads

Mistral Small 3.1: 63.8 (#225), Qwen Plus: 69.0 (#176)

BenchmarkMistral Small 3.1Qwen Plus
LMArena Instruction Following12641303
IFEval75%—

Long Context Too close to call

Mistral Small 3.1: 39.5 (#172), Qwen Plus: 40.3 (#153)

BenchmarkMistral Small 3.1Qwen Plus
LMArena Longer Query13001325

Writing & Preference Qwen Plus leads

Mistral Small 3.1: 37.2 (#254), Qwen Plus: 52.4 (#171)

BenchmarkMistral Small 3.1Qwen Plus
LMArena Text12781326
LMArena Creative Writing12531293
LMArena Multi-Turn12701336
EQ-Bench Creative Writing761—
WildBench78.8%—

Frequently asked questions

Is Mistral Small 3.1 better than Qwen Plus?

Qwen Plus is the stronger model overall, scoring 36.7 to 31.4 on the Noometry Index.

Which is cheaper, Mistral Small 3.1 or Qwen Plus?

Mistral Small 3.1 is cheaper. It lists at $0.35 per million input tokens and $0.56 per million output tokens; Qwen Plus lists at $0.40 and $1.20.

Is Mistral Small 3.1 or Qwen Plus better for coding?

They score almost the same on coding (37.7 vs 38.3); test both on your own repository before choosing.

Which has the bigger context window?

Qwen Plus does, with 1M tokens against 128K.

How many benchmarks do Mistral Small 3.1 and Qwen Plus share?

15 benchmarks have published results for both models. Mistral Small 3.1 has 28 scored results on Noometry and Qwen Plus has 20.

Related comparisons

Go deeper