Model comparison

Mistral Medium 3.5 vs Qwen3.7 Plus

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 40.2 on the Noometry Index.

Last verified . 19 shared benchmarks.

Mistral Medium 3.5 Mistral AI

40.2

Rank #152 Confirmed

Qwen3.7 Plus Alibaba (Qwen)

45.3

Rank #72 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Mistral Medium 3.5 scores higher in 0 categories and Qwen3.7 Plus in 9 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Qwen3.7 Plus leads 39.3 to 17.3.
  • The biggest single-benchmark swing is NYT Connections (extended): 12.9% for Mistral Medium 3.5 and 74.8% for Qwen3.7 Plus.
  • Qwen3.7 Plus is cheaper at $0.40 / $1.60 per million input/output tokens, against $1.50 / $7.50 for Mistral Medium 3.5.
  • Qwen3.7 Plus accepts more context: 1M tokens versus 262K.
  • Mistral Medium 3.5 has downloadable open weights; the other is API-only.

Side by side

Mistral Medium 3.5 and Qwen3.7 Plus specifications
Mistral Medium 3.5Qwen3.7 Plus
ProviderMistral AIAlibaba (Qwen)
Noometry Index40.245.3
Released—2026-06-02
WeightsOpenProprietary
Context window262K1M
Max output210K131K
Input $ / M tokens$1.50$0.40
Output $ / M tokens$7.50$1.60
Results tracked2232

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Mistral Medium 3.5: 36.0 (#213), Qwen3.7 Plus: 36.6 (#206)

Coding benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Plus
LMArena Coding14611473
FrontierCode—10.2%
LMArena WebDev1264—
SciCode—45.5%

Agentic & Tool Use Not comparable

Mistral Medium 3.5: —, Qwen3.7 Plus: 21.4 (#138)

Agentic & Tool Use benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Plus
OSWorld 2.0—2.8%

Reasoning Qwen3.7 Plus leads

Mistral Medium 3.5: 17.3 (#295), Qwen3.7 Plus: 39.3 (#59)

Reasoning benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Plus
NYT Connections (extended)12.9%74.8%
LMArena Hard Prompts14361460
Epoch Capabilities Index141.35147.37
Kagi LLM Benchmark41.4%—
CritPt—9.1%
Chess Puzzles—24%
Mystery Game Puzzles—17%
DTBench—84%
LMCA—37.6%

Math Qwen3.7 Plus leads

Mistral Medium 3.5: 39.1 (#113), Qwen3.7 Plus: 50.5 (#56)

Math benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Plus
LMArena Math14311466
FrontierMath (Tiers 1-3)—34.4%
OTIS Mock AIME 2024-2025—93.3%

Knowledge Qwen3.7 Plus leads

Mistral Medium 3.5: 40.0 (#126), Qwen3.7 Plus: 54.9 (#51)

Knowledge benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Plus
LMArena Expert14321467
GPQA Diamond—87.9%

Multimodal Qwen3.7 Plus leads

Mistral Medium 3.5: 38.3 (#65), Qwen3.7 Plus: 41.8 (#33)

Multimodal benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Plus
LMArena Vision12231279
LMArena Document—1444

Multilingual Qwen3.7 Plus leads

Mistral Medium 3.5: 51.9 (#100), Qwen3.7 Plus: 54.8 (#38)

Multilingual benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Plus
LMArena Non-English14041445
LMArena Chinese14421510
LMArena French14481473
LMArena German14511471
LMArena Korean13851415
LMArena Russian13951457
LMArena Spanish14091457
LMArena Japanese—1413

Instruction Following Qwen3.7 Plus leads

Mistral Medium 3.5: 74.6 (#90), Qwen3.7 Plus: 75.8 (#52)

Instruction Following benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Plus
LMArena Instruction Following14151440

Long Context Qwen3.7 Plus leads

Mistral Medium 3.5: 43.2 (#103), Qwen3.7 Plus: 44.5 (#65)

Long Context benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Plus
LMArena Longer Query14151455

Writing & Preference Qwen3.7 Plus leads

Mistral Medium 3.5: 58.5 (#117), Qwen3.7 Plus: 64.3 (#56)

Writing & Preference benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Plus
LMArena Text14211455
LMArena Creative Writing13741439
LMArena Multi-Turn14231460
EQ-Bench 4993—

Frequently asked questions

Is Mistral Medium 3.5 better than Qwen3.7 Plus?

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 40.2 on the Noometry Index.

Which is cheaper, Mistral Medium 3.5 or Qwen3.7 Plus?

Qwen3.7 Plus is cheaper. It lists at $0.40 per million input tokens and $1.60 per million output tokens; Mistral Medium 3.5 lists at $1.50 and $7.50.

Is Mistral Medium 3.5 or Qwen3.7 Plus better for coding?

They score almost the same on coding (36.0 vs 36.6); test both on your own repository before choosing.

Which has the bigger context window?

Qwen3.7 Plus does, with 1M tokens against 262K.

How many benchmarks do Mistral Medium 3.5 and Qwen3.7 Plus share?

19 benchmarks have published results for both models. Mistral Medium 3.5 has 22 scored results on Noometry and Qwen3.7 Plus has 32.

Related comparisons

Go deeper