Model comparison

Mistral Medium 3.5 vs Qwen3.7 Max

Qwen3.7 Max is the stronger model overall, scoring 51.4 to 39.6 on the Noometry Index.

Last verified . 16 shared benchmarks.

Mistral Medium 3.5 Mistral AI

39.6

Rank #151 Confirmed

Qwen3.7 Max Alibaba (Qwen)

51.4

Rank #35 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Mistral Medium 3.5 scores higher in 0 categories and Qwen3.7 Max in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Qwen3.7 Max leads 48.4 to 16.6.
  • The biggest single-benchmark swing is NYT Connections (extended): 12.9% for Mistral Medium 3.5 and 85.1% for Qwen3.7 Max.
  • Mistral Medium 3.5 is cheaper at $1.50 / $7.50 per million input/output tokens, against $2.50 / $7.50 for Qwen3.7 Max.
  • Qwen3.7 Max accepts more context: 1M tokens versus 262K.
  • Mistral Medium 3.5 has downloadable open weights; the other is API-only.

Side by side

Mistral Medium 3.5 and Qwen3.7 Max specifications
Mistral Medium 3.5Qwen3.7 Max
ProviderMistral AIAlibaba (Qwen)
Noometry Index39.651.4
Released—2026-05-19
WeightsOpenProprietary
Context window262K1M
Max output210K131K
Input $ / M tokens$1.50$2.50
Output $ / M tokens$7.50$7.50
Results tracked2233

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.7 Max leads

Mistral Medium 3.5: 35.7 (#208), Qwen3.7 Max: 50.2 (#43)

Coding benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Max
LMArena WebDev12631515
LMArena Coding14611498
SWE-bench Verified—77.3%
SciCode—48.8%
ALE-Bench—1,189

Agentic & Tool Use Not comparable

Mistral Medium 3.5: —, Qwen3.7 Max: 21.8 (#129)

Agentic & Tool Use benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Max
GBAEval—0.4%

Reasoning Qwen3.7 Max leads

Mistral Medium 3.5: 16.6 (#290), Qwen3.7 Max: 48.4 (#36)

Reasoning benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Max
NYT Connections (extended)12.9%85.1%
LMArena Hard Prompts14361483
Epoch Capabilities Index141.42153.74
SimpleBench—70.4%
Kagi LLM Benchmark41.4%—
CritPt—13.4%
Chess Puzzles—19%
EBR-Bench—9.5%
Mystery Game Puzzles—32%
DTBench—92.3%
LMCA—44%

Math Qwen3.7 Max leads

Mistral Medium 3.5: 36.4 (#113), Qwen3.7 Max: 62.3 (#26)

Math benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Max
LMArena Math14321488
FrontierMath (Tiers 1-3)—64.6%
FrontierMath Tier 4—34.1%
OTIS Mock AIME 2024-2025—95.6%
ProofBench—26%

Knowledge Qwen3.7 Max leads

Mistral Medium 3.5: 39.3 (#123), Qwen3.7 Max: 61.7 (#24)

Knowledge benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Max
LMArena Expert14311488
GPQA Diamond—90.9%
SimpleQA Verified—55.8%

Multimodal Not comparable

Mistral Medium 3.5: 37.6 (#64), Qwen3.7 Max: —

Multimodal benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Max
LMArena Vision1222—

Multilingual Qwen3.7 Max leads

Mistral Medium 3.5: 52.1 (#93), Qwen3.7 Max: 57.1 (#13)

Multilingual benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Max
LMArena Non-English14051475
LMArena Chinese14431533
LMArena Russian13961482
LMArena French1448—
LMArena German1453—
LMArena Korean1387—
LMArena Spanish1406—

Instruction Following Qwen3.7 Max leads

Mistral Medium 3.5: 74.7 (#87), Qwen3.7 Max: 76.9 (#34)

Instruction Following benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Max
LMArena Instruction Following14141460

Long Context Qwen3.7 Max leads

Mistral Medium 3.5: 43.2 (#101), Qwen3.7 Max: 45.4 (#34)

Long Context benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Max
LMArena Longer Query14141484

Writing & Preference Qwen3.7 Max leads

Mistral Medium 3.5: 58.6 (#113), Qwen3.7 Max: 65.2 (#52)

Writing & Preference benchmarks
BenchmarkMistral Medium 3.5Qwen3.7 Max
LMArena Text14211476
LMArena Creative Writing13721450
EQ-Bench 49931110
LMArena Multi-Turn14231482

Frequently asked questions

Is Mistral Medium 3.5 better than Qwen3.7 Max?

Qwen3.7 Max is the stronger model overall, scoring 51.4 to 39.6 on the Noometry Index.

Which is cheaper, Mistral Medium 3.5 or Qwen3.7 Max?

Mistral Medium 3.5 is cheaper. It lists at $1.50 per million input tokens and $7.50 per million output tokens; Qwen3.7 Max lists at $2.50 and $7.50.

Is Mistral Medium 3.5 or Qwen3.7 Max better for coding?

Qwen3.7 Max scores higher on coding benchmarks: 50.2 versus 35.7 in the Noometry coding category.

Which has the bigger context window?

Qwen3.7 Max does, with 1M tokens against 262K.

How many benchmarks do Mistral Medium 3.5 and Qwen3.7 Max share?

16 benchmarks have published results for both models. Mistral Medium 3.5 has 22 scored results on Noometry and Qwen3.7 Max has 33.

Related comparisons

Go deeper