Noometry

Model comparison

Mistral Medium vs Qwen3.5 Max Preview

Qwen3.5 Max Preview is the stronger model overall, scoring 45.3 to 36.3 on the Noometry Index.

Last verified . 17 shared benchmarks.

Mistral Medium Mistral AI

36.3

Rank #218 Confirmed

Qwen3.5 Max Preview Alibaba (Qwen)

45.3

Rank #71 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Mistral Medium scores higher in 0 categories and Qwen3.5 Max Preview in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.5 Max Preview leads 41.8 to 25.0.
  • Mistral Medium has downloadable open weights; the other is API-only.

Side by side

Mistral MediumQwen3.5 Max Preview
ProviderMistral AIAlibaba (Qwen)
Noometry Index36.345.3
Released2023-12-11—
WeightsOpenProprietary
Context window262K—
Max output262K—
Input $ / M tokens$1.50—
Output $ / M tokens$7.50—
Results tracked3617

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5 Max Preview leads

Mistral Medium: 34.2 (#243), Qwen3.5 Max Preview: 44.0 (#77)

BenchmarkMistral MediumQwen3.5 Max Preview
LMArena Coding14341487
FrontierCode8%—
SciCode40.2%—
WeirdML43.7%—
ALE-Bench763.98—

Agentic & Tool Use Not comparable

Mistral Medium: 28.3 (#90), Qwen3.5 Max Preview: —

BenchmarkMistral MediumQwen3.5 Max Preview
Berkeley Function Calling Leaderboard37.7%—

Reasoning Qwen3.5 Max Preview leads

Mistral Medium: 24.0 (#167), Qwen3.5 Max Preview: 30.8 (#84)

BenchmarkMistral MediumQwen3.5 Max Preview
LMArena Hard Prompts14261483
Kagi LLM Benchmark50%—
CritPt0%—
DTBench75.5%—
LMCA26.1%—
Surface Evolver Bench26.9%—

Math Qwen3.5 Max Preview leads

Mistral Medium: 28.1 (#245), Qwen3.5 Max Preview: 40.1 (#94)

BenchmarkMistral MediumQwen3.5 Max Preview
LMArena Math14081474
OTIS Mock AIME 2024-202532.2%—
ProofBench9%—
MATH Level 581.6%—
FrontierMath (Feb 2025 set)0.3%—

Knowledge Qwen3.5 Max Preview leads

Mistral Medium: 25.0 (#265), Qwen3.5 Max Preview: 41.8 (#107)

BenchmarkMistral MediumQwen3.5 Max Preview
LMArena Expert14081489
GPQA Diamond59.5%—
Humanity's Last Exam4.5%—
Vectara Hallucination Rate22.7%—

Multimodal Not comparable

Mistral Medium: 35.3 (#88), Qwen3.5 Max Preview: —

BenchmarkMistral MediumQwen3.5 Max Preview
LMArena Vision1172—

Multilingual Qwen3.5 Max Preview leads

Mistral Medium: 52.1 (#91), Qwen3.5 Max Preview: 56.2 (#22)

BenchmarkMistral MediumQwen3.5 Max Preview
LMArena Non-English14081465
LMArena Chinese14471534
LMArena French14591484
LMArena German14321487
LMArena Japanese13781495
LMArena Korean13801438
LMArena Russian14111471
LMArena Spanish14331470

Instruction Following Qwen3.5 Max Preview leads

Mistral Medium: 73.7 (#116), Qwen3.5 Max Preview: 77.0 (#31)

BenchmarkMistral MediumQwen3.5 Max Preview
LMArena Instruction Following13981467

Long Context Qwen3.5 Max Preview leads

Mistral Medium: 42.9 (#114), Qwen3.5 Max Preview: 45.2 (#45)

BenchmarkMistral MediumQwen3.5 Max Preview
LMArena Longer Query14061476

Writing & Preference Qwen3.5 Max Preview leads

Mistral Medium: 60.0 (#103), Qwen3.5 Max Preview: 66.0 (#41)

BenchmarkMistral MediumQwen3.5 Max Preview
LMArena Text14241470
LMArena Creative Writing13911464
LMArena Multi-Turn14181478
Short-Story Creative Writing77.3%—

Frequently asked questions

Is Mistral Medium better than Qwen3.5 Max Preview?

Qwen3.5 Max Preview is the stronger model overall, scoring 45.3 to 36.3 on the Noometry Index.

Is Mistral Medium or Qwen3.5 Max Preview better for coding?

Qwen3.5 Max Preview scores higher on coding benchmarks: 44.0 versus 34.2 in the Noometry coding category.

How many benchmarks do Mistral Medium and Qwen3.5 Max Preview share?

17 benchmarks have published results for both models. Mistral Medium has 36 scored results on Noometry and Qwen3.5 Max Preview has 17.

Related comparisons

Go deeper