Noometry

Model comparison

Magistral Medium vs Qwen3 Max

Qwen3 Max is the stronger model overall, scoring 43.7 to 35.2 on the Noometry Index.

Last verified . 18 shared benchmarks.

Magistral Medium Mistral AI

35.2

Rank #227 Confirmed

Qwen3 Max Alibaba (Qwen)

43.7

Rank #87 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Magistral Medium scores higher in 0 categories and Qwen3 Max in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3 Max leads 62.4 to 46.3.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 16.2% for Magistral Medium and 72.5% for Qwen3 Max.
  • Qwen3 Max is cheaper at $1.20 / $6 per million input/output tokens, against $2 / $5 for Magistral Medium.
  • Magistral Medium has downloadable open weights; the other is API-only.

Side by side

Magistral MediumQwen3 Max
ProviderMistral AIAlibaba (Qwen)
Noometry Index35.243.7
Released2025-03-172025-09-23
WeightsOpenProprietary
Context window262K262K
Max output16K66K
Input $ / M tokens$2$1.20
Output $ / M tokens$5$6
Results tracked2233

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3 Max leads

Magistral Medium: 39.1 (#161), Qwen3 Max: 43.0 (#93)

BenchmarkMagistral MediumQwen3 Max
LMArena Coding13191456
SciCode39.2%—
ALE-Bench—370.45

Agentic & Tool Use Not comparable

Magistral Medium: —, Qwen3 Max: —

BenchmarkMagistral MediumQwen3 Max
Vending-Bench 2—71.56

Reasoning Qwen3 Max leads

Magistral Medium: 8.6 (#348), Qwen3 Max: 22.6 (#190)

BenchmarkMagistral MediumQwen3 Max
Kagi LLM Benchmark16.2%72.5%
LMArena Hard Prompts12671448
ARC-AGI-20%—
NYT Connections (extended)—30.1%
ARC-AGI-16.1%—
CritPt0.3%—
Chess Puzzles—4%
Mystery Game Puzzles—5%
DTBench—82.1%
LMCA—28.3%
Epoch Capabilities Index—142.38

Math Qwen3 Max leads

Magistral Medium: 35.1 (#189), Qwen3 Max: 38.7 (#131)

BenchmarkMagistral MediumQwen3 Max
LMArena Math12501446
FrontierMath (Tiers 1-3)—18.9%
OTIS Mock AIME 2024-2025—73.3%
MATH Level 5—97.1%

Knowledge Qwen3 Max leads

Magistral Medium: 33.5 (#202), Qwen3 Max: 48.1 (#78)

BenchmarkMagistral MediumQwen3 Max
LMArena Expert12231455
GPQA Diamond—72.6%
SimpleQA Verified—48.7%

Multilingual Qwen3 Max leads

Magistral Medium: 39.6 (#224), Qwen3 Max: 53.7 (#62)

BenchmarkMagistral MediumQwen3 Max
LMArena Non-English12321429
LMArena Chinese12271478
LMArena French12671449
LMArena German12481463
LMArena Japanese11751397
LMArena Korean11251399
LMArena Russian12241428
LMArena Spanish12711462

Instruction Following Qwen3 Max leads

Magistral Medium: 66.0 (#211), Qwen3 Max: 74.8 (#87)

BenchmarkMagistral MediumQwen3 Max
LMArena Instruction Following12541419

Long Context Qwen3 Max leads

Magistral Medium: 39.3 (#183), Qwen3 Max: 41.6 (#134)

BenchmarkMagistral MediumQwen3 Max
LMArena Longer Query12951438
Fiction.LiveBench—66.7%
CL-bench—14.5%

Writing & Preference Qwen3 Max leads

Magistral Medium: 46.3 (#219), Qwen3 Max: 62.4 (#76)

BenchmarkMagistral MediumQwen3 Max
LMArena Text12551439
LMArena Creative Writing12451402
LMArena Multi-Turn12751446

Frequently asked questions

Is Magistral Medium better than Qwen3 Max?

Qwen3 Max is the stronger model overall, scoring 43.7 to 35.2 on the Noometry Index.

Which is cheaper, Magistral Medium or Qwen3 Max?

Qwen3 Max is cheaper. It lists at $1.20 per million input tokens and $6 per million output tokens; Magistral Medium lists at $2 and $5.

Is Magistral Medium or Qwen3 Max better for coding?

Qwen3 Max scores higher on coding benchmarks: 43.0 versus 39.1 in the Noometry coding category.

Which has the bigger context window?

Both accept 262K tokens.

How many benchmarks do Magistral Medium and Qwen3 Max share?

18 benchmarks have published results for both models. Magistral Medium has 22 scored results on Noometry and Qwen3 Max has 33.

Related comparisons

Go deeper