Model comparison

DeepSeek-R1 vs Magistral Medium

DeepSeek-R1 is the stronger model overall, scoring 42.3 to 35.2 on the Noometry Index.

Last verified . 22 shared benchmarks.

DeepSeek-R1 DeepSeek

42.3

Rank #115 Confirmed

Magistral Medium Mistral AI

35.2

Rank #227 Confirmed

Summary

  • They share 22 benchmarks with published results for both. DeepSeek-R1 scores higher in 8 categories and Magistral Medium in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where DeepSeek-R1 leads 61.4 to 46.3.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 69.4% for DeepSeek-R1 and 16.2% for Magistral Medium.
  • DeepSeek-R1 is cheaper at $0.50 / $2.15 per million input/output tokens, against $2 / $5 for Magistral Medium.
  • Magistral Medium accepts more context: 262K tokens versus 164K.
  • Magistral Medium has downloadable open weights; the other is API-only.

Side by side

DeepSeek-R1 and Magistral Medium specifications
DeepSeek-R1Magistral Medium
ProviderDeepSeekMistral AI
Noometry Index42.335.2
Released2025-01-202025-03-17
WeightsProprietaryOpen
Context window164K262K
Max output64K16K
Input $ / M tokens$0.50$2
Output $ / M tokens$2.15$5
Results tracked5222

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek-R1 leads

DeepSeek-R1: 46.3 (#68), Magistral Medium: 39.1 (#161)

Coding benchmarks
BenchmarkDeepSeek-R1Magistral Medium
SciCode35.7%39.2%
LMArena Coding14271319
Aider Polyglot71.4%—
WeirdML41.6%—
LiveBench Coding66.7%—
ALE-Bench804.12—
AlgoTune1.7—

Agentic & Tool Use Not comparable

DeepSeek-R1: 30.7 (#75), Magistral Medium: —

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-R1Magistral Medium
DeepResearch Bench35.1%—
BALROG34.9%—
METR Time Horizons53.8%—

Reasoning DeepSeek-R1 leads

DeepSeek-R1: 18.6 (#278), Magistral Medium: 8.6 (#348)

Reasoning benchmarks
BenchmarkDeepSeek-R1Magistral Medium
ARC-AGI-21.3%0%
Kagi LLM Benchmark69.4%16.2%
ARC-AGI-121.2%6.1%
CritPt1.1%0.3%
LMArena Hard Prompts14161267
SimpleBench40.8%—
LiveBench Reasoning83.2%—
LiveBench Data Analysis69.8%—
Epoch Capabilities Index141.29—
ForecastBench60—
LiveBench71.6%—

Math DeepSeek-R1 leads

DeepSeek-R1: 43.8 (#79), Magistral Medium: 35.1 (#189)

Math benchmarks
BenchmarkDeepSeek-R1Magistral Medium
LMArena Math14001250
OTIS Mock AIME 2024-202566.4%—
Omni-MATH42.4%—
LiveBench Math80.7%—
MATH Level 596.6%—

Knowledge DeepSeek-R1 leads

DeepSeek-R1: 44.5 (#87), Magistral Medium: 33.5 (#202)

Knowledge benchmarks
BenchmarkDeepSeek-R1Magistral Medium
LMArena Expert13941223
GPQA Diamond76.3%—
MMLU-Pro79.3%—
Confabulations12.7%—
Vectara Hallucination Rate11.3%—
GPQA (HELM)66.6%—

Multilingual DeepSeek-R1 leads

DeepSeek-R1: 52.4 (#85), Magistral Medium: 39.6 (#224)

Multilingual benchmarks
BenchmarkDeepSeek-R1Magistral Medium
LMArena Non-English14121232
LMArena Chinese14421227
LMArena French14171267
LMArena German14041248
LMArena Japanese13911175
LMArena Korean13601125
LMArena Russian14231224
LMArena Spanish14111271

Instruction Following DeepSeek-R1 leads

DeepSeek-R1: 72.0 (#143), Magistral Medium: 66.0 (#211)

Instruction Following benchmarks
BenchmarkDeepSeek-R1Magistral Medium
LMArena Instruction Following13821254
LiveBench Instruction Following80.5%—
IFEval78.4%—

Long Context DeepSeek-R1 leads

DeepSeek-R1: 45.4 (#36), Magistral Medium: 39.3 (#183)

Long Context benchmarks
BenchmarkDeepSeek-R1Magistral Medium
LMArena Longer Query13911295
Fiction.LiveBench75%—

Writing & Preference DeepSeek-R1 leads

DeepSeek-R1: 61.4 (#88), Magistral Medium: 46.3 (#219)

Writing & Preference benchmarks
BenchmarkDeepSeek-R1Magistral Medium
LMArena Text14281255
LMArena Creative Writing14051245
LMArena Multi-Turn14051275
Short-Story Creative Writing83%—
EQ-Bench Creative Writing1500—
WildBench82.8%—
LiveBench Language48.5%—

Frequently asked questions

Is DeepSeek-R1 better than Magistral Medium?

DeepSeek-R1 is the stronger model overall, scoring 42.3 to 35.2 on the Noometry Index.

Which is cheaper, DeepSeek-R1 or Magistral Medium?

DeepSeek-R1 is cheaper. It lists at $0.50 per million input tokens and $2.15 per million output tokens; Magistral Medium lists at $2 and $5.

Is DeepSeek-R1 or Magistral Medium better for coding?

DeepSeek-R1 scores higher on coding benchmarks: 46.3 versus 39.1 in the Noometry coding category.

Which has the bigger context window?

Magistral Medium does, with 262K tokens against 164K.

How many benchmarks do DeepSeek-R1 and Magistral Medium share?

22 benchmarks have published results for both models. DeepSeek-R1 has 52 scored results on Noometry and Magistral Medium has 22.

Related comparisons

Go deeper