Noometry

Model comparison

DeepSeek LLM 67B vs Magistral Small

Magistral Small is the stronger model overall, scoring 30.2 to 24.9 on the Noometry Index.

Last verified . 4 shared benchmarks.

DeepSeek LLM 67B DeepSeek

24.9

Rank #347 Confirmed

Magistral Small Mistral AI

30.2

Rank #296 Confirmed

Summary

  • They share 4 benchmarks with published results for both. DeepSeek LLM 67B scores higher in 1 category and Magistral Small in 3 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Magistral Small leads 30.9 to 7.0.
  • The biggest single-benchmark swing is GPQA Diamond: 24.6% for DeepSeek LLM 67B and 56.1% for Magistral Small.

Side by side

DeepSeek LLM 67BMagistral Small
ProviderDeepSeekMistral AI
Noometry Index24.930.2
Released2023-11-292025-06-10
WeightsOpenOpen
Context window—128K
Max output—40K
Input $ / M tokens—$0.50
Output $ / M tokens—$1.50
Results tracked1510

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Magistral Small leads

DeepSeek LLM 67B: 31.9 (#278), Magistral Small: 38.4 (#176)

BenchmarkDeepSeek LLM 67BMagistral Small
SciCode—35.2%
LMArena Coding1096—

Reasoning DeepSeek LLM 67B leads

DeepSeek LLM 67B: 16.5 (#304), Magistral Small: 6.8 (#350)

BenchmarkDeepSeek LLM 67BMagistral Small
Chess Puzzles0%3%
Epoch Capabilities Index110.5133.19
ARC-AGI-2—0%
Kagi LLM Benchmark—6.3%
ARC-AGI-1—5%
CritPt—0.3%
LMArena Hard Prompts1070—
DTBench—61.3%

Math Magistral Small leads

DeepSeek LLM 67B: 8.7 (#324), Magistral Small: 26.2 (#261)

BenchmarkDeepSeek LLM 67BMagistral Small
OTIS Mock AIME 2024-20250.8%30%
LMArena Math1108—
MATH Level 56.4%—

Knowledge Magistral Small leads

DeepSeek LLM 67B: 7.0 (#313), Magistral Small: 30.9 (#223)

BenchmarkDeepSeek LLM 67BMagistral Small
GPQA Diamond24.6%56.1%

Multilingual Not comparable

DeepSeek LLM 67B: 29.4 (#267), Magistral Small: —

BenchmarkDeepSeek LLM 67BMagistral Small
LMArena Non-English1073—
LMArena Chinese1132—

Instruction Following Not comparable

DeepSeek LLM 67B: 55.4 (#277), Magistral Small: —

BenchmarkDeepSeek LLM 67BMagistral Small
LMArena Instruction Following1079—

Long Context Not comparable

DeepSeek LLM 67B: 33.1 (#265), Magistral Small: —

BenchmarkDeepSeek LLM 67BMagistral Small
LMArena Longer Query1092—

Writing & Preference Not comparable

DeepSeek LLM 67B: 31.6 (#282), Magistral Small: —

BenchmarkDeepSeek LLM 67BMagistral Small
LMArena Text1105—
LMArena Creative Writing1067—
LMArena Multi-Turn1082—

Frequently asked questions

Is DeepSeek LLM 67B better than Magistral Small?

Magistral Small is the stronger model overall, scoring 30.2 to 24.9 on the Noometry Index.

Is DeepSeek LLM 67B or Magistral Small better for coding?

Magistral Small scores higher on coding benchmarks: 38.4 versus 31.9 in the Noometry coding category.

How many benchmarks do DeepSeek LLM 67B and Magistral Small share?

4 benchmarks have published results for both models. DeepSeek LLM 67B has 15 scored results on Noometry and Magistral Small has 10.

Related comparisons

Go deeper