Model comparison

DeepSeek-R1 vs Mistral Nemo

DeepSeek-R1 is the stronger model overall, scoring 42.3 to 26.4 on the Noometry Index. Mistral Nemo costs 6.1× less per token, which makes it the better buy when DeepSeek-R1's lead doesn't matter for your workload.

Last verified . 5 shared benchmarks.

DeepSeek-R1 DeepSeek

42.3

Rank #115 Confirmed

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Summary

  • They share 5 benchmarks with published results for both. DeepSeek-R1 scores higher in 4 categories and Mistral Nemo in 1 category; 5 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where DeepSeek-R1 leads 61.4 to 28.5.
  • The biggest single-benchmark swing is MATH Level 5: 96.6% for DeepSeek-R1 and 10.8% for Mistral Nemo.
  • Mistral Nemo is cheaper at $0.15 / $0.15 per million input/output tokens, against $0.50 / $2.15 for DeepSeek-R1.
  • DeepSeek-R1 accepts more context: 164K tokens versus 128K.
  • Mistral Nemo has downloadable open weights; the other is API-only.

Side by side

DeepSeek-R1 and Mistral Nemo specifications
DeepSeek-R1Mistral Nemo
ProviderDeepSeekMistral AI
Noometry Index42.326.4
Released2025-01-202024-07-01
WeightsProprietaryOpen
Context window164K128K
Max output64K128K
Input $ / M tokens$0.50$0.15
Output $ / M tokens$2.15$0.15
Results tracked5210

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

DeepSeek-R1: 46.3 (#68), Mistral Nemo: —

Coding benchmarks
BenchmarkDeepSeek-R1Mistral Nemo
Aider Polyglot71.4%—
SciCode35.7%—
WeirdML41.6%—
LiveBench Coding66.7%—
LMArena Coding1427—
ALE-Bench804.12—
AlgoTune1.7—

Agentic & Tool Use DeepSeek-R1 leads

DeepSeek-R1: 30.7 (#75), Mistral Nemo: 23.5 (#125)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-R1Mistral Nemo
BALROG34.9%17.6%
Berkeley Function Calling Leaderboard—27.6%
DeepResearch Bench35.1%—
METR Time Horizons53.8%—

Reasoning Mistral Nemo leads

DeepSeek-R1: 18.6 (#278), Mistral Nemo: 20.7 (#232)

Reasoning benchmarks
BenchmarkDeepSeek-R1Mistral Nemo
Epoch Capabilities Index141.29118.68
ARC-AGI-21.3%—
SimpleBench40.8%—
Kagi LLM Benchmark69.4%—
ARC-AGI-121.2%—
CritPt1.1%—
LiveBench Reasoning83.2%—
LMArena Hard Prompts1416—
DTBench—48.6%
LiveBench Data Analysis69.8%—
ForecastBench60—
LiveBench71.6%—
PIQA—83.5%

Math DeepSeek-R1 leads

DeepSeek-R1: 43.8 (#79), Mistral Nemo: 25.5 (#268)

Math benchmarks
BenchmarkDeepSeek-R1Mistral Nemo
MATH Level 596.6%10.8%
OTIS Mock AIME 2024-202566.4%—
Omni-MATH42.4%—
LiveBench Math80.7%—
LMArena Math1400—
GSM8K—84.2%

Knowledge DeepSeek-R1 leads

DeepSeek-R1: 44.5 (#87), Mistral Nemo: 12.3 (#298)

Knowledge benchmarks
BenchmarkDeepSeek-R1Mistral Nemo
GPQA Diamond76.3%29.9%
MMLU-Pro79.3%—
Confabulations12.7%—
Vectara Hallucination Rate11.3%—
GPQA (HELM)66.6%—
LMArena Expert1394—
BoolQ—82.5%

Multilingual Not comparable

DeepSeek-R1: 52.4 (#85), Mistral Nemo: —

Multilingual benchmarks
BenchmarkDeepSeek-R1Mistral Nemo
LMArena Non-English1412—
LMArena Chinese1442—
LMArena French1417—
LMArena German1404—
LMArena Japanese1391—
LMArena Korean1360—
LMArena Russian1423—
LMArena Spanish1411—

Instruction Following Not comparable

DeepSeek-R1: 72.0 (#143), Mistral Nemo: —

Instruction Following benchmarks
BenchmarkDeepSeek-R1Mistral Nemo
LiveBench Instruction Following80.5%—
IFEval78.4%—
LMArena Instruction Following1382—

Long Context Not comparable

DeepSeek-R1: 45.4 (#36), Mistral Nemo: —

Long Context benchmarks
BenchmarkDeepSeek-R1Mistral Nemo
Fiction.LiveBench75%—
LMArena Longer Query1391—

Writing & Preference DeepSeek-R1 leads

DeepSeek-R1: 61.4 (#88), Mistral Nemo: 28.5 (#296)

Writing & Preference benchmarks
BenchmarkDeepSeek-R1Mistral Nemo
EQ-Bench Creative Writing1500881
LMArena Text1428—
LMArena Creative Writing1405—
Short-Story Creative Writing83%—
WildBench82.8%—
LMArena Multi-Turn1405—
LiveBench Language48.5%—

Frequently asked questions

Is DeepSeek-R1 better than Mistral Nemo?

DeepSeek-R1 is the stronger model overall, scoring 42.3 to 26.4 on the Noometry Index. Mistral Nemo costs 6.1× less per token, which makes it the better buy when DeepSeek-R1's lead doesn't matter for your workload.

Which is cheaper, DeepSeek-R1 or Mistral Nemo?

Mistral Nemo is cheaper. It lists at $0.15 per million input tokens and $0.15 per million output tokens; DeepSeek-R1 lists at $0.50 and $2.15.

Which has the bigger context window?

DeepSeek-R1 does, with 164K tokens against 128K.

How many benchmarks do DeepSeek-R1 and Mistral Nemo share?

5 benchmarks have published results for both models. DeepSeek-R1 has 52 scored results on Noometry and Mistral Nemo has 10.

Related comparisons

Go deeper