Model comparison

DeepSeek-V3 vs Mistral Nemo

DeepSeek-V3 is the stronger model overall, scoring 39.5 to 26.4 on the Noometry Index. Mistral Nemo costs 2.7× less per token, which makes it the better buy when DeepSeek-V3's lead doesn't matter for your workload.

Last verified . 6 shared benchmarks.

DeepSeek-V3 DeepSeek

39.5

Rank #166 Confirmed

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Summary

  • They share 6 benchmarks with published results for both. DeepSeek-V3 scores higher in 3 categories and Mistral Nemo in 1 category; 3 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where DeepSeek-V3 leads 57.4 to 28.5.
  • The biggest single-benchmark swing is MATH Level 5: 75.5% for DeepSeek-V3 and 10.8% for Mistral Nemo.
  • Mistral Nemo is cheaper at $0.15 / $0.15 per million input/output tokens, against $0.24 / $0.90 for DeepSeek-V3.
  • DeepSeek-V3 accepts more context: 164K tokens versus 128K.

Side by side

DeepSeek-V3 and Mistral Nemo specifications
DeepSeek-V3Mistral Nemo
ProviderDeepSeekMistral AI
Noometry Index39.526.4
Released2024-12-262024-07-01
WeightsOpenOpen
Context window164K128K
Max output164K128K
Input $ / M tokens$0.24$0.15
Output $ / M tokens$0.90$0.15
Results tracked6010

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

DeepSeek-V3: 42.3 (#106), Mistral Nemo: —

Coding benchmarks
BenchmarkDeepSeek-V3Mistral Nemo
Aider Polyglot55.1%—
SciCode35.8%—
WeirdML36.1%—
BigCodeBench Instruct50%—
LiveBench Coding70.9%—
LMArena Coding1368—
BigCodeBench Complete62.2%—
HumanEval+86.6%—
MBPP+73%—

Agentic & Tool Use Not comparable

DeepSeek-V3: —, Mistral Nemo: 23.5 (#125)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-V3Mistral Nemo
Berkeley Function Calling Leaderboard—27.6%
BALROG—17.6%
METR Time Horizons49.6%—

Reasoning Too close to call

DeepSeek-V3: 20.5 (#236), Mistral Nemo: 20.7 (#232)

Reasoning benchmarks
BenchmarkDeepSeek-V3Mistral Nemo
DTBench64.8%48.6%
Epoch Capabilities Index135.94118.68
PIQA84.7%83.5%
SimpleBench27.2%—
Kagi LLM Benchmark52.3%—
CritPt0%—
LiveBench Reasoning65.8%—
LMArena Hard Prompts1365—
LiveBench Data Analysis60.9%—
LMCA15.5%—
BIG-Bench Hard87.5%—
ForecastBench59.1—
HellaSwag88.9%—
LiveBench66.9%—
WinoGrande85.2%—

Math DeepSeek-V3 leads

DeepSeek-V3: 32.1 (#219), Mistral Nemo: 25.5 (#268)

Math benchmarks
BenchmarkDeepSeek-V3Mistral Nemo
MATH Level 575.5%10.8%
OTIS Mock AIME 2024-202537.8%—
Omni-MATH40.3%—
LiveBench Math73.5%—
LMArena Math1373—
FrontierMath (Feb 2025 set)1.7%—
GSM8K—84.2%

Knowledge DeepSeek-V3 leads

DeepSeek-V3: 37.5 (#155), Mistral Nemo: 12.3 (#298)

Knowledge benchmarks
BenchmarkDeepSeek-V3Mistral Nemo
GPQA Diamond67.6%29.9%
MMLU-Pro72.3%—
Confabulations26.1%—
Vectara Hallucination Rate6.1%—
GPQA (HELM)53.8%—
LMArena Expert1351—
ARC (AI2) Challenge95.3%—
BoolQ—82.5%
MMLU87.2%—
TriviaQA82.9%—

Multilingual Not comparable

DeepSeek-V3: 48.5 (#143), Mistral Nemo: —

Multilingual benchmarks
BenchmarkDeepSeek-V3Mistral Nemo
LMArena Non-English1358—
LMArena Chinese1391—
LMArena French1385—
LMArena German1374—
LMArena Japanese1333—
LMArena Korean1319—
LMArena Russian1373—
LMArena Spanish1358—

Instruction Following Not comparable

DeepSeek-V3: 72.8 (#130), Mistral Nemo: —

Instruction Following benchmarks
BenchmarkDeepSeek-V3Mistral Nemo
LiveBench Instruction Following81.5%—
IFEval83.2%—
LMArena Instruction Following1345—

Long Context Not comparable

DeepSeek-V3: 34.0 (#253), Mistral Nemo: —

Long Context benchmarks
BenchmarkDeepSeek-V3Mistral Nemo
Fiction.LiveBench50%—
LMArena Longer Query1352—

Writing & Preference DeepSeek-V3 leads

DeepSeek-V3: 57.4 (#130), Mistral Nemo: 28.5 (#296)

Writing & Preference benchmarks
BenchmarkDeepSeek-V3Mistral Nemo
EQ-Bench Creative Writing1472881
LMArena Text1375—
LMArena Creative Writing1364—
Short-Story Creative Writing77%—
WildBench83%—
LMArena Multi-Turn1389—
LiveBench Language49.1%—

Frequently asked questions

Is DeepSeek-V3 better than Mistral Nemo?

DeepSeek-V3 is the stronger model overall, scoring 39.5 to 26.4 on the Noometry Index. Mistral Nemo costs 2.7× less per token, which makes it the better buy when DeepSeek-V3's lead doesn't matter for your workload.

Which is cheaper, DeepSeek-V3 or Mistral Nemo?

Mistral Nemo is cheaper. It lists at $0.15 per million input tokens and $0.15 per million output tokens; DeepSeek-V3 lists at $0.24 and $0.90.

Which has the bigger context window?

DeepSeek-V3 does, with 164K tokens against 128K.

How many benchmarks do DeepSeek-V3 and Mistral Nemo share?

6 benchmarks have published results for both models. DeepSeek-V3 has 60 scored results on Noometry and Mistral Nemo has 10.

Related comparisons

Go deeper