Model comparison

DeepSeek-V3.1 vs Mistral Large

DeepSeek-V3.1 is the stronger model overall, scoring 42.8 to 31.9 on the Noometry Index.

Last verified . 24 shared benchmarks.

DeepSeek-V3.1 DeepSeek

42.8

Rank #108 Confirmed

Mistral Large Mistral AI

31.9

Rank #263 Confirmed

Summary

  • They share 24 benchmarks with published results for both. DeepSeek-V3.1 scores higher in 7 categories and Mistral Large in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where DeepSeek-V3.1 leads 38.9 to 18.2.
  • The biggest single-benchmark swing is DTBench: 82.7% for DeepSeek-V3.1 and 65.1% for Mistral Large.
  • DeepSeek-V3.1 is cheaper at $0.25 / $0.95 per million input/output tokens, against $2 / $6 for Mistral Large.
  • DeepSeek-V3.1 accepts more context: 164K tokens versus 131K.

Side by side

DeepSeek-V3.1 and Mistral Large specifications
DeepSeek-V3.1Mistral Large
ProviderDeepSeekMistral AI
Noometry Index42.831.9
Released2025-08-212024-02-26
WeightsOpenOpen
Context window164K131K
Max output8K16K
Input $ / M tokens$0.25$2
Output $ / M tokens$0.95$6
Results tracked2751

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek-V3.1 leads

DeepSeek-V3.1: 40.3 (#144), Mistral Large: 34.3 (#240)

Coding benchmarks
BenchmarkDeepSeek-V3.1Mistral Large
LMArena Coding14171277
SciCode—36.2%
WeirdML38.4%—
BigCodeBench Instruct—30%
LiveBench Coding—47.1%
BigCodeBench Complete—38.3%
ALE-Bench—264.7
HumanEval+—62.2%
MBPP+—59.5%

Agentic & Tool Use Not comparable

DeepSeek-V3.1: —, Mistral Large: 28.6 (#89)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-V3.1Mistral Large
Berkeley Function Calling Leaderboard—38.4%

Reasoning DeepSeek-V3.1 leads

DeepSeek-V3.1: 27.9 (#110), Mistral Large: 15.8 (#310)

Reasoning benchmarks
BenchmarkDeepSeek-V3.1Mistral Large
SimpleBench40%22.5%
LMArena Hard Prompts14171257
DTBench82.7%65.1%
LMCA24.3%16.7%
Epoch Capabilities Index139.92128.52
ForecastBench5857.1
Kagi LLM Benchmark53.2%—
CritPt—0%
LiveBench Reasoning—43.5%
LiveBench Data Analysis—50.1%
LiveBench—48.4%

Math DeepSeek-V3.1 leads

DeepSeek-V3.1: 38.9 (#122), Mistral Large: 18.2 (#291)

Math benchmarks
BenchmarkDeepSeek-V3.1Mistral Large
LMArena Math14201262
OTIS Mock AIME 2024-2025—8.5%
Omni-MATH—28.1%
LiveBench Math—42.5%
MATH Level 5—50.3%
FrontierMath (Feb 2025 set)—0.3%

Knowledge DeepSeek-V3.1 leads

DeepSeek-V3.1: 43.7 (#90), Mistral Large: 30.1 (#230)

Knowledge benchmarks
BenchmarkDeepSeek-V3.1Mistral Large
Vectara Hallucination Rate5.5%4.5%
LMArena Expert14051232
GPQA Diamond—51.3%
MMLU-Pro—59.9%
Confabulations—21.4%
GPQA (HELM)—43.5%
MMLU—80%

Multilingual DeepSeek-V3.1 leads

DeepSeek-V3.1: 51.6 (#106), Mistral Large: 40.0 (#219)

Multilingual benchmarks
BenchmarkDeepSeek-V3.1Mistral Large
LMArena Non-English14001237
LMArena Chinese14691240
LMArena French14471325
LMArena German14111254
LMArena Japanese13781188
LMArena Korean13371202
LMArena Russian14051257
LMArena Spanish14311268

Instruction Following DeepSeek-V3.1 leads

DeepSeek-V3.1: 73.9 (#110), Mistral Large: 67.9 (#191)

Instruction Following benchmarks
BenchmarkDeepSeek-V3.1Mistral Large
LMArena Instruction Following14001249
LiveBench Instruction Following—67.9%
IFEval—87.7%

Long Context Mistral Large leads

DeepSeek-V3.1: 36.3 (#232), Mistral Large: 38.3 (#199)

Long Context benchmarks
BenchmarkDeepSeek-V3.1Mistral Large
LMArena Longer Query14221261
Fiction.LiveBench52.8%—

Writing & Preference DeepSeek-V3.1 leads

DeepSeek-V3.1: 60.3 (#98), Mistral Large: 40.7 (#242)

Writing & Preference benchmarks
BenchmarkDeepSeek-V3.1Mistral Large
LMArena Text14201266
LMArena Creative Writing14011243
EQ-Bench Creative Writing1436985
LMArena Multi-Turn14081260
Short-Story Creative Writing—69%
WildBench—80.1%
LiveBench Language—39.4%

Frequently asked questions

Is DeepSeek-V3.1 better than Mistral Large?

DeepSeek-V3.1 is the stronger model overall, scoring 42.8 to 31.9 on the Noometry Index.

Which is cheaper, DeepSeek-V3.1 or Mistral Large?

DeepSeek-V3.1 is cheaper. It lists at $0.25 per million input tokens and $0.95 per million output tokens; Mistral Large lists at $2 and $6.

Is DeepSeek-V3.1 or Mistral Large better for coding?

DeepSeek-V3.1 scores higher on coding benchmarks: 40.3 versus 34.3 in the Noometry coding category.

Which has the bigger context window?

DeepSeek-V3.1 does, with 164K tokens against 131K.

How many benchmarks do DeepSeek-V3.1 and Mistral Large share?

24 benchmarks have published results for both models. DeepSeek-V3.1 has 27 scored results on Noometry and Mistral Large has 51.

Related comparisons

Go deeper