Model comparison

DeepSeek-V2 (MoE-236B, May 2024) vs Mistral 7B

Mistral 7B has enough public results to be ranked (#346); DeepSeek-V2 (MoE-236B, May 2024) does not yet, so treat this comparison as directional.

Last verified October 10, 2026. 10 shared benchmarks.

DeepSeek-V2 (MoE-236B, May 2024)

DeepSeek

39.7

Unranked Sparse

Mistral 7B

Mistral AI

22.9

Rank #346 Confirmed

Summary

They share 10 benchmarks with published results for both. DeepSeek-V2 (MoE-236B, May 2024) scores higher in 1 category and Mistral 7B in 0 categories; one gap is clear of the uncertainty.
The widest gap is in coding, where DeepSeek-V2 (MoE-236B, May 2024) leads 39.8 to 25.9.
The biggest single-benchmark swing is BigCodeBench Complete: 59.4% for DeepSeek-V2 (MoE-236B, May 2024) and 27.3% for Mistral 7B.

Side by side

DeepSeek-V2 (MoE-236B, May 2024) and Mistral 7B specifications
	DeepSeek-V2 (MoE-236B, May 2024)	Mistral 7B
Provider	DeepSeek	Mistral AI
Noometry Index	39.7	22.9
Released	2024-05-07	2023-09-27
Weights	Open	Open
Context window	—	8K
Max output	—	8K
Input $ / M tokens	—	$0.25
Output $ / M tokens	—	$0.25
Results tracked	10	37

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek-V2 (MoE-236B, May 2024) leads

DeepSeek-V2 (MoE-236B, May 2024): 39.8 (#141), Mistral 7B: 25.9 (#321)

Coding benchmarks
Benchmark	DeepSeek-V2 (MoE-236B, May 2024)	Mistral 7B
BigCodeBench Instruct	48.9%	19.5%
BigCodeBench Complete	59.4%	27.3%
LMArena Coding	—	1082
HumanEval+	—	36%
MBPP+	—	42.1%

Reasoning Not comparable

DeepSeek-V2 (MoE-236B, May 2024): —, Mistral 7B: 12.6 (#331)

Reasoning benchmarks
Benchmark	DeepSeek-V2 (MoE-236B, May 2024)	Mistral 7B
BIG-Bench Hard	78.8%	56.1%
Epoch Capabilities Index	124.78	111.97
HellaSwag	87.1%	81%
PIQA	83.9%	83%
WinoGrande	86.3%	75.3%
Chess Puzzles	—	0%
LMArena Hard Prompts	—	1067
DTBench	—	42.5%
Adversarial NLI	—	47.1%

Math Not comparable

DeepSeek-V2 (MoE-236B, May 2024): —, Mistral 7B: 7.6 (#319)

Math benchmarks
Benchmark	DeepSeek-V2 (MoE-236B, May 2024)	Mistral 7B
OTIS Mock AIME 2024-2025	—	0.3%
LMArena Math	—	1085
MATH Level 5	—	3.7%
GSM8K	—	54.4%

Knowledge Not comparable

DeepSeek-V2 (MoE-236B, May 2024): —, Mistral 7B: 7.3 (#306)

Knowledge benchmarks
Benchmark	DeepSeek-V2 (MoE-236B, May 2024)	Mistral 7B
ARC (AI2) Challenge	92.2%	78.6%
MMLU	78.4%	62.5%
TriviaQA	80%	75.2%
GPQA Diamond	—	15.2%
LMArena Expert	—	1036
BoolQ	—	87.4%
OpenBookQA	—	79.8%

Multilingual Not comparable

DeepSeek-V2 (MoE-236B, May 2024): —, Mistral 7B: 26.0 (#278)

Multilingual benchmarks
Benchmark	DeepSeek-V2 (MoE-236B, May 2024)	Mistral 7B
LMArena Non-English	—	1012
LMArena Chinese	—	1009
LMArena French	—	1036
LMArena German	—	987
LMArena Japanese	—	878
LMArena Russian	—	1018
LMArena Spanish	—	1026

Instruction Following Not comparable

DeepSeek-V2 (MoE-236B, May 2024): —, Mistral 7B: 54.5 (#275)

Instruction Following benchmarks
Benchmark	DeepSeek-V2 (MoE-236B, May 2024)	Mistral 7B
LMArena Instruction Following	—	1060

Long Context Not comparable

DeepSeek-V2 (MoE-236B, May 2024): —, Mistral 7B: 32.2 (#266)

Long Context benchmarks
Benchmark	DeepSeek-V2 (MoE-236B, May 2024)	Mistral 7B
LMArena Longer Query	—	1060

Writing & Preference Not comparable

DeepSeek-V2 (MoE-236B, May 2024): —, Mistral 7B: 30.9 (#281)

Writing & Preference benchmarks
Benchmark	DeepSeek-V2 (MoE-236B, May 2024)	Mistral 7B
LMArena Text	—	1090
LMArena Creative Writing	—	1068
LMArena Multi-Turn	—	1062

Frequently asked questions

Is DeepSeek-V2 (MoE-236B, May 2024) better than Mistral 7B?