Model comparison

DeepSeek-V3 vs Devstral Small 2505

DeepSeek-V3 is the stronger model overall, scoring 39.5 to 34.3 on the Noometry Index. Devstral Small 2505 costs 2.7× less per token, which makes it the better buy when DeepSeek-V3's lead doesn't matter for your workload.

Last verified October 10, 2026. 3 shared benchmarks.

DeepSeek-V3

DeepSeek

39.5

Rank #166 Confirmed

Devstral Small 2505

Mistral AI

34.3

Rank #233 Reported

Summary

They share 3 benchmarks with published results for both. DeepSeek-V3 scores higher in 2 categories and Devstral Small 2505 in 0 categories; one gap is clear of the uncertainty.
The widest gap is in coding, where DeepSeek-V3 leads 42.3 to 38.9.
The biggest single-benchmark swing is Kagi LLM Benchmark: 52.3% for DeepSeek-V3 and 37.7% for Devstral Small 2505.
Devstral Small 2505 is cheaper at $0.10 / $0.30 per million input/output tokens, against $0.24 / $0.90 for DeepSeek-V3.
DeepSeek-V3 accepts more context: 164K tokens versus 128K.

Side by side

DeepSeek-V3 and Devstral Small 2505 specifications
	DeepSeek-V3	Devstral Small 2505
Provider	DeepSeek	Mistral AI
Noometry Index	39.5	34.3
Released	2024-12-26	2025-05-07
Weights	Open	Open
Context window	164K	128K
Max output	164K	128K
Input $ / M tokens	$0.24	$0.10
Output $ / M tokens	$0.90	$0.30
Results tracked	60	4

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek-V3 leads

DeepSeek-V3: 42.3 (#106), Devstral Small 2505: 38.9 (#166)

Coding benchmarks
Benchmark	DeepSeek-V3	Devstral Small 2505
SciCode	35.8%	28.8%
SWE-bench Verified (bash only)	—	56.4%
Aider Polyglot	55.1%	—
WeirdML	36.1%	—
BigCodeBench Instruct	50%	—
LiveBench Coding	70.9%	—
LMArena Coding	1368	—
BigCodeBench Complete	62.2%	—
HumanEval+	86.6%	—
MBPP+	73%	—

Agentic & Tool Use Not comparable

DeepSeek-V3: —, Devstral Small 2505: —

Agentic & Tool Use benchmarks
Benchmark	DeepSeek-V3	Devstral Small 2505
METR Time Horizons	49.6%	—

Reasoning Too close to call

DeepSeek-V3: 20.5 (#236), Devstral Small 2505: 19.7 (#252)

Reasoning benchmarks
Benchmark	DeepSeek-V3	Devstral Small 2505
Kagi LLM Benchmark	52.3%	37.7%
CritPt	0%	0%
SimpleBench	27.2%	—
LiveBench Reasoning	65.8%	—
LMArena Hard Prompts	1365	—
DTBench	64.8%	—
LiveBench Data Analysis	60.9%	—
LMCA	15.5%	—
BIG-Bench Hard	87.5%	—
Epoch Capabilities Index	135.94	—
ForecastBench	59.1	—
HellaSwag	88.9%	—
LiveBench	66.9%	—
PIQA	84.7%	—
WinoGrande	85.2%	—

Math Not comparable

DeepSeek-V3: 32.1 (#219), Devstral Small 2505: —

Math benchmarks
Benchmark	DeepSeek-V3	Devstral Small 2505
OTIS Mock AIME 2024-2025	37.8%	—
Omni-MATH	40.3%	—
LiveBench Math	73.5%	—
LMArena Math	1373	—
MATH Level 5	75.5%	—
FrontierMath (Feb 2025 set)	1.7%	—

Knowledge Not comparable

DeepSeek-V3: 37.5 (#155), Devstral Small 2505: —

Knowledge benchmarks
Benchmark	DeepSeek-V3	Devstral Small 2505
GPQA Diamond	67.6%	—
MMLU-Pro	72.3%	—
Confabulations	26.1%	—
Vectara Hallucination Rate	6.1%	—
GPQA (HELM)	53.8%	—
LMArena Expert	1351	—
ARC (AI2) Challenge	95.3%	—
MMLU	87.2%	—
TriviaQA	82.9%	—

Multilingual Not comparable

DeepSeek-V3: 48.5 (#143), Devstral Small 2505: —

Multilingual benchmarks
Benchmark	DeepSeek-V3	Devstral Small 2505
LMArena Non-English	1358	—
LMArena Chinese	1391	—
LMArena French	1385	—
LMArena German	1374	—
LMArena Japanese	1333	—
LMArena Korean	1319	—
LMArena Russian	1373	—
LMArena Spanish	1358	—

Instruction Following Not comparable

DeepSeek-V3: 72.8 (#130), Devstral Small 2505: —

Instruction Following benchmarks
Benchmark	DeepSeek-V3	Devstral Small 2505
LiveBench Instruction Following	81.5%	—
IFEval	83.2%	—
LMArena Instruction Following	1345	—

Long Context Not comparable

DeepSeek-V3: 34.0 (#253), Devstral Small 2505: —

Long Context benchmarks
Benchmark	DeepSeek-V3	Devstral Small 2505
Fiction.LiveBench	50%	—
LMArena Longer Query	1352	—

Writing & Preference Not comparable

DeepSeek-V3: 57.4 (#130), Devstral Small 2505: —

Writing & Preference benchmarks
Benchmark	DeepSeek-V3	Devstral Small 2505
LMArena Text	1375	—
LMArena Creative Writing	1364	—
Short-Story Creative Writing	77%	—
EQ-Bench Creative Writing	1472	—
WildBench	83%	—
LMArena Multi-Turn	1389	—
LiveBench Language	49.1%	—

Frequently asked questions

Is DeepSeek-V3 better than Devstral Small 2505?

Which is cheaper, DeepSeek-V3 or Devstral Small 2505?

Devstral Small 2505 is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; DeepSeek-V3 lists at $0.24 and $0.90.

Is DeepSeek-V3 or Devstral Small 2505 better for coding?

DeepSeek-V3 scores higher on coding benchmarks: 42.3 versus 38.9 in the Noometry coding category.

Which has the bigger context window?

DeepSeek-V3 does, with 164K tokens against 128K.

How many benchmarks do DeepSeek-V3 and Devstral Small 2505 share?

3 benchmarks have published results for both models. DeepSeek-V3 has 60 scored results on Noometry and Devstral Small 2505 has 4.