Model comparison

DeepSeek-V3 vs Ministral 8B

DeepSeek-V3 is the stronger model overall, scoring 39.5 to 28.2 on the Noometry Index. Ministral 8B costs 2.7× less per token, which makes it the better buy when DeepSeek-V3's lead doesn't matter for your workload.

Last verified . 16 shared benchmarks.

DeepSeek-V3 DeepSeek

39.5

Rank #166 Confirmed

Ministral 8B Mistral AI

28.2

Rank #325 Confirmed

Summary

  • They share 16 benchmarks with published results for both. DeepSeek-V3 scores higher in 7 categories and Ministral 8B in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where DeepSeek-V3 leads 37.5 to 12.6.
  • The biggest single-benchmark swing is MATH Level 5: 75.5% for DeepSeek-V3 and 14.9% for Ministral 8B.
  • Ministral 8B is cheaper at $0.15 / $0.15 per million input/output tokens, against $0.24 / $0.90 for DeepSeek-V3.
  • Ministral 8B accepts more context: 262K tokens versus 164K.

Side by side

DeepSeek-V3 and Ministral 8B specifications
DeepSeek-V3Ministral 8B
ProviderDeepSeekMistral AI
Noometry Index39.528.2
Released2024-12-262024-10-01
WeightsOpenOpen
Context window164K262K
Max output164K262K
Input $ / M tokens$0.24$0.15
Output $ / M tokens$0.90$0.15
Results tracked6017

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek-V3 leads

DeepSeek-V3: 42.3 (#106), Ministral 8B: 35.0 (#230)

Coding benchmarks
BenchmarkDeepSeek-V3Ministral 8B
LMArena Coding13681202
Aider Polyglot55.1%—
SciCode35.8%—
WeirdML36.1%—
BigCodeBench Instruct50%—
LiveBench Coding70.9%—
BigCodeBench Complete62.2%—
HumanEval+86.6%—
MBPP+73%—

Agentic & Tool Use Not comparable

DeepSeek-V3: —, Ministral 8B: 16.4 (#148)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-V3Ministral 8B
Berkeley Function Calling Leaderboard—11.1%
METR Time Horizons49.6%—

Reasoning DeepSeek-V3 leads

DeepSeek-V3: 20.5 (#236), Ministral 8B: 18.4 (#281)

Reasoning benchmarks
BenchmarkDeepSeek-V3Ministral 8B
LMArena Hard Prompts13651191
DTBench64.8%45.7%
SimpleBench27.2%—
Kagi LLM Benchmark52.3%—
CritPt0%—
LiveBench Reasoning65.8%—
LiveBench Data Analysis60.9%—
LMCA15.5%—
BIG-Bench Hard87.5%—
Epoch Capabilities Index135.94—
ForecastBench59.1—
HellaSwag88.9%—
LiveBench66.9%—
PIQA84.7%—
WinoGrande85.2%—

Math DeepSeek-V3 leads

DeepSeek-V3: 32.1 (#219), Ministral 8B: 25.7 (#267)

Math benchmarks
BenchmarkDeepSeek-V3Ministral 8B
LMArena Math13731188
MATH Level 575.5%14.9%
OTIS Mock AIME 2024-202537.8%—
Omni-MATH40.3%—
LiveBench Math73.5%—
FrontierMath (Feb 2025 set)1.7%—

Knowledge DeepSeek-V3 leads

DeepSeek-V3: 37.5 (#155), Ministral 8B: 12.6 (#297)

Knowledge benchmarks
BenchmarkDeepSeek-V3Ministral 8B
GPQA Diamond67.6%27.1%
Vectara Hallucination Rate6.1%7.4%
LMArena Expert13511170
MMLU-Pro72.3%—
Confabulations26.1%—
GPQA (HELM)53.8%—
ARC (AI2) Challenge95.3%—
MMLU87.2%—
TriviaQA82.9%—

Multilingual DeepSeek-V3 leads

DeepSeek-V3: 48.5 (#143), Ministral 8B: 35.1 (#247)

Multilingual benchmarks
BenchmarkDeepSeek-V3Ministral 8B
LMArena Non-English13581165
LMArena Chinese13911193
LMArena Russian13731195
LMArena French1385—
LMArena German1374—
LMArena Japanese1333—
LMArena Korean1319—
LMArena Spanish1358—

Instruction Following DeepSeek-V3 leads

DeepSeek-V3: 72.8 (#130), Ministral 8B: 60.5 (#250)

Instruction Following benchmarks
BenchmarkDeepSeek-V3Ministral 8B
LMArena Instruction Following13451161
LiveBench Instruction Following81.5%—
IFEval83.2%—

Long Context Ministral 8B leads

DeepSeek-V3: 34.0 (#253), Ministral 8B: 36.7 (#227)

Long Context benchmarks
BenchmarkDeepSeek-V3Ministral 8B
LMArena Longer Query13521212
Fiction.LiveBench50%—

Writing & Preference DeepSeek-V3 leads

DeepSeek-V3: 57.4 (#130), Ministral 8B: 39.6 (#246)

Writing & Preference benchmarks
BenchmarkDeepSeek-V3Ministral 8B
LMArena Text13751191
LMArena Creative Writing13641175
LMArena Multi-Turn13891166
Short-Story Creative Writing77%—
EQ-Bench Creative Writing1472—
WildBench83%—
LiveBench Language49.1%—

Frequently asked questions

Is DeepSeek-V3 better than Ministral 8B?

DeepSeek-V3 is the stronger model overall, scoring 39.5 to 28.2 on the Noometry Index. Ministral 8B costs 2.7× less per token, which makes it the better buy when DeepSeek-V3's lead doesn't matter for your workload.

Which is cheaper, DeepSeek-V3 or Ministral 8B?

Ministral 8B is cheaper. It lists at $0.15 per million input tokens and $0.15 per million output tokens; DeepSeek-V3 lists at $0.24 and $0.90.

Is DeepSeek-V3 or Ministral 8B better for coding?

DeepSeek-V3 scores higher on coding benchmarks: 42.3 versus 35.0 in the Noometry coding category.

Which has the bigger context window?

Ministral 8B does, with 262K tokens against 164K.

How many benchmarks do DeepSeek-V3 and Ministral 8B share?

16 benchmarks have published results for both models. DeepSeek-V3 has 60 scored results on Noometry and Ministral 8B has 17.

Related comparisons

Go deeper