Noometry

Model comparison

Ministral 8B vs Mistral 7B

Ministral 8B is the stronger model overall, scoring 27.8 to 22.9 on the Noometry Index.

Last verified . 15 shared benchmarks.

Ministral 8B Mistral AI

27.8

Rank #321 Confirmed

Mistral 7B Mistral AI

22.9

Rank #346 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Ministral 8B scores higher in 8 categories and Mistral 7B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Ministral 8B leads 23.7 to 7.6.
  • The biggest single-benchmark swing is GPQA Diamond: 27.1% for Ministral 8B and 15.2% for Mistral 7B.
  • Ministral 8B is cheaper at $0.10 / $0.10 per million input/output tokens, against $0.25 / $0.25 for Mistral 7B.
  • Ministral 8B accepts more context: 128K tokens versus 8K.

Side by side

Ministral 8BMistral 7B
ProviderMistral AIMistral AI
Noometry Index27.822.9
Released2024-10-012023-09-27
WeightsOpenOpen
Context window128K8K
Max output128K8K
Input $ / M tokens$0.10$0.25
Output $ / M tokens$0.10$0.25
Results tracked1737

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Ministral 8B leads

Ministral 8B: 34.4 (#226), Mistral 7B: 25.9 (#321)

BenchmarkMinistral 8BMistral 7B
LMArena Coding12021082
BigCodeBench Instruct—19.5%
BigCodeBench Complete—27.3%
HumanEval+—36%
MBPP+—42.1%

Agentic & Tool Use Not comparable

Ministral 8B: 16.2 (#140), Mistral 7B: —

BenchmarkMinistral 8BMistral 7B
Berkeley Function Calling Leaderboard11.1%—

Reasoning Ministral 8B leads

Ministral 8B: 17.7 (#279), Mistral 7B: 12.6 (#331)

BenchmarkMinistral 8BMistral 7B
LMArena Hard Prompts11911067
DTBench45.7%42.5%
Chess Puzzles—0%
Adversarial NLI—47.1%
BIG-Bench Hard—56.1%
Epoch Capabilities Index—111.97
HellaSwag—81%
PIQA—83%
WinoGrande—75.3%

Math Ministral 8B leads

Ministral 8B: 23.7 (#262), Mistral 7B: 7.6 (#319)

BenchmarkMinistral 8BMistral 7B
LMArena Math11881085
MATH Level 514.9%3.7%
OTIS Mock AIME 2024-2025—0.3%
GSM8K—54.4%

Knowledge Ministral 8B leads

Ministral 8B: 12.5 (#292), Mistral 7B: 7.3 (#306)

BenchmarkMinistral 8BMistral 7B
GPQA Diamond27.1%15.2%
LMArena Expert11701036
Vectara Hallucination Rate7.4%—
ARC (AI2) Challenge—78.6%
BoolQ—87.4%
MMLU—62.5%
OpenBookQA—79.8%
TriviaQA—75.2%

Multilingual Ministral 8B leads

Ministral 8B: 35.3 (#242), Mistral 7B: 26.0 (#278)

BenchmarkMinistral 8BMistral 7B
LMArena Non-English11651012
LMArena Chinese11931009
LMArena Russian11951018
LMArena French—1036
LMArena German—987
LMArena Japanese—878
LMArena Spanish—1026

Instruction Following Ministral 8B leads

Ministral 8B: 60.7 (#245), Mistral 7B: 54.5 (#275)

BenchmarkMinistral 8BMistral 7B
LMArena Instruction Following11611060

Long Context Ministral 8B leads

Ministral 8B: 36.7 (#222), Mistral 7B: 32.2 (#266)

BenchmarkMinistral 8BMistral 7B
LMArena Longer Query12121060

Writing & Preference Ministral 8B leads

Ministral 8B: 39.8 (#241), Mistral 7B: 30.9 (#281)

BenchmarkMinistral 8BMistral 7B
LMArena Text11911090
LMArena Creative Writing11751068
LMArena Multi-Turn11661062

Frequently asked questions

Is Ministral 8B better than Mistral 7B?

Ministral 8B is the stronger model overall, scoring 27.8 to 22.9 on the Noometry Index.

Which is cheaper, Ministral 8B or Mistral 7B?

Ministral 8B is cheaper. It lists at $0.10 per million input tokens and $0.10 per million output tokens; Mistral 7B lists at $0.25 and $0.25.

Is Ministral 8B or Mistral 7B better for coding?

Ministral 8B scores higher on coding benchmarks: 34.4 versus 25.9 in the Noometry coding category.

Which has the bigger context window?

Ministral 8B does, with 128K tokens against 8K.

How many benchmarks do Ministral 8B and Mistral 7B share?

15 benchmarks have published results for both models. Ministral 8B has 17 scored results on Noometry and Mistral 7B has 37.

Related comparisons

Go deeper