Noometry

Model comparison

GPT-5.4 mini vs Ministral 8B

GPT-5.4 mini is the stronger model overall, scoring 44.8 to 27.8 on the Noometry Index. Ministral 8B costs 17× less per token, which makes it the better buy when GPT-5.4 mini's lead doesn't matter for your workload.

Last verified . 15 shared benchmarks.

GPT-5.4 mini OpenAI

44.8

Rank #69 Confirmed

Ministral 8B Mistral AI

27.8

Rank #321 Confirmed

Summary

  • They share 15 benchmarks with published results for both. GPT-5.4 mini scores higher in 9 categories and Ministral 8B in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GPT-5.4 mini leads 51.4 to 12.5.
  • The biggest single-benchmark swing is GPQA Diamond: 86.9% for GPT-5.4 mini and 27.1% for Ministral 8B.
  • Ministral 8B is cheaper at $0.10 / $0.10 per million input/output tokens, against $0.75 / $4.50 for GPT-5.4 mini.
  • GPT-5.4 mini accepts more context: 400K tokens versus 128K.
  • Ministral 8B has downloadable open weights; the other is API-only.

Side by side

GPT-5.4 miniMinistral 8B
ProviderOpenAIMistral AI
Noometry Index44.827.8
Released2026-03-172024-10-01
WeightsProprietaryOpen
Context window400K128K
Max output128K128K
Input $ / M tokens$0.75$0.10
Output $ / M tokens$4.50$0.10
Results tracked4617

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.4 mini leads

GPT-5.4 mini: 45.0 (#67), Ministral 8B: 34.4 (#226)

BenchmarkGPT-5.4 miniMinistral 8B
LMArena Coding14381202
FrontierCode27%—
LMArena WebDev1397—
SciCode49.9%—
WeirdML60.3%—
ALE-Bench1,189—

Agentic & Tool Use GPT-5.4 mini leads

GPT-5.4 mini: 29.6 (#74), Ministral 8B: 16.2 (#140)

BenchmarkGPT-5.4 miniMinistral 8B
Berkeley Function Calling Leaderboard—11.1%
DeepResearch Bench36.3%—

Reasoning GPT-5.4 mini leads

GPT-5.4 mini: 30.3 (#77), Ministral 8B: 17.7 (#279)

BenchmarkGPT-5.4 miniMinistral 8B
LMArena Hard Prompts14241191
DTBench80%45.7%
ARC-AGI-218.9%—
Kagi LLM Benchmark37.9%—
NYT Connections (extended)61.8%—
ARC-AGI-163.7%—
CritPt10%—
Chess Puzzles24%—
Thematic Generalization61.7%—
Mystery Game Puzzles11%—
LMCA40.8%—
Epoch Capabilities Index148.83—
ForecastBench57—

Math GPT-5.4 mini leads

GPT-5.4 mini: 45.4 (#63), Ministral 8B: 23.7 (#262)

BenchmarkGPT-5.4 miniMinistral 8B
LMArena Math14181188
FrontierMath (Tiers 1-3)51.2%—
FrontierMath Tier 49.8%—
OTIS Mock AIME 2024-202588.9%—
ProofBench21%—
MATH Level 5—14.9%
FrontierMath (Feb 2025 set)28.3%—
FrontierMath Tier 4 (v1)2.1%—

Knowledge GPT-5.4 mini leads

GPT-5.4 mini: 51.4 (#62), Ministral 8B: 12.5 (#292)

BenchmarkGPT-5.4 miniMinistral 8B
GPQA Diamond86.9%27.1%
Vectara Hallucination Rate5.5%7.4%
LMArena Expert14341170
SimpleQA Verified29.4%—

Multimodal Not comparable

GPT-5.4 mini: 39.0 (#51), Ministral 8B: —

BenchmarkGPT-5.4 miniMinistral 8B
LMArena Vision1245—

Multilingual GPT-5.4 mini leads

GPT-5.4 mini: 52.1 (#94), Ministral 8B: 35.3 (#242)

BenchmarkGPT-5.4 miniMinistral 8B
LMArena Non-English14051165
LMArena Chinese14461193
LMArena Russian14171195
LMArena French1440—
LMArena German1407—
LMArena Japanese1375—
LMArena Korean1369—
LMArena Spanish1403—

Instruction Following GPT-5.4 mini leads

GPT-5.4 mini: 74.3 (#99), Ministral 8B: 60.7 (#245)

BenchmarkGPT-5.4 miniMinistral 8B
LMArena Instruction Following14051161

Long Context GPT-5.4 mini leads

GPT-5.4 mini: 42.9 (#107), Ministral 8B: 36.7 (#222)

BenchmarkGPT-5.4 miniMinistral 8B
LMArena Longer Query14071212

Writing & Preference GPT-5.4 mini leads

GPT-5.4 mini: 64.2 (#56), Ministral 8B: 39.8 (#241)

BenchmarkGPT-5.4 miniMinistral 8B
LMArena Text14111191
LMArena Creative Writing13701175
LMArena Multi-Turn14291166
EQ-Bench Creative Writing1665—

Frequently asked questions

Is GPT-5.4 mini better than Ministral 8B?

GPT-5.4 mini is the stronger model overall, scoring 44.8 to 27.8 on the Noometry Index. Ministral 8B costs 17× less per token, which makes it the better buy when GPT-5.4 mini's lead doesn't matter for your workload.

Which is cheaper, GPT-5.4 mini or Ministral 8B?

Ministral 8B is cheaper. It lists at $0.10 per million input tokens and $0.10 per million output tokens; GPT-5.4 mini lists at $0.75 and $4.50.

Is GPT-5.4 mini or Ministral 8B better for coding?

GPT-5.4 mini scores higher on coding benchmarks: 45.0 versus 34.4 in the Noometry coding category.

Which has the bigger context window?

GPT-5.4 mini does, with 400K tokens against 128K.

How many benchmarks do GPT-5.4 mini and Ministral 8B share?

15 benchmarks have published results for both models. GPT-5.4 mini has 46 scored results on Noometry and Ministral 8B has 17.

Related comparisons

Go deeper