Noometry

Model comparison

gpt-oss-20b vs Ministral 8B

gpt-oss-20b is the stronger model overall, scoring 32.1 to 27.8 on the Noometry Index.

Last verified . 14 shared benchmarks.

gpt-oss-20b OpenAI

32.1

Rank #249 Confirmed

Ministral 8B Mistral AI

27.8

Rank #321 Confirmed

Summary

  • They share 14 benchmarks with published results for both. gpt-oss-20b scores higher in 7 categories and Ministral 8B in 2 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where gpt-oss-20b leads 34.6 to 12.5.
  • The biggest single-benchmark swing is GPQA Diamond: 60.8% for gpt-oss-20b and 27.1% for Ministral 8B.
  • gpt-oss-20b is cheaper at $0.018 / $0.09 per million input/output tokens, against $0.10 / $0.10 for Ministral 8B.
  • gpt-oss-20b accepts more context: 131K tokens versus 128K.

Side by side

gpt-oss-20bMinistral 8B
ProviderOpenAIMistral AI
Noometry Index32.127.8
Released2025-08-052024-10-01
WeightsOpenOpen
Context window131K128K
Max output16K128K
Input $ / M tokens$0.018$0.10
Output $ / M tokens$0.09$0.10
Results tracked3417

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding gpt-oss-20b leads

gpt-oss-20b: 37.1 (#185), Ministral 8B: 34.4 (#226)

Benchmarkgpt-oss-20bMinistral 8B
LMArena Coding13071202
SciCode34.4%—
WeirdML40.9%—
ALE-Bench566.05—

Agentic & Tool Use Ministral 8B leads

gpt-oss-20b: 9.2 (#146), Ministral 8B: 16.2 (#140)

Benchmarkgpt-oss-20bMinistral 8B
Terminal-Bench3.4%—
Berkeley Function Calling Leaderboard—11.1%

Reasoning gpt-oss-20b leads

gpt-oss-20b: 18.8 (#251), Ministral 8B: 17.7 (#279)

Benchmarkgpt-oss-20bMinistral 8B
LMArena Hard Prompts12741191
DTBench68%45.7%
Kagi LLM Benchmark53.2%—
CritPt1.4%—
Chess Puzzles4%—
LMCA14.5%—
Epoch Capabilities Index137.81—

Math gpt-oss-20b leads

gpt-oss-20b: 37.6 (#93), Ministral 8B: 23.7 (#262)

Benchmarkgpt-oss-20bMinistral 8B
LMArena Math13171188
OTIS Mock AIME 2024-202565.3%—
Omni-MATH56.5%—
MATH Level 5—14.9%

Knowledge gpt-oss-20b leads

gpt-oss-20b: 34.6 (#186), Ministral 8B: 12.5 (#292)

Benchmarkgpt-oss-20bMinistral 8B
GPQA Diamond60.8%27.1%
LMArena Expert12581170
MMLU-Pro74%—
Vectara Hallucination Rate—7.4%
GPQA (HELM)59.4%—

Multilingual gpt-oss-20b leads

gpt-oss-20b: 42.4 (#192), Ministral 8B: 35.3 (#242)

Benchmarkgpt-oss-20bMinistral 8B
LMArena Non-English12691165
LMArena Chinese13111193
LMArena Russian12791195
LMArena German1249—
LMArena Japanese1245—
LMArena Korean1239—
LMArena Spanish1267—

Instruction Following gpt-oss-20b leads

gpt-oss-20b: 62.0 (#235), Ministral 8B: 60.7 (#245)

Benchmarkgpt-oss-20bMinistral 8B
LMArena Instruction Following12361161
IFEval73.2%—

Long Context gpt-oss-20b leads

gpt-oss-20b: 37.9 (#203), Ministral 8B: 36.7 (#222)

Benchmarkgpt-oss-20bMinistral 8B
LMArena Longer Query12511212

Writing & Preference Ministral 8B leads

gpt-oss-20b: 35.8 (#260), Ministral 8B: 39.8 (#241)

Benchmarkgpt-oss-20bMinistral 8B
LMArena Text12881191
LMArena Creative Writing12011175
LMArena Multi-Turn12681166
EQ-Bench Creative Writing666—
WildBench73.7%—

Frequently asked questions

Is gpt-oss-20b better than Ministral 8B?

gpt-oss-20b is the stronger model overall, scoring 32.1 to 27.8 on the Noometry Index.

Which is cheaper, gpt-oss-20b or Ministral 8B?

gpt-oss-20b is cheaper. It lists at $0.018 per million input tokens and $0.09 per million output tokens; Ministral 8B lists at $0.10 and $0.10.

Is gpt-oss-20b or Ministral 8B better for coding?

gpt-oss-20b scores higher on coding benchmarks: 37.1 versus 34.4 in the Noometry coding category.

Which has the bigger context window?

gpt-oss-20b does, with 131K tokens against 128K.

How many benchmarks do gpt-oss-20b and Ministral 8B share?

14 benchmarks have published results for both models. gpt-oss-20b has 34 scored results on Noometry and Ministral 8B has 17.

Related comparisons

Go deeper