Model comparison

Llama 3.2 90B vs Ministral 8B

Llama 3.2 90B and Ministral 8B score almost the same on the Noometry Index (27.5 vs 28.2), so choose on price, context window or the category you care about most.

Last verified . 2 shared benchmarks.

Llama 3.2 90B Meta

27.5

Rank #331 Confirmed

Ministral 8B Mistral AI

28.2

Rank #325 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Llama 3.2 90B scores higher in 3 categories and Ministral 8B in 1 category; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Ministral 8B leads 25.7 to 11.1.
  • The biggest single-benchmark swing is MATH Level 5: 39.4% for Llama 3.2 90B and 14.9% for Ministral 8B.

Side by side

Llama 3.2 90B and Ministral 8B specifications
Llama 3.2 90BMinistral 8B
ProviderMetaMistral AI
Noometry Index27.528.2
Released2024-09-242024-10-01
WeightsOpenOpen
Context window—262K
Max output—262K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.15
Results tracked917

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 3.2 90B: —, Ministral 8B: 35.0 (#230)

Coding benchmarks
BenchmarkLlama 3.2 90BMinistral 8B
LMArena Coding—1202

Agentic & Tool Use Llama 3.2 90B leads

Llama 3.2 90B: 30.0 (#80), Ministral 8B: 16.4 (#148)

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 90BMinistral 8B
Berkeley Function Calling Leaderboard—11.1%
BALROG27.3%—

Reasoning Llama 3.2 90B leads

Llama 3.2 90B: 21.7 (#217), Ministral 8B: 18.4 (#281)

Reasoning benchmarks
BenchmarkLlama 3.2 90BMinistral 8B
EnigmaEval0.4%—
LMArena Hard Prompts—1191
DTBench—45.7%
Epoch Capabilities Index125.5—

Math Ministral 8B leads

Llama 3.2 90B: 11.1 (#308), Ministral 8B: 25.7 (#267)

Math benchmarks
BenchmarkLlama 3.2 90BMinistral 8B
MATH Level 539.4%14.9%
OTIS Mock AIME 2024-20252.6%—
LMArena Math—1188

Knowledge Llama 3.2 90B leads

Llama 3.2 90B: 21.7 (#274), Ministral 8B: 12.6 (#297)

Knowledge benchmarks
BenchmarkLlama 3.2 90BMinistral 8B
GPQA Diamond41%27.1%
Vectara Hallucination Rate—7.4%
LMArena Expert—1170
MMLU80.3%—

Multimodal Not comparable

Llama 3.2 90B: 25.4 (#124), Ministral 8B: —

Multimodal benchmarks
BenchmarkLlama 3.2 90BMinistral 8B
LMArena Vision1000—
GeoBench52%—

Multilingual Not comparable

Llama 3.2 90B: —, Ministral 8B: 35.1 (#247)

Multilingual benchmarks
BenchmarkLlama 3.2 90BMinistral 8B
LMArena Non-English—1165
LMArena Chinese—1193
LMArena Russian—1195

Instruction Following Not comparable

Llama 3.2 90B: —, Ministral 8B: 60.5 (#250)

Instruction Following benchmarks
BenchmarkLlama 3.2 90BMinistral 8B
LMArena Instruction Following—1161

Long Context Not comparable

Llama 3.2 90B: —, Ministral 8B: 36.7 (#227)

Long Context benchmarks
BenchmarkLlama 3.2 90BMinistral 8B
LMArena Longer Query—1212

Writing & Preference Not comparable

Llama 3.2 90B: —, Ministral 8B: 39.6 (#246)

Writing & Preference benchmarks
BenchmarkLlama 3.2 90BMinistral 8B
LMArena Text—1191
LMArena Creative Writing—1175
LMArena Multi-Turn—1166

Frequently asked questions

Is Llama 3.2 90B better than Ministral 8B?

Llama 3.2 90B and Ministral 8B score almost the same on the Noometry Index (27.5 vs 28.2), so choose on price, context window or the category you care about most.

How many benchmarks do Llama 3.2 90B and Ministral 8B share?

2 benchmarks have published results for both models. Llama 3.2 90B has 9 scored results on Noometry and Ministral 8B has 17.

Related comparisons

Go deeper