Model comparison

Llama 3.2 90B vs Ministral 3B

Llama 3.2 90B is the stronger model overall, scoring 27.1 to 25.6 on the Noometry Index.

Last verified . 3 shared benchmarks.

Llama 3.2 90B Meta

27.1

Rank #326 Confirmed

Ministral 3B Mistral AI

25.6

Rank #336 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Llama 3.2 90B scores higher in 2 categories and Ministral 3B in 1 category; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where Ministral 3B leads 24.5 to 10.4.
  • The biggest single-benchmark swing is MATH Level 5: 39.4% for Llama 3.2 90B and 14.4% for Ministral 3B.

Side by side

Llama 3.2 90B and Ministral 3B specifications
Llama 3.2 90BMinistral 3B
ProviderMetaMistral AI
Noometry Index27.125.6
Released2024-09-242024-10-01
WeightsOpenOpen
Context window—128K
Max output—128K
Input $ / M tokens—$0.04
Output $ / M tokens—$0.04
Results tracked96

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Agentic & Tool Use Not comparable

Llama 3.2 90B: 29.7 (#73), Ministral 3B: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 90BMinistral 3B
BALROG27.3%—

Reasoning Llama 3.2 90B leads

Llama 3.2 90B: 20.9 (#207), Ministral 3B: 17.7 (#278)

Reasoning benchmarks
BenchmarkLlama 3.2 90BMinistral 3B
Epoch Capabilities Index125.5118.08
EnigmaEval0.4%—
DTBench—51.7%
LMCA—5.5%

Math Ministral 3B leads

Llama 3.2 90B: 10.4 (#302), Ministral 3B: 24.5 (#257)

Math benchmarks
BenchmarkLlama 3.2 90BMinistral 3B
MATH Level 539.4%14.4%
OTIS Mock AIME 2024-20252.6%—

Knowledge Llama 3.2 90B leads

Llama 3.2 90B: 21.7 (#269), Ministral 3B: 10.4 (#297)

Knowledge benchmarks
BenchmarkLlama 3.2 90BMinistral 3B
GPQA Diamond41%25.3%
Vectara Hallucination Rate—7.3%
MMLU80.3%—

Multimodal Not comparable

Llama 3.2 90B: 24.9 (#119), Ministral 3B: —

Multimodal benchmarks
BenchmarkLlama 3.2 90BMinistral 3B
LMArena Vision1000—
GeoBench52%—

Frequently asked questions

Is Llama 3.2 90B better than Ministral 3B?

Llama 3.2 90B is the stronger model overall, scoring 27.1 to 25.6 on the Noometry Index.

How many benchmarks do Llama 3.2 90B and Ministral 3B share?

3 benchmarks have published results for both models. Llama 3.2 90B has 9 scored results on Noometry and Ministral 3B has 6.

Related comparisons

Go deeper