Model comparison

Llama 3.2 90B vs Mistral Medium 3.1

Mistral Medium 3.1 is the stronger model overall, scoring 31.5 to 27.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Llama 3.2 90B Meta

27.1

Rank #326 Confirmed

Mistral Medium 3.1 Mistral AI

31.5

Rank #260 Reported

Summary

  • The widest gap is in reasoning, where Llama 3.2 90B leads 20.9 to 10.1.
  • Llama 3.2 90B has downloadable open weights; the other is API-only.

Side by side

Llama 3.2 90B and Mistral Medium 3.1 specifications
Llama 3.2 90BMistral Medium 3.1
ProviderMetaMistral AI
Noometry Index27.131.5
Released2024-09-24—
WeightsOpenProprietary
Context window—131K
Max output—105K
Input $ / M tokens—$0.40
Output $ / M tokens—$2
Results tracked93

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Agentic & Tool Use Not comparable

Llama 3.2 90B: 29.7 (#73), Mistral Medium 3.1: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 90BMistral Medium 3.1
BALROG27.3%—

Reasoning Llama 3.2 90B leads

Llama 3.2 90B: 20.9 (#207), Mistral Medium 3.1: 10.1 (#336)

Reasoning benchmarks
BenchmarkLlama 3.2 90BMistral Medium 3.1
NYT Connections (extended)—6.5%
EnigmaEval0.4%—
Thematic Generalization—20.3%
Epoch Capabilities Index125.5—

Math Not comparable

Llama 3.2 90B: 10.4 (#302), Mistral Medium 3.1: —

Math benchmarks
BenchmarkLlama 3.2 90BMistral Medium 3.1
OTIS Mock AIME 2024-20252.6%—
MATH Level 539.4%—

Knowledge Not comparable

Llama 3.2 90B: 21.7 (#269), Mistral Medium 3.1: —

Knowledge benchmarks
BenchmarkLlama 3.2 90BMistral Medium 3.1
GPQA Diamond41%—
MMLU80.3%—

Multimodal Not comparable

Llama 3.2 90B: 24.9 (#119), Mistral Medium 3.1: —

Multimodal benchmarks
BenchmarkLlama 3.2 90BMistral Medium 3.1
LMArena Vision1000—
GeoBench52%—

Writing & Preference Not comparable

Llama 3.2 90B: —, Mistral Medium 3.1: 55.6 (#140)

Writing & Preference benchmarks
BenchmarkLlama 3.2 90BMistral Medium 3.1
EQ-Bench Creative Writing—1476

Frequently asked questions

Is Llama 3.2 90B better than Mistral Medium 3.1?

Mistral Medium 3.1 is the stronger model overall, scoring 31.5 to 27.1 on the Noometry Index.

How many benchmarks do Llama 3.2 90B and Mistral Medium 3.1 share?

0 benchmarks have published results for both models. Llama 3.2 90B has 9 scored results on Noometry and Mistral Medium 3.1 has 3.

Related comparisons

Go deeper