Model comparison

Llama 3.2 90B vs Mistral Small 3.1

Mistral Small 3.1 is the stronger model overall, scoring 31.4 to 27.1 on the Noometry Index.

Last verified . 4 shared benchmarks.

Llama 3.2 90B Meta

27.1

Rank #326 Confirmed

Mistral Small 3.1 Mistral AI

31.4

Rank #263 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Llama 3.2 90B scores higher in 1 category and Mistral Small 3.1 in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in multimodal, where Mistral Small 3.1 leads 32.6 to 24.9.

Side by side

Llama 3.2 90B and Mistral Small 3.1 specifications
Llama 3.2 90BMistral Small 3.1
ProviderMetaMistral AI
Noometry Index27.131.4
Released2024-09-242025-03-17
WeightsOpenOpen
Context window—128K
Max output—102K
Input $ / M tokens—$0.35
Output $ / M tokens—$0.56
Results tracked928

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 3.2 90B: —, Mistral Small 3.1: 37.7 (#175)

Coding benchmarks
BenchmarkLlama 3.2 90BMistral Small 3.1
LMArena Coding—1309

Agentic & Tool Use Not comparable

Llama 3.2 90B: 29.7 (#73), Mistral Small 3.1: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 90BMistral Small 3.1
BALROG27.3%—

Reasoning Llama 3.2 90B leads

Llama 3.2 90B: 20.9 (#207), Mistral Small 3.1: 18.9 (#249)

Reasoning benchmarks
BenchmarkLlama 3.2 90BMistral Small 3.1
Epoch Capabilities Index125.5127.48
Chess Puzzles—1%
EnigmaEval0.4%—
LMArena Hard Prompts—1278

Math Mistral Small 3.1 leads

Llama 3.2 90B: 10.4 (#302), Mistral Small 3.1: 13.7 (#295)

Math benchmarks
BenchmarkLlama 3.2 90BMistral Small 3.1
OTIS Mock AIME 2024-20252.6%3.9%
Omni-MATH—24.8%
LMArena Math—1261
MATH Level 539.4%—

Knowledge Too close to call

Llama 3.2 90B: 21.7 (#269), Mistral Small 3.1: 22.6 (#266)

Knowledge benchmarks
BenchmarkLlama 3.2 90BMistral Small 3.1
GPQA Diamond41%41.9%
MMLU-Pro—61%
GPQA (HELM)—39.2%
LMArena Expert—1258
MMLU80.3%—

Multimodal Mistral Small 3.1 leads

Llama 3.2 90B: 24.9 (#119), Mistral Small 3.1: 32.6 (#93)

Multimodal benchmarks
BenchmarkLlama 3.2 90BMistral Small 3.1
LMArena Vision10001136
GeoBench52%—

Multilingual Not comparable

Llama 3.2 90B: —, Mistral Small 3.1: 41.4 (#204)

Multilingual benchmarks
BenchmarkLlama 3.2 90BMistral Small 3.1
LMArena Non-English—1255
LMArena Chinese—1254
LMArena French—1270
LMArena German—1266
LMArena Japanese—1210
LMArena Korean—1206
LMArena Russian—1263
LMArena Spanish—1283

Instruction Following Not comparable

Llama 3.2 90B: —, Mistral Small 3.1: 63.8 (#225)

Instruction Following benchmarks
BenchmarkLlama 3.2 90BMistral Small 3.1
IFEval—75%
LMArena Instruction Following—1264

Long Context Not comparable

Llama 3.2 90B: —, Mistral Small 3.1: 39.5 (#172)

Long Context benchmarks
BenchmarkLlama 3.2 90BMistral Small 3.1
LMArena Longer Query—1300

Writing & Preference Not comparable

Llama 3.2 90B: —, Mistral Small 3.1: 37.2 (#254)

Writing & Preference benchmarks
BenchmarkLlama 3.2 90BMistral Small 3.1
LMArena Text—1278
LMArena Creative Writing—1253
EQ-Bench Creative Writing—761
WildBench—78.8%
LMArena Multi-Turn—1270

Frequently asked questions

Is Llama 3.2 90B better than Mistral Small 3.1?

Mistral Small 3.1 is the stronger model overall, scoring 31.4 to 27.1 on the Noometry Index.

How many benchmarks do Llama 3.2 90B and Mistral Small 3.1 share?

4 benchmarks have published results for both models. Llama 3.2 90B has 9 scored results on Noometry and Mistral Small 3.1 has 28.

Related comparisons

Go deeper