Model comparison

Llama 3.2 90B vs Mistral Medium 3.5

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 27.5 on the Noometry Index.

Last verified . 2 shared benchmarks.

Llama 3.2 90B Meta

27.5

Rank #331 Confirmed

Mistral Medium 3.5 Mistral AI

40.2

Rank #152 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Llama 3.2 90B scores higher in 1 category and Mistral Medium 3.5 in 3 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Mistral Medium 3.5 leads 39.1 to 11.1.

Side by side

Llama 3.2 90B and Mistral Medium 3.5 specifications
Llama 3.2 90BMistral Medium 3.5
ProviderMetaMistral AI
Noometry Index27.540.2
Released2024-09-24—
WeightsOpenOpen
Context window—262K
Max output—210K
Input $ / M tokens—$1.50
Output $ / M tokens—$7.50
Results tracked922

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 3.2 90B: —, Mistral Medium 3.5: 36.0 (#213)

Coding benchmarks
BenchmarkLlama 3.2 90BMistral Medium 3.5
LMArena WebDev—1264
LMArena Coding—1461

Agentic & Tool Use Not comparable

Llama 3.2 90B: 30.0 (#80), Mistral Medium 3.5: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 90BMistral Medium 3.5
BALROG27.3%—

Reasoning Llama 3.2 90B leads

Llama 3.2 90B: 21.7 (#217), Mistral Medium 3.5: 17.3 (#295)

Reasoning benchmarks
BenchmarkLlama 3.2 90BMistral Medium 3.5
Epoch Capabilities Index125.5141.35
Kagi LLM Benchmark—41.4%
NYT Connections (extended)—12.9%
EnigmaEval0.4%—
LMArena Hard Prompts—1436

Math Mistral Medium 3.5 leads

Llama 3.2 90B: 11.1 (#308), Mistral Medium 3.5: 39.1 (#113)

Math benchmarks
BenchmarkLlama 3.2 90BMistral Medium 3.5
OTIS Mock AIME 2024-20252.6%—
LMArena Math—1431
MATH Level 539.4%—

Knowledge Mistral Medium 3.5 leads

Llama 3.2 90B: 21.7 (#274), Mistral Medium 3.5: 40.0 (#126)

Knowledge benchmarks
BenchmarkLlama 3.2 90BMistral Medium 3.5
GPQA Diamond41%—
LMArena Expert—1432
MMLU80.3%—

Multimodal Mistral Medium 3.5 leads

Llama 3.2 90B: 25.4 (#124), Mistral Medium 3.5: 38.3 (#65)

Multimodal benchmarks
BenchmarkLlama 3.2 90BMistral Medium 3.5
LMArena Vision10001223
GeoBench52%—

Multilingual Not comparable

Llama 3.2 90B: —, Mistral Medium 3.5: 51.9 (#100)

Multilingual benchmarks
BenchmarkLlama 3.2 90BMistral Medium 3.5
LMArena Non-English—1404
LMArena Chinese—1442
LMArena French—1448
LMArena German—1451
LMArena Korean—1385
LMArena Russian—1395
LMArena Spanish—1409

Instruction Following Not comparable

Llama 3.2 90B: —, Mistral Medium 3.5: 74.6 (#90)

Instruction Following benchmarks
BenchmarkLlama 3.2 90BMistral Medium 3.5
LMArena Instruction Following—1415

Long Context Not comparable

Llama 3.2 90B: —, Mistral Medium 3.5: 43.2 (#103)

Long Context benchmarks
BenchmarkLlama 3.2 90BMistral Medium 3.5
LMArena Longer Query—1415

Writing & Preference Not comparable

Llama 3.2 90B: —, Mistral Medium 3.5: 58.5 (#117)

Writing & Preference benchmarks
BenchmarkLlama 3.2 90BMistral Medium 3.5
LMArena Text—1421
LMArena Creative Writing—1374
EQ-Bench 4—993
LMArena Multi-Turn—1423

Frequently asked questions

Is Llama 3.2 90B better than Mistral Medium 3.5?

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 27.5 on the Noometry Index.

How many benchmarks do Llama 3.2 90B and Mistral Medium 3.5 share?

2 benchmarks have published results for both models. Llama 3.2 90B has 9 scored results on Noometry and Mistral Medium 3.5 has 22.

Related comparisons

Go deeper