Model comparison

Llama 13b vs Mistral Small 3.2

Mistral Small 3.2 is the stronger model overall, scoring 31.2 to 24.4 on the Noometry Index.

Last verified . 1 shared benchmarks.

Llama 13b Meta

24.4

Rank #348 Confirmed

Mistral Small 3.2 Mistral AI

31.2

Rank #280 Confirmed

Summary

  • They share 1 benchmark with published results for both. Llama 13b scores higher in 1 category and Mistral Small 3.2 in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Mistral Small 3.2 leads 45.0 to 13.8.

Side by side

Llama 13b and Mistral Small 3.2 specifications
Llama 13bMistral Small 3.2
ProviderMetaMistral AI
Noometry Index24.431.2
Released2023-02-242025-06-20
WeightsOpenOpen
Context window—256K
Max output—16K
Input $ / M tokens—$0.0938
Output $ / M tokens—$0.25
Results tracked216

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 13b: 21.4 (#337), Mistral Small 3.2: —

Coding benchmarks
BenchmarkLlama 13bMistral Small 3.2
LMArena Coding683—

Reasoning Mistral Small 3.2 leads

Llama 13b: 14.0 (#329), Mistral Small 3.2: 18.1 (#287)

Reasoning benchmarks
BenchmarkLlama 13bMistral Small 3.2
Epoch Capabilities Index100.58131.74
Kagi LLM Benchmark—40.4%
Chess Puzzles—1%
LMArena Hard Prompts728—
BIG-Bench Hard37.9%—
HellaSwag79.2%—
LAMBADA75.2%—
PIQA80.1%—
WinoGrande73%—

Math Too close to call

Llama 13b: 26.7 (#256), Mistral Small 3.2: 26.3 (#260)

Math benchmarks
BenchmarkLlama 13bMistral Small 3.2
OTIS Mock AIME 2024-2025—30.3%
LMArena Math838—
GSM8K20.6%—

Knowledge Not comparable

Llama 13b: —, Mistral Small 3.2: 26.7 (#256)

Knowledge benchmarks
BenchmarkLlama 13bMistral Small 3.2
GPQA Diamond—49.1%
ARC (AI2) Challenge52.7%—
BoolQ78.7%—
MMLU47.7%—
OpenBookQA56.4%—
TriviaQA77.9%—

Multimodal Not comparable

Llama 13b: —, Mistral Small 3.2: —

Multimodal benchmarks
BenchmarkLlama 13bMistral Small 3.2
ScienceQA43.3%—

Multilingual Not comparable

Llama 13b: 16.6 (#297), Mistral Small 3.2: —

Multilingual benchmarks
BenchmarkLlama 13bMistral Small 3.2
LMArena Non-English819—

Instruction Following Not comparable

Llama 13b: 36.7 (#305), Mistral Small 3.2: —

Instruction Following benchmarks
BenchmarkLlama 13bMistral Small 3.2
LMArena Instruction Following781—

Writing & Preference Mistral Small 3.2 leads

Llama 13b: 13.8 (#312), Mistral Small 3.2: 45.0 (#224)

Writing & Preference benchmarks
BenchmarkLlama 13bMistral Small 3.2
LMArena Text834—
LMArena Creative Writing794—
EQ-Bench Creative Writing—1255
LMArena Multi-Turn753—

Frequently asked questions

Is Llama 13b better than Mistral Small 3.2?

Mistral Small 3.2 is the stronger model overall, scoring 31.2 to 24.4 on the Noometry Index.

How many benchmarks do Llama 13b and Mistral Small 3.2 share?

1 benchmark has published results for both models. Llama 13b has 21 scored results on Noometry and Mistral Small 3.2 has 6.

Related comparisons

Go deeper