Model comparison

Llama 13b vs Mistral Medium

Mistral Medium is the stronger model overall, scoring 36.3 to 24.4 on the Noometry Index.

Last verified October 10, 2026. 8 shared benchmarks.

Summary

They share 8 benchmarks with published results for both. Llama 13b scores higher in 0 categories and Mistral Medium in 6 categories; 6 gaps are clear of the uncertainty.
The widest gap is in writing & preference, where Mistral Medium leads 60.0 to 13.8.

Side by side

Llama 13b and Mistral Medium specifications
	Llama 13b	Mistral Medium
Provider	Meta	Mistral AI
Noometry Index	24.4	36.3
Released	2023-02-24	2023-12-11
Weights	Open	Open
Context window	—	262K
Max output	—	262K
Input $ / M tokens	—	$1.50
Output $ / M tokens	—	$7.50
Results tracked	21	36

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Medium leads

Llama 13b: 21.4 (#337), Mistral Medium: 34.2 (#243)

Coding benchmarks
Benchmark	Llama 13b	Mistral Medium
LMArena Coding	683	1434
FrontierCode	—	8%
SciCode	—	40.2%
WeirdML	—	43.7%
ALE-Bench	—	763.98

Agentic & Tool Use Not comparable

Llama 13b: —, Mistral Medium: 28.3 (#90)

Agentic & Tool Use benchmarks
Benchmark	Llama 13b	Mistral Medium
Berkeley Function Calling Leaderboard	—	37.7%

Reasoning Mistral Medium leads

Llama 13b: 14.0 (#329), Mistral Medium: 24.0 (#167)

Reasoning benchmarks
Benchmark	Llama 13b	Mistral Medium
LMArena Hard Prompts	728	1426
Kagi LLM Benchmark	—	50%
CritPt	—	0%
DTBench	—	75.5%
LMCA	—	26.1%
Surface Evolver Bench	—	26.9%
BIG-Bench Hard	37.9%	—
Epoch Capabilities Index	100.58	—
HellaSwag	79.2%	—
LAMBADA	75.2%	—
PIQA	80.1%	—
WinoGrande	73%	—

Math Mistral Medium leads

Llama 13b: 26.7 (#256), Mistral Medium: 28.1 (#245)

Math benchmarks
Benchmark	Llama 13b	Mistral Medium
LMArena Math	838	1408
OTIS Mock AIME 2024-2025	—	32.2%
ProofBench	—	9%
MATH Level 5	—	81.6%
FrontierMath (Feb 2025 set)	—	0.3%
GSM8K	20.6%	—

Knowledge Not comparable

Llama 13b: —, Mistral Medium: 25.0 (#265)

Knowledge benchmarks
Benchmark	Llama 13b	Mistral Medium
GPQA Diamond	—	59.5%
Humanity's Last Exam	—	4.5%
Vectara Hallucination Rate	—	22.7%
LMArena Expert	—	1408
ARC (AI2) Challenge	52.7%	—
BoolQ	78.7%	—
MMLU	47.7%	—
OpenBookQA	56.4%	—
TriviaQA	77.9%	—

Multimodal Not comparable

Llama 13b: —, Mistral Medium: 35.3 (#88)

Multimodal benchmarks
Benchmark	Llama 13b	Mistral Medium
LMArena Vision	—	1172
ScienceQA	43.3%	—

Multilingual Mistral Medium leads

Llama 13b: 16.6 (#297), Mistral Medium: 52.1 (#91)

Multilingual benchmarks
Benchmark	Llama 13b	Mistral Medium
LMArena Non-English	819	1408
LMArena Chinese	—	1447
LMArena French	—	1459
LMArena German	—	1432
LMArena Japanese	—	1378
LMArena Korean	—	1380
LMArena Russian	—	1411
LMArena Spanish	—	1433

Instruction Following Mistral Medium leads

Llama 13b: 36.7 (#305), Mistral Medium: 73.7 (#116)

Instruction Following benchmarks
Benchmark	Llama 13b	Mistral Medium
LMArena Instruction Following	781	1398

Long Context Not comparable

Llama 13b: —, Mistral Medium: 42.9 (#114)

Long Context benchmarks
Benchmark	Llama 13b	Mistral Medium
LMArena Longer Query	—	1406

Writing & Preference Mistral Medium leads

Llama 13b: 13.8 (#312), Mistral Medium: 60.0 (#103)

Writing & Preference benchmarks
Benchmark	Llama 13b	Mistral Medium
LMArena Text	834	1424
LMArena Creative Writing	794	1391
LMArena Multi-Turn	753	1418
Short-Story Creative Writing	—	77.3%

Frequently asked questions

Is Llama 13b better than Mistral Medium?