Model comparison

Llama 13b vs Mistral Large

Mistral Large is the stronger model overall, scoring 31.6 to 23.9 on the Noometry Index.

Last verified . 10 shared benchmarks.

Llama 13b Meta

23.9

Rank #344 Confirmed

Mistral Large Mistral AI

31.6

Rank #258 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Llama 13b scores higher in 1 category and Mistral Large in 5 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in instruction following, where Mistral Large leads 68.1 to 36.9.

Side by side

Llama 13b and Mistral Large specifications
Llama 13bMistral Large
ProviderMetaMistral AI
Noometry Index23.931.6
Released2023-02-242024-02-26
WeightsOpenOpen
Context window—131K
Max output—16K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked2151

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Large leads

Llama 13b: 20.9 (#332), Mistral Large: 33.8 (#240)

Coding benchmarks
BenchmarkLlama 13bMistral Large
LMArena Coding6831277
SciCode—36.2%
BigCodeBench Instruct—30%
LiveBench Coding—47.1%
BigCodeBench Complete—38.3%
ALE-Bench—264.7
HumanEval+—62.2%
MBPP+—59.5%

Agentic & Tool Use Not comparable

Llama 13b: —, Mistral Large: 28.4 (#83)

Agentic & Tool Use benchmarks
BenchmarkLlama 13bMistral Large
Berkeley Function Calling Leaderboard—38.4%

Reasoning Mistral Large leads

Llama 13b: 13.4 (#327), Mistral Large: 15.4 (#305)

Reasoning benchmarks
BenchmarkLlama 13bMistral Large
LMArena Hard Prompts7281257
Epoch Capabilities Index100.09128.52
SimpleBench—22.5%
CritPt—0%
LiveBench Reasoning—43.5%
DTBench—65.1%
LiveBench Data Analysis—50.1%
LMCA—16.7%
BIG-Bench Hard37.9%—
ForecastBench—57.1
HellaSwag79.2%—
LAMBADA75.2%—
LiveBench—48.4%
PIQA80.1%—
WinoGrande73%—

Math Llama 13b leads

Llama 13b: 24.4 (#259), Mistral Large: 17.1 (#285)

Math benchmarks
BenchmarkLlama 13bMistral Large
LMArena Math8381262
OTIS Mock AIME 2024-2025—8.5%
Omni-MATH—28.1%
LiveBench Math—42.5%
MATH Level 5—50.3%
FrontierMath (Feb 2025 set)—0.3%
GSM8K20.6%—

Knowledge Not comparable

Llama 13b: —, Mistral Large: 30.0 (#224)

Knowledge benchmarks
BenchmarkLlama 13bMistral Large
MMLU47.7%80%
GPQA Diamond—51.3%
MMLU-Pro—59.9%
Confabulations—21.4%
Vectara Hallucination Rate—4.5%
GPQA (HELM)—43.5%
LMArena Expert—1232
ARC (AI2) Challenge52.7%—
BoolQ78.7%—
OpenBookQA56.4%—
TriviaQA77.9%—

Multimodal Not comparable

Llama 13b: —, Mistral Large: —

Multimodal benchmarks
BenchmarkLlama 13bMistral Large
ScienceQA43.3%—

Multilingual Mistral Large leads

Llama 13b: 16.8 (#292), Mistral Large: 40.1 (#214)

Multilingual benchmarks
BenchmarkLlama 13bMistral Large
LMArena Non-English8191237
LMArena Chinese—1240
LMArena French—1324
LMArena German—1254
LMArena Japanese—1187
LMArena Korean—1202
LMArena Russian—1257
LMArena Spanish—1268

Instruction Following Mistral Large leads

Llama 13b: 36.9 (#300), Mistral Large: 68.1 (#186)

Instruction Following benchmarks
BenchmarkLlama 13bMistral Large
LMArena Instruction Following7811249
LiveBench Instruction Following—67.9%
IFEval—87.7%

Long Context Not comparable

Llama 13b: —, Mistral Large: 38.3 (#194)

Long Context benchmarks
BenchmarkLlama 13bMistral Large
LMArena Longer Query—1262

Writing & Preference Mistral Large leads

Llama 13b: 13.9 (#307), Mistral Large: 40.9 (#237)

Writing & Preference benchmarks
BenchmarkLlama 13bMistral Large
LMArena Text8341266
LMArena Creative Writing7941243
LMArena Multi-Turn7531260
Short-Story Creative Writing—69%
EQ-Bench Creative Writing—985
WildBench—80.1%
LiveBench Language—39.4%

Frequently asked questions

Is Llama 13b better than Mistral Large?

Mistral Large is the stronger model overall, scoring 31.6 to 23.9 on the Noometry Index.

Is Llama 13b or Mistral Large better for coding?

Mistral Large scores higher on coding benchmarks: 33.8 versus 20.9 in the Noometry coding category.

How many benchmarks do Llama 13b and Mistral Large share?

10 benchmarks have published results for both models. Llama 13b has 21 scored results on Noometry and Mistral Large has 51.

Related comparisons

Go deeper