Model comparison

Llama 2-7B vs Mistral Large

Mistral Large is the stronger model overall, scoring 31.9 to 29.1 on the Noometry Index.

Last verified October 10, 2026. 17 shared benchmarks.

Summary

They share 17 benchmarks with published results for both. Llama 2-7B scores higher in 1 category and Mistral Large in 7 categories; 7 gaps are clear of the uncertainty.
The widest gap is in instruction following, where Mistral Large leads 67.9 to 50.8.

Side by side

Llama 2-7B and Mistral Large specifications
	Llama 2-7B	Mistral Large
Provider	Meta	Mistral AI
Noometry Index	29.1	31.9
Released	2023-07-18	2024-02-26
Weights	Open	Open
Context window	—	131K
Max output	—	16K
Input $ / M tokens	—	$2
Output $ / M tokens	—	$6
Results tracked	29	51

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Large leads

Llama 2-7B: 29.2 (#307), Mistral Large: 34.3 (#240)

Coding benchmarks
Benchmark	Llama 2-7B	Mistral Large
LMArena Coding	1002	1277
SciCode	—	36.2%
BigCodeBench Instruct	—	30%
LiveBench Coding	—	47.1%
BigCodeBench Complete	—	38.3%
ALE-Bench	—	264.7
HumanEval+	—	62.2%
MBPP+	—	59.5%

Agentic & Tool Use Not comparable

Llama 2-7B: —, Mistral Large: 28.6 (#89)

Agentic & Tool Use benchmarks
Benchmark	Llama 2-7B	Mistral Large
Berkeley Function Calling Leaderboard	—	38.4%

Reasoning Too close to call

Llama 2-7B: 15.7 (#312), Mistral Large: 15.8 (#310)

Reasoning benchmarks
Benchmark	Llama 2-7B	Mistral Large
LMArena Hard Prompts	1009	1257
Epoch Capabilities Index	99.06	128.52
SimpleBench	—	22.5%
CritPt	—	0%
Chess Puzzles	0%	—
LiveBench Reasoning	—	43.5%
DTBench	—	65.1%
LiveBench Data Analysis	—	50.1%
LMCA	—	16.7%
BIG-Bench Hard	39.2%	—
ForecastBench	—	57.1
HellaSwag	77.2%	—
LAMBADA	73.3%	—
LiveBench	—	48.4%
PIQA	78.8%	—
WinoGrande	69.2%	—

Math Llama 2-7B leads

Llama 2-7B: 30.7 (#233), Mistral Large: 18.2 (#291)

Math benchmarks
Benchmark	Llama 2-7B	Mistral Large
LMArena Math	1042	1262
OTIS Mock AIME 2024-2025	—	8.5%
Omni-MATH	—	28.1%
LiveBench Math	—	42.5%
MATH Level 5	—	50.3%
FrontierMath (Feb 2025 set)	—	0.3%
GSM8K	16.7%	—

Knowledge Mistral Large leads

Llama 2-7B: 28.2 (#248), Mistral Large: 30.1 (#230)

Knowledge benchmarks
Benchmark	Llama 2-7B	Mistral Large
LMArena Expert	1036	1232
MMLU	45.8%	80%
GPQA Diamond	—	51.3%
MMLU-Pro	—	59.9%
Confabulations	—	21.4%
Vectara Hallucination Rate	—	4.5%
GPQA (HELM)	—	43.5%
ARC (AI2) Challenge	45.9%	—
BoolQ	77.9%	—
OpenBookQA	58.6%	—
TriviaQA	73.7%	—

Multimodal Not comparable

Llama 2-7B: —, Mistral Large: —

Multimodal benchmarks
Benchmark	Llama 2-7B	Mistral Large
ScienceQA	43.1%	—

Multilingual Mistral Large leads

Llama 2-7B: 23.8 (#293), Mistral Large: 40.0 (#219)

Multilingual benchmarks
Benchmark	Llama 2-7B	Mistral Large
LMArena Non-English	973	1237
LMArena Chinese	973	1240
LMArena French	970	1325
LMArena German	978	1254
LMArena Russian	995	1257
LMArena Spanish	1007	1268
LMArena Japanese	—	1188
LMArena Korean	—	1202

Instruction Following Mistral Large leads

Llama 2-7B: 50.8 (#298), Mistral Large: 67.9 (#191)

Instruction Following benchmarks
Benchmark	Llama 2-7B	Mistral Large
LMArena Instruction Following	1006	1249
LiveBench Instruction Following	—	67.9%
IFEval	—	87.7%

Long Context Mistral Large leads

Llama 2-7B: 30.4 (#287), Mistral Large: 38.3 (#199)

Long Context benchmarks
Benchmark	Llama 2-7B	Mistral Large
LMArena Longer Query	999	1261

Writing & Preference Mistral Large leads

Llama 2-7B: 28.0 (#298), Mistral Large: 40.7 (#242)

Writing & Preference benchmarks
Benchmark	Llama 2-7B	Mistral Large
LMArena Text	1053	1266
LMArena Creative Writing	1033	1243
LMArena Multi-Turn	1029	1260
Short-Story Creative Writing	—	69%
EQ-Bench Creative Writing	—	985
WildBench	—	80.1%
LiveBench Language	—	39.4%

Frequently asked questions

Is Llama 2-7B better than Mistral Large?