Model comparison

Falcon-7B vs Mistral Large

Mistral Large has enough public results to be ranked (#263); Falcon-7B does not yet, so treat this comparison as directional.

Last verified . 2 shared benchmarks.

Summary

  • They share 2 benchmarks with published results for both.

Side by side

Falcon-7B and Mistral Large specifications
Falcon-7BMistral Large
ProviderTechnology Innovation InstituteMistral AI
Noometry Index—31.9
Released2023-04-242024-02-26
WeightsOpenOpen
Context window—131K
Max output—16K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked1251

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-7B: —, Mistral Large: 34.3 (#240)

Coding benchmarks
BenchmarkFalcon-7BMistral Large
SciCode—36.2%
BigCodeBench Instruct—30%
LiveBench Coding—47.1%
LMArena Coding—1277
BigCodeBench Complete—38.3%
ALE-Bench—264.7
HumanEval+—62.2%
MBPP+—59.5%

Agentic & Tool Use Not comparable

Falcon-7B: —, Mistral Large: 28.6 (#89)

Agentic & Tool Use benchmarks
BenchmarkFalcon-7BMistral Large
Berkeley Function Calling Leaderboard—38.4%

Reasoning Not comparable

Falcon-7B: —, Mistral Large: 15.8 (#310)

Reasoning benchmarks
BenchmarkFalcon-7BMistral Large
Epoch Capabilities Index95.1128.52
SimpleBench—22.5%
CritPt—0%
LiveBench Reasoning—43.5%
LMArena Hard Prompts—1257
DTBench—65.1%
LiveBench Data Analysis—50.1%
LMCA—16.7%
BIG-Bench Hard28.8%—
ForecastBench—57.1
HellaSwag78.1%—
LAMBADA74.9%—
LiveBench—48.4%
PIQA80.3%—
WinoGrande67.2%—

Math Not comparable

Falcon-7B: —, Mistral Large: 18.2 (#291)

Math benchmarks
BenchmarkFalcon-7BMistral Large
OTIS Mock AIME 2024-2025—8.5%
Omni-MATH—28.1%
LiveBench Math—42.5%
LMArena Math—1262
MATH Level 5—50.3%
FrontierMath (Feb 2025 set)—0.3%
GSM8K6.8%—

Knowledge Not comparable

Falcon-7B: —, Mistral Large: 30.1 (#230)

Knowledge benchmarks
BenchmarkFalcon-7BMistral Large
MMLU35%80%
GPQA Diamond—51.3%
MMLU-Pro—59.9%
Confabulations—21.4%
Vectara Hallucination Rate—4.5%
GPQA (HELM)—43.5%
LMArena Expert—1232
ARC (AI2) Challenge47.9%—
BoolQ75.3%—
OpenBookQA51.6%—
TriviaQA64.6%—

Multilingual Not comparable

Falcon-7B: —, Mistral Large: 40.0 (#219)

Multilingual benchmarks
BenchmarkFalcon-7BMistral Large
LMArena Non-English—1237
LMArena Chinese—1240
LMArena French—1325
LMArena German—1254
LMArena Japanese—1188
LMArena Korean—1202
LMArena Russian—1257
LMArena Spanish—1268

Instruction Following Not comparable

Falcon-7B: —, Mistral Large: 67.9 (#191)

Instruction Following benchmarks
BenchmarkFalcon-7BMistral Large
LiveBench Instruction Following—67.9%
IFEval—87.7%
LMArena Instruction Following—1249

Long Context Not comparable

Falcon-7B: —, Mistral Large: 38.3 (#199)

Long Context benchmarks
BenchmarkFalcon-7BMistral Large
LMArena Longer Query—1261

Writing & Preference Not comparable

Falcon-7B: —, Mistral Large: 40.7 (#242)

Writing & Preference benchmarks
BenchmarkFalcon-7BMistral Large
LMArena Text—1266
LMArena Creative Writing—1243
Short-Story Creative Writing—69%
EQ-Bench Creative Writing—985
WildBench—80.1%
LMArena Multi-Turn—1260
LiveBench Language—39.4%

Frequently asked questions

Is Falcon-7B better than Mistral Large?

Mistral Large has enough public results to be ranked (#263); Falcon-7B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon-7B and Mistral Large share?

2 benchmarks have published results for both models. Falcon-7B has 12 scored results on Noometry and Mistral Large has 51.

Related comparisons

Go deeper