Model comparison

Falcon 2 11B vs Ministral 8B

Ministral 8B has enough public results to be ranked (#321); Falcon 2 11B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Side by side

Falcon 2 11B and Ministral 8B specifications
Falcon 2 11BMinistral 8B
ProviderTechnology Innovation InstituteMistral AI
Noometry Index—27.8
Released2024-05-092024-10-01
WeightsOpenOpen
Context window—128K
Max output—128K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.10
Results tracked517

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon 2 11B: —, Ministral 8B: 34.4 (#226)

Coding benchmarks
BenchmarkFalcon 2 11BMinistral 8B
LMArena Coding—1202

Agentic & Tool Use Not comparable

Falcon 2 11B: —, Ministral 8B: 16.2 (#140)

Agentic & Tool Use benchmarks
BenchmarkFalcon 2 11BMinistral 8B
Berkeley Function Calling Leaderboard—11.1%

Reasoning Not comparable

Falcon 2 11B: —, Ministral 8B: 17.7 (#279)

Reasoning benchmarks
BenchmarkFalcon 2 11BMinistral 8B
LMArena Hard Prompts—1191
DTBench—45.7%
Epoch Capabilities Index109.25—
HellaSwag82.9%—
WinoGrande78.3%—

Math Not comparable

Falcon 2 11B: —, Ministral 8B: 23.7 (#262)

Math benchmarks
BenchmarkFalcon 2 11BMinistral 8B
LMArena Math—1188
MATH Level 5—14.9%
GSM8K53.8%—

Knowledge Not comparable

Falcon 2 11B: —, Ministral 8B: 12.5 (#292)

Knowledge benchmarks
BenchmarkFalcon 2 11BMinistral 8B
GPQA Diamond—27.1%
Vectara Hallucination Rate—7.4%
LMArena Expert—1170
MMLU58.4%—

Multilingual Not comparable

Falcon 2 11B: —, Ministral 8B: 35.3 (#242)

Multilingual benchmarks
BenchmarkFalcon 2 11BMinistral 8B
LMArena Non-English—1165
LMArena Chinese—1193
LMArena Russian—1195

Instruction Following Not comparable

Falcon 2 11B: —, Ministral 8B: 60.7 (#245)

Instruction Following benchmarks
BenchmarkFalcon 2 11BMinistral 8B
LMArena Instruction Following—1161

Long Context Not comparable

Falcon 2 11B: —, Ministral 8B: 36.7 (#222)

Long Context benchmarks
BenchmarkFalcon 2 11BMinistral 8B
LMArena Longer Query—1212

Writing & Preference Not comparable

Falcon 2 11B: —, Ministral 8B: 39.8 (#241)

Writing & Preference benchmarks
BenchmarkFalcon 2 11BMinistral 8B
LMArena Text—1191
LMArena Creative Writing—1175
LMArena Multi-Turn—1166

Frequently asked questions

Is Falcon 2 11B better than Ministral 8B?

Ministral 8B has enough public results to be ranked (#321); Falcon 2 11B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon 2 11B and Ministral 8B share?

0 benchmarks have published results for both models. Falcon 2 11B has 5 scored results on Noometry and Ministral 8B has 17.

Related comparisons

Go deeper