Model comparison

Falcon 2 11B vs Mistral Small 3

Mistral Small 3 has enough public results to be ranked (#268); Falcon 2 11B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Summary

  • They share 1 benchmark with published results for both.

Side by side

Falcon 2 11B and Mistral Small 3 specifications
Falcon 2 11BMistral Small 3
ProviderTechnology Innovation InstituteMistral AI
Noometry Index—30.9
Released2024-05-092025-01-30
WeightsOpenOpen
Context window—33K
Max output—16K
Input $ / M tokens—$0.05
Output $ / M tokens—$0.08
Results tracked524

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon 2 11B: —, Mistral Small 3: 36.0 (#203)

Coding benchmarks
BenchmarkFalcon 2 11BMistral Small 3
BigCodeBench Instruct—45.3%
LMArena Coding—1246
BigCodeBench Complete—50.4%

Reasoning Not comparable

Falcon 2 11B: —, Mistral Small 3: 18.2 (#269)

Reasoning benchmarks
BenchmarkFalcon 2 11BMistral Small 3
Epoch Capabilities Index109.25127.06
Chess Puzzles—0%
LMArena Hard Prompts—1233
HellaSwag82.9%—
WinoGrande78.3%—

Math Not comparable

Falcon 2 11B: —, Mistral Small 3: 15.3 (#290)

Math benchmarks
BenchmarkFalcon 2 11BMistral Small 3
OTIS Mock AIME 2024-2025—6.7%
LMArena Math—1240
GSM8K53.8%—

Knowledge Not comparable

Falcon 2 11B: —, Mistral Small 3: 25.0 (#258)

Knowledge benchmarks
BenchmarkFalcon 2 11BMistral Small 3
GPQA Diamond—47.3%
Confabulations—25.2%
LMArena Expert—1202
MMLU58.4%—

Multilingual Not comparable

Falcon 2 11B: —, Mistral Small 3: 37.5 (#231)

Multilingual benchmarks
BenchmarkFalcon 2 11BMistral Small 3
LMArena Non-English—1198
LMArena Chinese—1204
LMArena French—1202
LMArena German—1211
LMArena Japanese—1111
LMArena Korean—1188
LMArena Russian—1216

Instruction Following Not comparable

Falcon 2 11B: —, Mistral Small 3: 63.9 (#224)

Instruction Following benchmarks
BenchmarkFalcon 2 11BMistral Small 3
LMArena Instruction Following—1214

Long Context Not comparable

Falcon 2 11B: —, Mistral Small 3: 37.8 (#206)

Long Context benchmarks
BenchmarkFalcon 2 11BMistral Small 3
LMArena Longer Query—1246

Writing & Preference Not comparable

Falcon 2 11B: —, Mistral Small 3: 32.4 (#275)

Writing & Preference benchmarks
BenchmarkFalcon 2 11BMistral Small 3
LMArena Text—1234
LMArena Creative Writing—1195
EQ-Bench Creative Writing—707
LMArena Multi-Turn—1217

Frequently asked questions

Is Falcon 2 11B better than Mistral Small 3?

Mistral Small 3 has enough public results to be ranked (#268); Falcon 2 11B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon 2 11B and Mistral Small 3 share?

1 benchmark has published results for both models. Falcon 2 11B has 5 scored results on Noometry and Mistral Small 3 has 24.

Related comparisons

Go deeper