Model comparison

Falcon-40B vs Mistral Small 3.2

Mistral Small 3.2 has enough public results to be ranked (#280); Falcon-40B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Summary

  • They share 1 benchmark with published results for both.

Side by side

Falcon-40B and Mistral Small 3.2 specifications
Falcon-40BMistral Small 3.2
ProviderTechnology Innovation InstituteMistral AI
Noometry Index—31.2
Released2023-03-152025-06-20
WeightsOpenOpen
Context window—256K
Max output—16K
Input $ / M tokens—$0.0938
Output $ / M tokens—$0.25
Results tracked126

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Reasoning Not comparable

Falcon-40B: —, Mistral Small 3.2: 18.1 (#287)

Reasoning benchmarks
BenchmarkFalcon-40BMistral Small 3.2
Epoch Capabilities Index104.45131.74
Kagi LLM Benchmark—40.4%
Chess Puzzles—1%
BIG-Bench Hard37.1%—
HellaSwag85.3%—
LAMBADA77.3%—
PIQA83%—
WinoGrande76.9%—

Math Not comparable

Falcon-40B: —, Mistral Small 3.2: 26.3 (#260)

Math benchmarks
BenchmarkFalcon-40BMistral Small 3.2
OTIS Mock AIME 2024-2025—30.3%
GSM8K33.8%—

Knowledge Not comparable

Falcon-40B: —, Mistral Small 3.2: 26.7 (#256)

Knowledge benchmarks
BenchmarkFalcon-40BMistral Small 3.2
GPQA Diamond—49.1%
ARC (AI2) Challenge61.9%—
BoolQ83.1%—
MMLU56.9%—
OpenBookQA56.6%—
TriviaQA79.9%—

Writing & Preference Not comparable

Falcon-40B: —, Mistral Small 3.2: 45.0 (#224)

Writing & Preference benchmarks
BenchmarkFalcon-40BMistral Small 3.2
EQ-Bench Creative Writing—1255

Frequently asked questions

Is Falcon-40B better than Mistral Small 3.2?

Mistral Small 3.2 has enough public results to be ranked (#280); Falcon-40B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon-40B and Mistral Small 3.2 share?

1 benchmark has published results for both models. Falcon-40B has 12 scored results on Noometry and Mistral Small 3.2 has 6.

Related comparisons

Go deeper