Model comparison

Falcon 2 11B vs Qwen2.5 32B Instruct

Qwen2.5 32B Instruct has enough public results to be ranked (#297); Falcon 2 11B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Summary

  • They share 1 benchmark with published results for both.

Side by side

Falcon 2 11B and Qwen2.5 32B Instruct specifications
Falcon 2 11BQwen2.5 32B Instruct
ProviderTechnology Innovation InstituteAlibaba (Qwen)
Noometry Index—30.1
Released2024-05-092024-09
WeightsOpenOpen
Context window—131K
Max output—8K
Input $ / M tokens—$0.70
Output $ / M tokens—$2.80
Results tracked57

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon 2 11B: —, Qwen2.5 32B Instruct: 38.7 (#169)

Coding benchmarks
BenchmarkFalcon 2 11BQwen2.5 32B Instruct
BigCodeBench Instruct—45%
BigCodeBench Complete—52.3%

Reasoning Not comparable

Falcon 2 11B: —, Qwen2.5 32B Instruct: 19.2 (#266)

Reasoning benchmarks
BenchmarkFalcon 2 11BQwen2.5 32B Instruct
Epoch Capabilities Index109.56128.52
Chess Puzzles—0%
HellaSwag82.9%—
WinoGrande78.3%—

Math Not comparable

Falcon 2 11B: —, Qwen2.5 32B Instruct: 16.2 (#296)

Math benchmarks
BenchmarkFalcon 2 11BQwen2.5 32B Instruct
OTIS Mock AIME 2024-2025—7.4%
MATH Level 5—56.1%
GSM8K53.8%—

Knowledge Not comparable

Falcon 2 11B: —, Qwen2.5 32B Instruct: 24.9 (#266)

Knowledge benchmarks
BenchmarkFalcon 2 11BQwen2.5 32B Instruct
GPQA Diamond—46.1%
MMLU58.4%—

Frequently asked questions

Is Falcon 2 11B better than Qwen2.5 32B Instruct?

Qwen2.5 32B Instruct has enough public results to be ranked (#297); Falcon 2 11B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon 2 11B and Qwen2.5 32B Instruct share?

1 benchmark has published results for both models. Falcon 2 11B has 5 scored results on Noometry and Qwen2.5 32B Instruct has 7.

Related comparisons

Go deeper