Model comparison

Falcon 2 11B vs QwQ-32B

QwQ-32B has enough public results to be ranked (#153); Falcon 2 11B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Summary

  • They share 1 benchmark with published results for both.

Side by side

Falcon 2 11B and QwQ-32B specifications
Falcon 2 11BQwQ-32B
ProviderTechnology Innovation InstituteAlibaba (Qwen)
Noometry Index—39.4
Released2024-05-092024-11-28
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked536

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon 2 11B: —, QwQ-32B: 34.9 (#220)

Coding benchmarks
BenchmarkFalcon 2 11BQwQ-32B
Aider Polyglot—20.9%
BigCodeBench Instruct—44.6%
LiveBench Coding—72.2%
LMArena Coding—1333
BigCodeBench Complete—54.4%

Reasoning Not comparable

Falcon 2 11B: —, QwQ-32B: 22.9 (#171)

Reasoning benchmarks
BenchmarkFalcon 2 11BQwQ-32B
Epoch Capabilities Index109.25137.6
Chess Puzzles—5%
LiveBench Reasoning—83.5%
LMArena Hard Prompts—1326
LiveBench Data Analysis—65%
ForecastBench—58.3
HellaSwag82.9%—
LiveBench—72%
WinoGrande78.3%—

Math Not comparable

Falcon 2 11B: —, QwQ-32B: 36.2 (#123)

Math benchmarks
BenchmarkFalcon 2 11BQwQ-32B
OTIS Mock AIME 2024-2025—59.2%
LiveBench Math—77.8%
LMArena Math—1359
GSM8K53.8%—

Knowledge Not comparable

Falcon 2 11B: —, QwQ-32B: 37.2 (#150)

Knowledge benchmarks
BenchmarkFalcon 2 11BQwQ-32B
GPQA Diamond—65.3%
Confabulations—15.6%
LMArena Expert—1323
MMLU58.4%—

Multilingual Not comparable

Falcon 2 11B: —, QwQ-32B: 45.0 (#171)

Multilingual benchmarks
BenchmarkFalcon 2 11BQwQ-32B
LMArena Non-English—1306
LMArena Chinese—1378
LMArena French—1337
LMArena German—1313
LMArena Japanese—1263
LMArena Korean—1278
LMArena Russian—1297
LMArena Spanish—1353

Instruction Following Not comparable

Falcon 2 11B: —, QwQ-32B: 72.8 (#131)

Instruction Following benchmarks
BenchmarkFalcon 2 11BQwQ-32B
LiveBench Instruction Following—81.8%
LMArena Instruction Following—1297

Long Context Not comparable

Falcon 2 11B: —, QwQ-32B: 49.0 (#11)

Long Context benchmarks
BenchmarkFalcon 2 11BQwQ-32B
Fiction.LiveBench—83.3%
LMArena Longer Query—1308

Writing & Preference Not comparable

Falcon 2 11B: —, QwQ-32B: 50.9 (#175)

Writing & Preference benchmarks
BenchmarkFalcon 2 11BQwQ-32B
LMArena Text—1329
LMArena Creative Writing—1288
Short-Story Creative Writing—80.2%
EQ-Bench Creative Writing—1257
LMArena Multi-Turn—1314
LiveBench Language—51.4%

Frequently asked questions

Is Falcon 2 11B better than QwQ-32B?

QwQ-32B has enough public results to be ranked (#153); Falcon 2 11B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon 2 11B and QwQ-32B share?

1 benchmark has published results for both models. Falcon 2 11B has 5 scored results on Noometry and QwQ-32B has 36.

Related comparisons

Go deeper