Model comparison

Falcon 2 11B vs GPT-4o

GPT-4o has enough public results to be ranked (#316); Falcon 2 11B does not yet, so treat this comparison as directional.

Last verified October 10, 2026. 2 shared benchmarks.

Falcon 2 11B

Technology Innovation Institute

—

Unranked

GPT-4o OpenAI

28.5

Rank #316 Confirmed

Summary

They share 2 benchmarks with published results for both.
Falcon 2 11B has downloadable open weights; the other is API-only.

Side by side

Falcon 2 11B and GPT-4o specifications
	Falcon 2 11B	GPT-4o
Provider	Technology Innovation Institute	OpenAI
Noometry Index	—	28.5
Released	2024-05-09	2024-05-13
Weights	Open	Proprietary
Context window	—	128K
Max output	—	16K
Input $ / M tokens	—	$2.50
Output $ / M tokens	—	$10
Results tracked	5	72

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon 2 11B: —, GPT-4o: 25.1 (#323)

Coding benchmarks
Benchmark	Falcon 2 11B	GPT-4o
SWE-bench Verified	—	31%
SWE-bench Verified (bash only)	—	21.6%
Aider Polyglot	—	45.3%
GSO	—	0%
WeirdML	—	25.1%
BigCodeBench Instruct	—	51.1%
LiveBench Coding	—	51.4%
LMArena Coding	—	1297
BigCodeBench Complete	—	61.1%
CadEval	—	26%
HumanEval+	—	87.2%
MBPP+	—	72.2%

Agentic & Tool Use Not comparable

Falcon 2 11B: —, GPT-4o: 20.8 (#133)

Agentic & Tool Use benchmarks
Benchmark	Falcon 2 11B	GPT-4o
GDPval	—	9.9%
TheAgentCompany	—	8.6%
Cybench	—	12.5%
BALROG	—	32.3%
LMArena Search	—	1006
METR Time Horizons	—	40.8%

Reasoning Not comparable

Falcon 2 11B: —, GPT-4o: 9.4 (#338)

Reasoning benchmarks
Benchmark	Falcon 2 11B	GPT-4o
Epoch Capabilities Index	109.25	128.97
ARC-AGI-2	—	0%
SimpleBench	—	17.8%
ARC-AGI-1	—	4.5%
CritPt	—	0%
Chess Puzzles	—	13%
EnigmaEval	—	0.8%
LiveBench Reasoning	—	55.8%
LMArena Hard Prompts	—	1281
DTBench	—	64.5%
LiveBench Data Analysis	—	60.9%
LMCA	—	16.6%
ForecastBench	—	57.7
HellaSwag	82.9%	—
LiveBench	—	55.3%
WinoGrande	78.3%	—

Math Not comparable

Falcon 2 11B: —, GPT-4o: 10.2 (#303)

Math benchmarks
Benchmark	Falcon 2 11B	GPT-4o
FrontierMath (Tiers 1-3)	—	0.4%
OTIS Mock AIME 2024-2025	—	6.4%
Omni-MATH	—	29.3%
LiveBench Math	—	49.5%
LMArena Math	—	1285
MATH Level 5	—	53.3%
FrontierMath (Feb 2025 set)	—	0.3%
GSM8K	53.8%	—

Knowledge Not comparable

Falcon 2 11B: —, GPT-4o: 28.8 (#235)

Knowledge benchmarks
Benchmark	Falcon 2 11B	GPT-4o
MMLU	58.4%	88.1%
GPQA Diamond	—	49.2%
Humanity's Last Exam	—	2.7%
SimpleQA Verified	—	26%
MMLU-Pro	—	71.3%
Confabulations	—	15.3%
Vectara Hallucination Rate	—	9.6%
GPQA (HELM)	—	52%
LMArena Expert	—	1250

Multimodal Not comparable

Falcon 2 11B: —, GPT-4o: 33.9 (#85)

Multimodal benchmarks
Benchmark	Falcon 2 11B	GPT-4o
LMArena Vision	—	1137
Video-MME	—	71.9%
GeoBench	—	71%
VPCT	—	40%
ScienceQA	—	88.5%

Multilingual Not comparable

Falcon 2 11B: —, GPT-4o: 43.4 (#181)

Multilingual benchmarks
Benchmark	Falcon 2 11B	GPT-4o
LMArena Non-English	—	1283
LMArena Chinese	—	1277
LMArena French	—	1303
LMArena German	—	1282
LMArena Japanese	—	1257
LMArena Korean	—	1234
LMArena Russian	—	1286
LMArena Spanish	—	1292

Instruction Following Not comparable

Falcon 2 11B: —, GPT-4o: 66.8 (#202)

Instruction Following benchmarks
Benchmark	Falcon 2 11B	GPT-4o
LiveBench Instruction Following	—	68.6%
IFEval	—	81.7%
LMArena Instruction Following	—	1278

Long Context Not comparable

Falcon 2 11B: —, GPT-4o: 39.4 (#174)

Long Context benchmarks
Benchmark	Falcon 2 11B	GPT-4o
Fiction.LiveBench	—	66.7%
LMArena Longer Query	—	1289

Writing & Preference Not comparable

Falcon 2 11B: —, GPT-4o: 52.8 (#160)

Writing & Preference benchmarks
Benchmark	Falcon 2 11B	GPT-4o
LMArena Text	—	1300
LMArena Creative Writing	—	1291
Short-Story Creative Writing	—	81.8%
WildBench	—	82.8%
LMArena Multi-Turn	—	1302
LiveBench Language	—	47.6%

Frequently asked questions

Is Falcon 2 11B better than GPT-4o?