Model comparison

Falcon-180B vs GPT-5

GPT-5 is the stronger model overall, scoring 50.9 to 32.2 on the Noometry Index.

Last verified October 10, 2026. 7 shared benchmarks.

Falcon-180B

Technology Innovation Institute

32.2

Rank #260 Confirmed

GPT-5 OpenAI

50.9

Rank #45 Confirmed

Summary

They share 7 benchmarks with published results for both. Falcon-180B scores higher in 0 categories and GPT-5 in 4 categories; 4 gaps are clear of the uncertainty.
The widest gap is in writing & preference, where GPT-5 leads 63.4 to 29.1.
Falcon-180B has downloadable open weights; the other is API-only.

Side by side

Falcon-180B and GPT-5 specifications
	Falcon-180B	GPT-5
Provider	Technology Innovation Institute	OpenAI
Noometry Index	32.2	50.9
Released	2023-09-06	2025-08-07
Weights	Open	Proprietary
Context window	—	400K
Max output	—	128K
Input $ / M tokens	—	$1.25
Output $ / M tokens	—	$10
Results tracked	16	69

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, GPT-5: 50.3 (#47)

Coding benchmarks
Benchmark	Falcon-180B	GPT-5
SWE-bench Verified	—	73.6%
SWE-bench Verified (bash only)	—	65%
Aider Polyglot	—	88%
LMArena WebDev	—	1418
SciCode	—	42.9%
GSO	—	6.9%
WeirdML	—	60.7%
LMArena Coding	—	1436
ALE-Bench	—	1,162
AlgoTune	—	1.67

Agentic & Tool Use Not comparable

Falcon-180B: —, GPT-5: 33.1 (#56)

Agentic & Tool Use benchmarks
Benchmark	Falcon-180B	GPT-5
Terminal-Bench	—	49.6%
GDPval	—	34.8%
Remote Labor Index	—	1.7%
DeepResearch Bench	—	49.6%
BALROG	—	32.8%
LMArena Search	—	1133
METR Time Horizons	—	69.6%

Reasoning GPT-5 leads

Falcon-180B: 19.1 (#269), GPT-5: 38.3 (#64)

Reasoning benchmarks
Benchmark	Falcon-180B	GPT-5
LMArena Hard Prompts	1007	1416
Epoch Capabilities Index	112.13	150
ARC-AGI-2	—	9.9%
SimpleBench	—	56.7%
Kagi LLM Benchmark	—	72.7%
ARC-AGI-1	—	65.7%
CritPt	—	12.6%
Chess Puzzles	—	37%
EnigmaEval	—	10.5%
EBR-Bench	—	12.7%
Mystery Game Puzzles	—	23%
DTBench	—	90.7%
LMCA	—	40%
ForecastBench	—	61.4
HellaSwag	89%	—
LAMBADA	79.8%	—
PIQA	84.9%	—
WinoGrande	87.1%	—

Math Not comparable

Falcon-180B: —, GPT-5: 55.0 (#44)

Math benchmarks
Benchmark	Falcon-180B	GPT-5
FrontierMath (Tiers 1-3)	—	55.4%
FrontierMath Tier 4	—	22%
OTIS Mock AIME 2024-2025	—	91.4%
ProofBench	—	18%
Omni-MATH	—	64.7%
LMArena Math	—	1407
MATH Level 5	—	98.1%
FrontierMath (Feb 2025 set)	—	32.4%
FrontierMath Tier 4 (v1)	—	12.5%
GSM8K	54.4%	—

Knowledge Not comparable

Falcon-180B: —, GPT-5: 56.6 (#43)

Knowledge benchmarks
Benchmark	Falcon-180B	GPT-5
GPQA Diamond	—	86.2%
Humanity's Last Exam	—	25.3%
SimpleQA Verified	—	50.1%
MMLU-Pro	—	86.3%
Confabulations	—	10.3%
Vectara Hallucination Rate	—	14.7%
GPQA (HELM)	—	79.2%
LMArena Expert	—	1419
ARC (AI2) Challenge	67.8%	—
BoolQ	89%	—
MMLU	70.6%	—
OpenBookQA	64.2%	—

Multimodal Not comparable

Falcon-180B: —, GPT-5: 46.8 (#13)

Multimodal benchmarks
Benchmark	Falcon-180B	GPT-5
LMArena Vision	—	1232
GeoBench	—	81%
VPCT	—	66%

Multilingual GPT-5 leads

Falcon-180B: 25.2 (#286), GPT-5: 51.4 (#110)

Multilingual benchmarks
Benchmark	Falcon-180B	GPT-5
LMArena Non-English	1000	1397
LMArena Chinese	—	1422
LMArena French	—	1410
LMArena German	—	1416
LMArena Japanese	—	1409
LMArena Korean	—	1360
LMArena Russian	—	1406
LMArena Spanish	—	1399

Instruction Following GPT-5 leads

Falcon-180B: 53.4 (#286), GPT-5: 73.8 (#113)

Instruction Following benchmarks
Benchmark	Falcon-180B	GPT-5
LMArena Instruction Following	1047	1388
IFEval	—	87.5%

Long Context Not comparable

Falcon-180B: —, GPT-5: 69.5 (#2)

Long Context benchmarks
Benchmark	Falcon-180B	GPT-5
Fiction.LiveBench	—	97.2%
LMArena Longer Query	—	1399

Writing & Preference GPT-5 leads

Falcon-180B: 29.1 (#295), GPT-5: 63.4 (#65)

Writing & Preference benchmarks
Benchmark	Falcon-180B	GPT-5
LMArena Text	1054	1406
LMArena Creative Writing	1089	1365
LMArena Multi-Turn	1013	1426
Short-Story Creative Writing	—	86%
EQ-Bench Creative Writing	—	1627
WildBench	—	85.7%

Frequently asked questions

Is Falcon-180B better than GPT-5?