Model comparison

Falcon-180B vs GPT-4.5

GPT-4.5 is the stronger model overall, scoring 37.2 to 32.2 on the Noometry Index.

Last verified . 7 shared benchmarks.

GPT-4.5 OpenAI

37.2

Rank #208 Confirmed

Summary

  • They share 7 benchmarks with published results for both. Falcon-180B scores higher in 1 category and GPT-4.5 in 3 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GPT-4.5 leads 56.9 to 29.1.
  • Falcon-180B has downloadable open weights; the other is API-only.

Side by side

Falcon-180B and GPT-4.5 specifications
Falcon-180BGPT-4.5
ProviderTechnology Innovation InstituteOpenAI
Noometry Index32.237.2
Released2023-09-062025-02-27
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1642

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, GPT-4.5: 42.2 (#109)

Coding benchmarks
BenchmarkFalcon-180BGPT-4.5
Aider Polyglot—44.9%
WeirdML—39.4%
LiveBench Coding—75.2%
LMArena Coding—1396

Agentic & Tool Use Not comparable

Falcon-180B: —, GPT-4.5: 27.9 (#97)

Agentic & Tool Use benchmarks
BenchmarkFalcon-180BGPT-4.5
Cybench—17.5%

Reasoning Falcon-180B leads

Falcon-180B: 19.1 (#269), GPT-4.5: 13.9 (#330)

Reasoning benchmarks
BenchmarkFalcon-180BGPT-4.5
LMArena Hard Prompts10071403
Epoch Capabilities Index112.13136.74
ARC-AGI-2—0.8%
SimpleBench—34.5%
ARC-AGI-1—10.3%
EnigmaEval—3.2%
LiveBench Reasoning—71.1%
LiveBench Data Analysis—64.3%
ForecastBench—61.7
HellaSwag89%—
LAMBADA79.8%—
LiveBench—69%
PIQA84.9%—
WinoGrande87.1%—

Math Not comparable

Falcon-180B: —, GPT-4.5: 32.6 (#211)

Math benchmarks
BenchmarkFalcon-180BGPT-4.5
OTIS Mock AIME 2024-2025—37.8%
LiveBench Math—69.3%
LMArena Math—1412
MATH Level 5—78.6%
GSM8K54.4%—

Knowledge Not comparable

Falcon-180B: —, GPT-4.5: 32.5 (#211)

Knowledge benchmarks
BenchmarkFalcon-180BGPT-4.5
GPQA Diamond—68.7%
Humanity's Last Exam—5.4%
Confabulations—13.6%
LMArena Expert—1394
ARC (AI2) Challenge67.8%—
BoolQ89%—
MMLU70.6%—
OpenBookQA64.2%—

Multimodal Not comparable

Falcon-180B: —, GPT-4.5: 37.6 (#71)

Multimodal benchmarks
BenchmarkFalcon-180BGPT-4.5
LMArena Vision—1195
VPCT—45%

Multilingual GPT-4.5 leads

Falcon-180B: 25.2 (#286), GPT-4.5: 52.5 (#83)

Multilingual benchmarks
BenchmarkFalcon-180BGPT-4.5
LMArena Non-English10001413
LMArena Chinese—1421
LMArena French—1418
LMArena German—1457
LMArena Japanese—1416
LMArena Korean—1392
LMArena Russian—1419

Instruction Following GPT-4.5 leads

Falcon-180B: 53.4 (#286), GPT-4.5: 72.6 (#134)

Instruction Following benchmarks
BenchmarkFalcon-180BGPT-4.5
LMArena Instruction Following10471404
LiveBench Instruction Following—72.3%

Long Context Not comparable

Falcon-180B: —, GPT-4.5: 40.4 (#155)

Long Context benchmarks
BenchmarkFalcon-180BGPT-4.5
Fiction.LiveBench—63.9%
LMArena Longer Query—1406

Writing & Preference GPT-4.5 leads

Falcon-180B: 29.1 (#295), GPT-4.5: 56.9 (#134)

Writing & Preference benchmarks
BenchmarkFalcon-180BGPT-4.5
LMArena Text10541417
LMArena Creative Writing10891394
LMArena Multi-Turn10131444
Short-Story Creative Writing—75.6%
EQ-Bench Creative Writing—1258
LiveBench Language—61.5%

Frequently asked questions

Is Falcon-180B better than GPT-4.5?

GPT-4.5 is the stronger model overall, scoring 37.2 to 32.2 on the Noometry Index.

How many benchmarks do Falcon-180B and GPT-4.5 share?

7 benchmarks have published results for both models. Falcon-180B has 16 scored results on Noometry and GPT-4.5 has 42.

Related comparisons

Go deeper