Model comparison

Falcon 2 11B vs GPT-5.4 Pro

GPT-5.4 Pro has enough public results to be ranked (#18); Falcon 2 11B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Summary

  • They share 1 benchmark with published results for both.
  • Falcon 2 11B has downloadable open weights; the other is API-only.

Side by side

Falcon 2 11B and GPT-5.4 Pro specifications
Falcon 2 11BGPT-5.4 Pro
ProviderTechnology Innovation InstituteOpenAI
Noometry Index—58.9
Released2024-05-092026-03-05
WeightsOpenProprietary
Context window—1.05M
Max output—128K
Input $ / M tokens—$30
Output $ / M tokens—$180
Results tracked516

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon 2 11B: —, GPT-5.4 Pro: 43.2 (#90)

Coding benchmarks
BenchmarkFalcon 2 11BGPT-5.4 Pro
WeirdML—57.4%

Reasoning Not comparable

Falcon 2 11B: —, GPT-5.4 Pro: 70.7 (#13)

Reasoning benchmarks
BenchmarkFalcon 2 11BGPT-5.4 Pro
Epoch Capabilities Index109.56158.93
ARC-AGI-2—83.3%
SimpleBench—74.1%
ARC-AGI-1—94.5%
CritPt—30%
Chess Puzzles—58.6%
EnigmaEval—23.8%
HellaSwag82.9%—
WinoGrande78.3%—

Math Not comparable

Falcon 2 11B: —, GPT-5.4 Pro: 72.4 (#22)

Math benchmarks
BenchmarkFalcon 2 11BGPT-5.4 Pro
FrontierMath (Tiers 1-3)—82.5%
FrontierMath Tier 4—58.5%
FrontierMath (Feb 2025 set)—50%
FrontierMath Tier 4 (v1)—37.5%
GSM8K53.8%—

Knowledge Not comparable

Falcon 2 11B: —, GPT-5.4 Pro: 68.3 (#7)

Knowledge benchmarks
BenchmarkFalcon 2 11BGPT-5.4 Pro
GPQA Diamond—94.6%
Humanity's Last Exam—44.3%
SimpleQA Verified—46.3%
Vectara Hallucination Rate—8.3%
MMLU58.4%—

Frequently asked questions

Is Falcon 2 11B better than GPT-5.4 Pro?

GPT-5.4 Pro has enough public results to be ranked (#18); Falcon 2 11B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon 2 11B and GPT-5.4 Pro share?

1 benchmark has published results for both models. Falcon 2 11B has 5 scored results on Noometry and GPT-5.4 Pro has 16.

Related comparisons

Go deeper