Model comparison

Falcon-180B vs GPT-5.1-Codex

GPT-5.1-Codex is the stronger model overall, scoring 38.6 to 32.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

GPT-5.1-Codex OpenAI

38.6

Rank #186 Reported

Summary

  • Falcon-180B has downloadable open weights; the other is API-only.

Side by side

Falcon-180B and GPT-5.1-Codex specifications
Falcon-180BGPT-5.1-Codex
ProviderTechnology Innovation InstituteOpenAI
Noometry Index32.238.6
Released2023-09-062025-11-12
WeightsOpenProprietary
Context window—400K
Max output—128K
Input $ / M tokens—$1.25
Output $ / M tokens—$10
Results tracked166

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, GPT-5.1-Codex: 41.9 (#116)

Coding benchmarks
BenchmarkFalcon-180BGPT-5.1-Codex
SWE-bench Verified (bash only)—66%
LMArena WebDev—1337
ALE-Bench—1,245

Agentic & Tool Use Not comparable

Falcon-180B: —, GPT-5.1-Codex: 38.0 (#33)

Agentic & Tool Use benchmarks
BenchmarkFalcon-180BGPT-5.1-Codex
Terminal-Bench—60.4%
METR Time Horizons—70.8%

Reasoning Not comparable

Falcon-180B: 19.1 (#269), GPT-5.1-Codex: —

Reasoning benchmarks
BenchmarkFalcon-180BGPT-5.1-Codex
LMArena Hard Prompts1007—
Epoch Capabilities Index112.13—
HellaSwag89%—
LAMBADA79.8%—
PIQA84.9%—
WinoGrande87.1%—

Math Not comparable

Falcon-180B: —, GPT-5.1-Codex: 30.3 (#235)

Math benchmarks
BenchmarkFalcon-180BGPT-5.1-Codex
ProofBench—9%
GSM8K54.4%—

Knowledge Not comparable

Falcon-180B: —, GPT-5.1-Codex: —

Knowledge benchmarks
BenchmarkFalcon-180BGPT-5.1-Codex
ARC (AI2) Challenge67.8%—
BoolQ89%—
MMLU70.6%—
OpenBookQA64.2%—

Multilingual Not comparable

Falcon-180B: 25.2 (#286), GPT-5.1-Codex: —

Multilingual benchmarks
BenchmarkFalcon-180BGPT-5.1-Codex
LMArena Non-English1000—

Instruction Following Not comparable

Falcon-180B: 53.4 (#286), GPT-5.1-Codex: —

Instruction Following benchmarks
BenchmarkFalcon-180BGPT-5.1-Codex
LMArena Instruction Following1047—

Writing & Preference Not comparable

Falcon-180B: 29.1 (#295), GPT-5.1-Codex: —

Writing & Preference benchmarks
BenchmarkFalcon-180BGPT-5.1-Codex
LMArena Text1054—
LMArena Creative Writing1089—
LMArena Multi-Turn1013—

Frequently asked questions

Is Falcon-180B better than GPT-5.1-Codex?

GPT-5.1-Codex is the stronger model overall, scoring 38.6 to 32.2 on the Noometry Index.

How many benchmarks do Falcon-180B and GPT-5.1-Codex share?

0 benchmarks have published results for both models. Falcon-180B has 16 scored results on Noometry and GPT-5.1-Codex has 6.

Related comparisons

Go deeper