Model comparison

Falcon-7B vs o1-pro

o1-pro has enough public results to be ranked (#264); Falcon-7B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

o1-pro OpenAI

31.2

Rank #264 Reported

Summary

  • Falcon-7B has downloadable open weights; the other is API-only.

Side by side

Falcon-7B and o1-pro specifications
Falcon-7Bo1-pro
ProviderTechnology Innovation InstituteOpenAI
Noometry Index—31.2
Released2023-04-242025-03-19
WeightsOpenProprietary
Context window—200K
Max output—100K
Input $ / M tokens—$150
Output $ / M tokens—$600
Results tracked123

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Reasoning Not comparable

Falcon-7B: —, o1-pro: 20.2 (#223)

Reasoning benchmarks
BenchmarkFalcon-7Bo1-pro
ARC-AGI-1—23.3%
EnigmaEval—6.1%
BIG-Bench Hard28.8%—
Epoch Capabilities Index94.49—
HellaSwag78.1%—
LAMBADA74.9%—
PIQA80.3%—
WinoGrande67.2%—

Math Not comparable

Falcon-7B: —, o1-pro: —

Math benchmarks
BenchmarkFalcon-7Bo1-pro
GSM8K6.8%—

Knowledge Not comparable

Falcon-7B: —, o1-pro: 29.3 (#227)

Knowledge benchmarks
BenchmarkFalcon-7Bo1-pro
Humanity's Last Exam—8.1%
ARC (AI2) Challenge47.9%—
BoolQ75.3%—
MMLU35%—
OpenBookQA51.6%—
TriviaQA64.6%—

Frequently asked questions

Is Falcon-7B better than o1-pro?

o1-pro has enough public results to be ranked (#264); Falcon-7B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon-7B and o1-pro share?

0 benchmarks have published results for both models. Falcon-7B has 12 scored results on Noometry and o1-pro has 3.

Related comparisons

Go deeper