Model comparison

Falcon 2 11B vs INTELLECT-1

Neither Falcon 2 11B nor INTELLECT-1 has enough public benchmark results to be ranked yet; the rows below show what has been published.

Last verified . 5 shared benchmarks.

Summary

  • They share 5 benchmarks with published results for both.
  • Falcon 2 11B has downloadable open weights; the other is API-only.

Side by side

Falcon 2 11B and INTELLECT-1 specifications
Falcon 2 11BINTELLECT-1
ProviderTechnology Innovation InstituteHugging Face
Noometry Index——
Released2024-05-092024-11-29
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked57

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Reasoning Not comparable

Falcon 2 11B: —, INTELLECT-1: —

Reasoning benchmarks
BenchmarkFalcon 2 11BINTELLECT-1
Epoch Capabilities Index109.56100.86
HellaSwag82.9%71.4%
WinoGrande78.3%65.8%
BIG-Bench Hard—34.9%

Math Not comparable

Falcon 2 11B: —, INTELLECT-1: —

Math benchmarks
BenchmarkFalcon 2 11BINTELLECT-1
GSM8K53.8%38.6%

Knowledge Not comparable

Falcon 2 11B: —, INTELLECT-1: —

Knowledge benchmarks
BenchmarkFalcon 2 11BINTELLECT-1
MMLU58.4%49.9%
ARC (AI2) Challenge—54.5%

Frequently asked questions

Is Falcon 2 11B better than INTELLECT-1?

Neither Falcon 2 11B nor INTELLECT-1 has enough public benchmark results to be ranked yet; the rows below show what has been published.

How many benchmarks do Falcon 2 11B and INTELLECT-1 share?

5 benchmarks have published results for both models. Falcon 2 11B has 5 scored results on Noometry and INTELLECT-1 has 7.

Related comparisons

Go deeper