Model comparison

Falcon-40B vs Grok Build 0.1

Grok Build 0.1 has enough public results to be ranked (#216); Falcon-40B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Summary

  • Falcon-40B has downloadable open weights; the other is API-only.

Side by side

Falcon-40B and Grok Build 0.1 specifications
Falcon-40BGrok Build 0.1
ProviderTechnology Innovation InstitutexAI
Noometry Index—36.4
Released2023-03-152026-04-16
WeightsOpenProprietary
Context window—256K
Max output—256K
Input $ / M tokens—$1
Output $ / M tokens—$2
Results tracked123

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-40B: —, Grok Build 0.1: 43.1 (#91)

Coding benchmarks
BenchmarkFalcon-40BGrok Build 0.1
SciCode—50.2%

Agentic & Tool Use Not comparable

Falcon-40B: —, Grok Build 0.1: 22.7 (#129)

Agentic & Tool Use benchmarks
BenchmarkFalcon-40BGrok Build 0.1
GBAEval—2.4%

Reasoning Not comparable

Falcon-40B: —, Grok Build 0.1: 32.2 (#77)

Reasoning benchmarks
BenchmarkFalcon-40BGrok Build 0.1
CritPt—9.1%
BIG-Bench Hard37.1%—
Epoch Capabilities Index104.45—
HellaSwag85.3%—
LAMBADA77.3%—
PIQA83%—
WinoGrande76.9%—

Math Not comparable

Falcon-40B: —, Grok Build 0.1: —

Math benchmarks
BenchmarkFalcon-40BGrok Build 0.1
GSM8K33.8%—

Knowledge Not comparable

Falcon-40B: —, Grok Build 0.1: —

Knowledge benchmarks
BenchmarkFalcon-40BGrok Build 0.1
ARC (AI2) Challenge61.9%—
BoolQ83.1%—
MMLU56.9%—
OpenBookQA56.6%—
TriviaQA79.9%—

Frequently asked questions

Is Falcon-40B better than Grok Build 0.1?

Grok Build 0.1 has enough public results to be ranked (#216); Falcon-40B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon-40B and Grok Build 0.1 share?

0 benchmarks have published results for both models. Falcon-40B has 12 scored results on Noometry and Grok Build 0.1 has 3.

Related comparisons

Go deeper