Model comparison

Falcon-180B vs Grok Build 0.1

Grok Build 0.1 is the stronger model overall, scoring 35.8 to 31.8 on the Noometry Index.

Last verified . 0 shared benchmarks.

Grok Build 0.1 xAI

35.8

Rank #214 Reported

Summary

  • The widest gap is in reasoning, where Grok Build 0.1 leads 31.3 to 18.3.
  • Falcon-180B has downloadable open weights; the other is API-only.

Side by side

Falcon-180B and Grok Build 0.1 specifications
Falcon-180BGrok Build 0.1
ProviderTechnology Innovation InstitutexAI
Noometry Index31.835.8
Released2023-09-062026-04-16
WeightsOpenProprietary
Context window—256K
Max output—256K
Input $ / M tokens—$1
Output $ / M tokens—$2
Results tracked163

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, Grok Build 0.1: 42.5 (#90)

Coding benchmarks
BenchmarkFalcon-180BGrok Build 0.1
SciCode—50.2%

Agentic & Tool Use Not comparable

Falcon-180B: —, Grok Build 0.1: 22.5 (#122)

Agentic & Tool Use benchmarks
BenchmarkFalcon-180BGrok Build 0.1
GBAEval—2.4%

Reasoning Grok Build 0.1 leads

Falcon-180B: 18.3 (#266), Grok Build 0.1: 31.3 (#73)

Reasoning benchmarks
BenchmarkFalcon-180BGrok Build 0.1
CritPt—9.1%
LMArena Hard Prompts1007—
Epoch Capabilities Index111.89—
HellaSwag89%—
LAMBADA79.8%—
PIQA84.9%—
WinoGrande87.1%—

Math Not comparable

Falcon-180B: —, Grok Build 0.1: —

Math benchmarks
BenchmarkFalcon-180BGrok Build 0.1
GSM8K54.4%—

Knowledge Not comparable

Falcon-180B: —, Grok Build 0.1: —

Knowledge benchmarks
BenchmarkFalcon-180BGrok Build 0.1
ARC (AI2) Challenge67.8%—
BoolQ89%—
MMLU70.6%—
OpenBookQA64.2%—

Multilingual Not comparable

Falcon-180B: 25.3 (#281), Grok Build 0.1: —

Multilingual benchmarks
BenchmarkFalcon-180BGrok Build 0.1
LMArena Non-English1000—

Instruction Following Not comparable

Falcon-180B: 53.6 (#281), Grok Build 0.1: —

Instruction Following benchmarks
BenchmarkFalcon-180BGrok Build 0.1
LMArena Instruction Following1047—

Writing & Preference Not comparable

Falcon-180B: 29.3 (#290), Grok Build 0.1: —

Writing & Preference benchmarks
BenchmarkFalcon-180BGrok Build 0.1
LMArena Text1054—
LMArena Creative Writing1089—
LMArena Multi-Turn1013—

Frequently asked questions

Is Falcon-180B better than Grok Build 0.1?

Grok Build 0.1 is the stronger model overall, scoring 35.8 to 31.8 on the Noometry Index.

How many benchmarks do Falcon-180B and Grok Build 0.1 share?

0 benchmarks have published results for both models. Falcon-180B has 16 scored results on Noometry and Grok Build 0.1 has 3.

Related comparisons

Go deeper