Model comparison

Claude 2.1 vs Grok Build 0.1

Grok Build 0.1 is the stronger model overall, scoring 35.8 to 24.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 2.1 Anthropic

24.9

Rank #340 Reported

Grok Build 0.1 xAI

35.8

Rank #214 Reported

Summary

  • The widest gap is in coding, where Grok Build 0.1 leads 42.5 to 25.8.

Side by side

Claude 2.1 and Grok Build 0.1 specifications
Claude 2.1Grok Build 0.1
ProviderAnthropicxAI
Noometry Index24.935.8
Released2023-11-212026-04-16
WeightsProprietaryProprietary
Context window—256K
Max output—256K
Input $ / M tokens—$1
Output $ / M tokens—$2
Results tracked73

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok Build 0.1 leads

Claude 2.1: 25.8 (#322), Grok Build 0.1: 42.5 (#90)

Coding benchmarks
BenchmarkClaude 2.1Grok Build 0.1
SciCode—50.2%
WeirdML7.1%—

Agentic & Tool Use Not comparable

Claude 2.1: —, Grok Build 0.1: 22.5 (#122)

Agentic & Tool Use benchmarks
BenchmarkClaude 2.1Grok Build 0.1
GBAEval—2.4%

Reasoning Grok Build 0.1 leads

Claude 2.1: 20.6 (#216), Grok Build 0.1: 31.3 (#73)

Reasoning benchmarks
BenchmarkClaude 2.1Grok Build 0.1
CritPt—9.1%
DTBench51%—
Epoch Capabilities Index119.22—
ForecastBench54.2—

Math Not comparable

Claude 2.1: 9.6 (#309), Grok Build 0.1: —

Math benchmarks
BenchmarkClaude 2.1Grok Build 0.1
OTIS Mock AIME 2024-20251.9%—

Knowledge Not comparable

Claude 2.1: 15.5 (#287), Grok Build 0.1: —

Knowledge benchmarks
BenchmarkClaude 2.1Grok Build 0.1
GPQA Diamond33%—
MMLU73.5%—

Frequently asked questions

Is Claude 2.1 better than Grok Build 0.1?

Grok Build 0.1 is the stronger model overall, scoring 35.8 to 24.9 on the Noometry Index.

Is Claude 2.1 or Grok Build 0.1 better for coding?

Grok Build 0.1 scores higher on coding benchmarks: 42.5 versus 25.8 in the Noometry coding category.

How many benchmarks do Claude 2.1 and Grok Build 0.1 share?

0 benchmarks have published results for both models. Claude 2.1 has 7 scored results on Noometry and Grok Build 0.1 has 3.

Related comparisons

Go deeper