Model comparison

Claude 2 vs Grok Build 0.1

Grok Build 0.1 is the stronger model overall, scoring 36.4 to 25.0 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 2 Anthropic

25.0

Rank #346 Reported

Grok Build 0.1 xAI

36.4

Rank #216 Reported

Summary

  • The widest gap is in reasoning, where Grok Build 0.1 leads 32.2 to 21.7.

Side by side

Claude 2 and Grok Build 0.1 specifications
Claude 2Grok Build 0.1
ProviderAnthropicxAI
Noometry Index25.036.4
Released2023-07-112026-04-16
WeightsProprietaryProprietary
Context window—256K
Max output—256K
Input $ / M tokens—$1
Output $ / M tokens—$2
Results tracked83

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 2: —, Grok Build 0.1: 43.1 (#91)

Coding benchmarks
BenchmarkClaude 2Grok Build 0.1
SciCode—50.2%
HumanEval+61.6%—

Agentic & Tool Use Not comparable

Claude 2: —, Grok Build 0.1: 22.7 (#129)

Agentic & Tool Use benchmarks
BenchmarkClaude 2Grok Build 0.1
GBAEval—2.4%

Reasoning Grok Build 0.1 leads

Claude 2: 21.7 (#216), Grok Build 0.1: 32.2 (#77)

Reasoning benchmarks
BenchmarkClaude 2Grok Build 0.1
CritPt—9.1%
DTBench51.9%—
Epoch Capabilities Index120.13—

Math Not comparable

Claude 2: 9.3 (#320), Grok Build 0.1: —

Math benchmarks
BenchmarkClaude 2Grok Build 0.1
OTIS Mock AIME 2024-20252.5%—
MATH Level 511.7%—

Knowledge Not comparable

Claude 2: 16.9 (#287), Grok Build 0.1: —

Knowledge benchmarks
BenchmarkClaude 2Grok Build 0.1
GPQA Diamond34.7%—
MMLU78.5%—
TriviaQA87.5%—

Frequently asked questions

Is Claude 2 better than Grok Build 0.1?

Grok Build 0.1 is the stronger model overall, scoring 36.4 to 25.0 on the Noometry Index.

How many benchmarks do Claude 2 and Grok Build 0.1 share?

0 benchmarks have published results for both models. Claude 2 has 8 scored results on Noometry and Grok Build 0.1 has 3.

Related comparisons

Go deeper