Model comparison

Claude Instant vs Grok Build 0.1

Grok Build 0.1 has enough public results to be ranked (#214); Claude Instant does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Claude Instant Anthropic

28.8

Unranked Sparse

Grok Build 0.1 xAI

35.8

Rank #214 Reported

Summary

  • The widest gap is in reasoning, where Grok Build 0.1 leads 31.3 to 18.8.

Side by side

Claude Instant and Grok Build 0.1 specifications
Claude InstantGrok Build 0.1
ProviderAnthropicxAI
Noometry Index28.835.8
Released2023-08-092026-04-16
WeightsProprietaryProprietary
Context window—256K
Max output—256K
Input $ / M tokens—$1
Output $ / M tokens—$2
Results tracked73

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude Instant: —, Grok Build 0.1: 42.5 (#90)

Coding benchmarks
BenchmarkClaude InstantGrok Build 0.1
SciCode—50.2%
HumanEval+50.6%—

Agentic & Tool Use Not comparable

Claude Instant: —, Grok Build 0.1: 22.5 (#122)

Agentic & Tool Use benchmarks
BenchmarkClaude InstantGrok Build 0.1
GBAEval—2.4%

Reasoning Grok Build 0.1 leads

Claude Instant: 18.8, Grok Build 0.1: 31.3 (#73)

Reasoning benchmarks
BenchmarkClaude InstantGrok Build 0.1
CritPt—9.1%
DTBench45.8%—
Epoch Capabilities Index120.2—

Math Not comparable

Claude Instant: —, Grok Build 0.1: —

Math benchmarks
BenchmarkClaude InstantGrok Build 0.1
GSM8K86.7%—

Knowledge Not comparable

Claude Instant: —, Grok Build 0.1: —

Knowledge benchmarks
BenchmarkClaude InstantGrok Build 0.1
ARC (AI2) Challenge86.3%—
MMLU73.4%—
TriviaQA78.9%—

Frequently asked questions

Is Claude Instant better than Grok Build 0.1?

Grok Build 0.1 has enough public results to be ranked (#214); Claude Instant does not yet, so treat this comparison as directional.

How many benchmarks do Claude Instant and Grok Build 0.1 share?

0 benchmarks have published results for both models. Claude Instant has 7 scored results on Noometry and Grok Build 0.1 has 3.

Related comparisons

Go deeper