Model comparison

Claude 2.1 vs Grok 4.3

Grok 4.3 is the stronger model overall, scoring 43.8 to 25.2 on the Noometry Index.

Last verified . 6 shared benchmarks.

Claude 2.1 Anthropic

25.2

Rank #345 Reported

Grok 4.3 xAI

43.8

Rank #86 Confirmed

Summary

  • They share 6 benchmarks with published results for both. Claude 2.1 scores higher in 0 categories and Grok 4.3 in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Grok 4.3 leads 52.5 to 15.4.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.9% for Claude 2.1 and 93.3% for Grok 4.3.

Side by side

Claude 2.1 and Grok 4.3 specifications
Claude 2.1Grok 4.3
ProviderAnthropicxAI
Noometry Index25.243.8
Released2023-11-212026-04-17
WeightsProprietaryProprietary
Context window—1M
Max output—30K
Input $ / M tokens—$1.25
Output $ / M tokens—$2.50
Results tracked740

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.3 leads

Claude 2.1: 26.2 (#327), Grok 4.3: 41.6 (#121)

Coding benchmarks
BenchmarkClaude 2.1Grok 4.3
WeirdML7.1%49.9%
LMArena WebDev—1357
SciCode—47.3%
LMArena Coding—1415
ALE-Bench—944.17

Agentic & Tool Use Not comparable

Claude 2.1: —, Grok 4.3: 27.7 (#99)

Agentic & Tool Use benchmarks
BenchmarkClaude 2.1Grok 4.3
GDP.pdf—8%
LMArena Search—1165
Vending-Bench 2—35.26

Reasoning Grok 4.3 leads

Claude 2.1: 21.4 (#221), Grok 4.3: 35.9 (#68)

Reasoning benchmarks
BenchmarkClaude 2.1Grok 4.3
DTBench51%90.7%
Epoch Capabilities Index119.27149.16
ForecastBench54.260.3
NYT Connections (extended)—55.2%
CritPt—8%
Chess Puzzles—25%
LMArena Hard Prompts—1396
LMCA—38.3%

Math Grok 4.3 leads

Claude 2.1: 10.2 (#315), Grok 4.3: 46.0 (#74)

Math benchmarks
BenchmarkClaude 2.1Grok 4.3
OTIS Mock AIME 2024-20251.9%93.3%
FrontierMath (Tiers 1-3)—42.8%
FrontierMath Tier 4—14.6%
ProofBench—11%
LMArena Math—1388

Knowledge Grok 4.3 leads

Claude 2.1: 15.4 (#292), Grok 4.3: 52.5 (#62)

Knowledge benchmarks
BenchmarkClaude 2.1Grok 4.3
GPQA Diamond33%88.8%
SimpleQA Verified—33.2%
LMArena Expert—1385
MMLU73.5%—

Multimodal Not comparable

Claude 2.1: —, Grok 4.3: 31.6 (#104)

Multimodal benchmarks
BenchmarkClaude 2.1Grok 4.3
LMArena Vision—1229
Blueprint-Bench 2—0%

Multilingual Not comparable

Claude 2.1: —, Grok 4.3: 50.5 (#120)

Multilingual benchmarks
BenchmarkClaude 2.1Grok 4.3
LMArena Non-English—1385
LMArena Chinese—1422
LMArena French—1412
LMArena German—1395
LMArena Japanese—1379
LMArena Korean—1356
LMArena Russian—1399
LMArena Spanish—1398

Instruction Following Not comparable

Claude 2.1: —, Grok 4.3: 72.1 (#140)

Instruction Following benchmarks
BenchmarkClaude 2.1Grok 4.3
LMArena Instruction Following—1366

Long Context Not comparable

Claude 2.1: —, Grok 4.3: 42.5 (#123)

Long Context benchmarks
BenchmarkClaude 2.1Grok 4.3
LMArena Longer Query—1393

Writing & Preference Not comparable

Claude 2.1: —, Grok 4.3: 58.5 (#118)

Writing & Preference benchmarks
BenchmarkClaude 2.1Grok 4.3
LMArena Text—1397
LMArena Creative Writing—1380
EQ-Bench 4—1075
LMArena Multi-Turn—1406

Frequently asked questions

Is Claude 2.1 better than Grok 4.3?

Grok 4.3 is the stronger model overall, scoring 43.8 to 25.2 on the Noometry Index.

Is Claude 2.1 or Grok 4.3 better for coding?

Grok 4.3 scores higher on coding benchmarks: 41.6 versus 26.2 in the Noometry coding category.

How many benchmarks do Claude 2.1 and Grok 4.3 share?

6 benchmarks have published results for both models. Claude 2.1 has 7 scored results on Noometry and Grok 4.3 has 40.

Related comparisons

Go deeper