Noometry

Model comparison

GPT-4 Turbo vs Grok 4 Fast

Grok 4 Fast is the stronger model overall, scoring 39.0 to 30.3 on the Noometry Index.

Last verified . 21 shared benchmarks.

GPT-4 Turbo OpenAI

30.3

Rank #281 Confirmed

Grok 4 Fast xAI

39.0

Rank #164 Confirmed

Summary

  • They share 21 benchmarks with published results for both. GPT-4 Turbo scores higher in 1 category and Grok 4 Fast in 7 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Grok 4 Fast leads 36.1 to 8.6.
  • The biggest single-benchmark swing is WeirdML: 18% for GPT-4 Turbo and 42.9% for Grok 4 Fast.

Side by side

GPT-4 TurboGrok 4 Fast
ProviderOpenAIxAI
Noometry Index30.339.0
Released2023-11-062025-09-19
WeightsProprietaryProprietary
Context window128K—
Max output4K—
Input $ / M tokens$10—
Output $ / M tokens$30—
Results tracked3630

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-4 Turbo leads

GPT-4 Turbo: 33.4 (#247), Grok 4 Fast: 32.3 (#264)

BenchmarkGPT-4 TurboGrok 4 Fast
WeirdML18%42.9%
LMArena Coding12681429
LMArena WebDev—1160
BigCodeBench Instruct48.2%—
BigCodeBench Complete58.2%—
HumanEval+86.6%—
MBPP+73.3%—

Agentic & Tool Use Not comparable

GPT-4 Turbo: —, Grok 4 Fast: 29.3 (#80)

BenchmarkGPT-4 TurboGrok 4 Fast
τ²-bench Banking—15.7%
Cybench—30%
LMArena Search—1171
METR Time Horizons36.7%—

Reasoning Grok 4 Fast leads

GPT-4 Turbo: 14.9 (#311), Grok 4 Fast: 22.5 (#179)

BenchmarkGPT-4 TurboGrok 4 Fast
LMArena Hard Prompts12511413
DTBench61.6%82.7%
Epoch Capabilities Index127.25144.21
ForecastBench59.460.5
ARC-AGI-2—5.3%
SimpleBench25.1%—
Kagi LLM Benchmark—66.1%
ARC-AGI-1—48.5%
Chess Puzzles6%—
LMCA9.8%—

Math Grok 4 Fast leads

GPT-4 Turbo: 8.6 (#316), Grok 4 Fast: 36.1 (#126)

BenchmarkGPT-4 TurboGrok 4 Fast
LMArena Math12721419
FrontierMath (Tiers 1-3)0.7%—
OTIS Mock AIME 2024-20256.7%—
MATH Level 546.7%—

Knowledge Grok 4 Fast leads

GPT-4 Turbo: 24.3 (#263), Grok 4 Fast: 31.5 (#211)

BenchmarkGPT-4 TurboGrok 4 Fast
LMArena Expert12231411
GPQA Diamond46.6%—
Confabulations28.4%—
Vectara Hallucination Rate—19.7%
MMLU81.3%—

Multimodal Not comparable

GPT-4 Turbo: 30.0 (#104), Grok 4 Fast: —

BenchmarkGPT-4 TurboGrok 4 Fast
LMArena Vision1090—

Multilingual Grok 4 Fast leads

GPT-4 Turbo: 40.7 (#211), Grok 4 Fast: 51.5 (#106)

BenchmarkGPT-4 TurboGrok 4 Fast
LMArena Non-English12451397
LMArena Chinese12421458
LMArena French12751433
LMArena German12591383
LMArena Japanese11941358
LMArena Korean11871359
LMArena Russian12591387
LMArena Spanish12601414

Instruction Following Grok 4 Fast leads

GPT-4 Turbo: 66.0 (#211), Grok 4 Fast: 73.4 (#116)

BenchmarkGPT-4 TurboGrok 4 Fast
LMArena Instruction Following12501388

Long Context Grok 4 Fast leads

GPT-4 Turbo: 38.0 (#200), Grok 4 Fast: 63.2 (#3)

BenchmarkGPT-4 TurboGrok 4 Fast
LMArena Longer Query12541415
Fiction.LiveBench—94.4%

Writing & Preference Grok 4 Fast leads

GPT-4 Turbo: 47.9 (#201), Grok 4 Fast: 60.2 (#96)

BenchmarkGPT-4 TurboGrok 4 Fast
LMArena Text12721407
LMArena Creative Writing12691388
LMArena Multi-Turn12671414

Frequently asked questions

Is GPT-4 Turbo better than Grok 4 Fast?

Grok 4 Fast is the stronger model overall, scoring 39.0 to 30.3 on the Noometry Index.

Is GPT-4 Turbo or Grok 4 Fast better for coding?

GPT-4 Turbo scores higher on coding benchmarks: 33.4 versus 32.3 in the Noometry coding category.

How many benchmarks do GPT-4 Turbo and Grok 4 Fast share?

21 benchmarks have published results for both models. GPT-4 Turbo has 36 scored results on Noometry and Grok 4 Fast has 30.

Related comparisons

Go deeper