Noometry

Model comparison

GPT-4 Turbo vs Grok 4.1 Fast

Grok 4.1 Fast is the stronger model overall, scoring 41.4 to 30.5 on the Noometry Index.

Last verified . 21 shared benchmarks.

GPT-4 Turbo OpenAI

30.5

Rank #292 Confirmed

Grok 4.1 Fast xAI

41.4

Rank #136 Confirmed

Summary

  • They share 21 benchmarks with published results for both. GPT-4 Turbo scores higher in 0 categories and Grok 4.1 Fast in 9 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.1 Fast leads 43.4 to 15.3.
  • The biggest single-benchmark swing is SimpleBench: 25.1% for GPT-4 Turbo and 56% for Grok 4.1 Fast.
  • Grok 4.1 Fast is cheaper at $0.20 / $0.50 per million input/output tokens, against $10 / $30 for GPT-4 Turbo.

Side by side

GPT-4 TurboGrok 4.1 Fast
ProviderOpenAIxAI
Noometry Index30.541.4
Released2023-11-062025-06-27
WeightsProprietaryProprietary
Context window128K128K
Max output4K30K
Input $ / M tokens$10$0.20
Output $ / M tokens$30$0.50
Results tracked3632

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

GPT-4 Turbo: 33.8 (#249), Grok 4.1 Fast: 34.1 (#245)

BenchmarkGPT-4 TurboGrok 4.1 Fast
LMArena Coding12681411
LMArena WebDev—1242
WeirdML18%—
BigCodeBench Instruct48.2%—
BigCodeBench Complete58.2%—
ALE-Bench—394.93
HumanEval+86.6%—
MBPP+73.3%—

Agentic & Tool Use Not comparable

GPT-4 Turbo: —, Grok 4.1 Fast: 36.3 (#39)

BenchmarkGPT-4 TurboGrok 4.1 Fast
Berkeley Function Calling Leaderboard—69.6%
τ²-bench Banking—13.1%
LMArena Search—1171
METR Time Horizons36.7%—
Vending-Bench 2—1,107

Reasoning Grok 4.1 Fast leads

GPT-4 Turbo: 15.3 (#317), Grok 4.1 Fast: 43.4 (#49)

BenchmarkGPT-4 TurboGrok 4.1 Fast
SimpleBench25.1%56%
LMArena Hard Prompts12511407
DTBench61.6%87.7%
ForecastBench59.461
NYT Connections (extended)—87.4%
Chess Puzzles6%—
LMCA9.8%—
Epoch Capabilities Index127.25—

Math Grok 4.1 Fast leads

GPT-4 Turbo: 9.0 (#322), Grok 4.1 Fast: 31.9 (#221)

BenchmarkGPT-4 TurboGrok 4.1 Fast
LMArena Math12721408
FrontierMath (Tiers 1-3)0.7%—
MathArena Final-Answer Competitions—60.9%
OTIS Mock AIME 2024-20256.7%—
ProofBench—4%
MATH Level 546.7%—

Knowledge Grok 4.1 Fast leads

GPT-4 Turbo: 24.3 (#268), Grok 4.1 Fast: 33.1 (#207)

BenchmarkGPT-4 TurboGrok 4.1 Fast
LMArena Expert12231399
GPQA Diamond46.6%—
Confabulations28.4%—
Vectara Hallucination Rate—17.8%
MMLU81.3%—

Multimodal Grok 4.1 Fast leads

GPT-4 Turbo: 30.6 (#110), Grok 4.1 Fast: 37.0 (#76)

BenchmarkGPT-4 TurboGrok 4.1 Fast
LMArena Vision10901201

Multilingual Grok 4.1 Fast leads

GPT-4 Turbo: 40.5 (#216), Grok 4.1 Fast: 51.0 (#114)

BenchmarkGPT-4 TurboGrok 4.1 Fast
LMArena Non-English12451391
LMArena Chinese12421441
LMArena French12761415
LMArena German12591404
LMArena Japanese11941349
LMArena Korean11871361
LMArena Russian12591387
LMArena Spanish12601413

Instruction Following Grok 4.1 Fast leads

GPT-4 Turbo: 65.8 (#216), Grok 4.1 Fast: 72.7 (#133)

BenchmarkGPT-4 TurboGrok 4.1 Fast
LMArena Instruction Following12491376

Long Context Grok 4.1 Fast leads

GPT-4 Turbo: 38.0 (#206), Grok 4.1 Fast: 42.4 (#126)

BenchmarkGPT-4 TurboGrok 4.1 Fast
LMArena Longer Query12541390

Writing & Preference Grok 4.1 Fast leads

GPT-4 Turbo: 47.7 (#206), Grok 4.1 Fast: 57.2 (#131)

BenchmarkGPT-4 TurboGrok 4.1 Fast
LMArena Text12721408
LMArena Creative Writing12691394
LMArena Multi-Turn12671389
EQ-Bench Creative Writing—1327

Frequently asked questions

Is GPT-4 Turbo better than Grok 4.1 Fast?

Grok 4.1 Fast is the stronger model overall, scoring 41.4 to 30.5 on the Noometry Index.

Which is cheaper, GPT-4 Turbo or Grok 4.1 Fast?

Grok 4.1 Fast is cheaper. It lists at $0.20 per million input tokens and $0.50 per million output tokens; GPT-4 Turbo lists at $10 and $30.

Is GPT-4 Turbo or Grok 4.1 Fast better for coding?

They score almost the same on coding (33.8 vs 34.1); test both on your own repository before choosing.

Which has the bigger context window?

Both accept 128K tokens.

How many benchmarks do GPT-4 Turbo and Grok 4.1 Fast share?

21 benchmarks have published results for both models. GPT-4 Turbo has 36 scored results on Noometry and Grok 4.1 Fast has 32.

Related comparisons

Go deeper