Noometry

Model comparison

GPT-4.1 nano vs Grok 4 Fast

Grok 4 Fast is the stronger model overall, scoring 39.4 to 27.9 on the Noometry Index.

Last verified . 21 shared benchmarks.

GPT-4.1 nano OpenAI

27.9

Rank #327 Confirmed

Grok 4 Fast xAI

39.4

Rank #167 Confirmed

Summary

  • They share 21 benchmarks with published results for both. GPT-4.1 nano scores higher in 0 categories and Grok 4 Fast in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in long context, where Grok 4 Fast leads 63.2 to 23.7.
  • The biggest single-benchmark swing is Fiction.LiveBench: 25% for GPT-4.1 nano and 94.4% for Grok 4 Fast.

Side by side

GPT-4.1 nanoGrok 4 Fast
ProviderOpenAIxAI
Noometry Index27.939.4
Released2025-04-142025-09-19
WeightsProprietaryProprietary
Context window1.05M—
Max output33K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.40—
Results tracked3830

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4 Fast leads

GPT-4.1 nano: 24.1 (#330), Grok 4 Fast: 32.5 (#271)

BenchmarkGPT-4.1 nanoGrok 4 Fast
WeirdML19%42.9%
LMArena Coding13061429
Aider Polyglot8.9%—
LMArena WebDev—1159
SciCode25.9%—

Agentic & Tool Use Grok 4 Fast leads

GPT-4.1 nano: 26.5 (#104), Grok 4 Fast: 29.5 (#86)

BenchmarkGPT-4.1 nanoGrok 4 Fast
Berkeley Function Calling Leaderboard33%—
τ²-bench Banking—15.7%
Cybench—30%
LMArena Search—1171

Reasoning Grok 4 Fast leads

GPT-4.1 nano: 8.5 (#349), Grok 4 Fast: 22.2 (#201)

BenchmarkGPT-4.1 nanoGrok 4 Fast
ARC-AGI-20%5.3%
Kagi LLM Benchmark33.3%66.1%
ARC-AGI-10%48.5%
LMArena Hard Prompts12861412
DTBench52.5%82.7%
Epoch Capabilities Index129.62144.2
CritPt0%—
LMCA5.5%—
ForecastBench—60.5

Math Grok 4 Fast leads

GPT-4.1 nano: 26.9 (#252), Grok 4 Fast: 38.9 (#123)

BenchmarkGPT-4.1 nanoGrok 4 Fast
LMArena Math12741419
OTIS Mock AIME 2024-202528.9%—
Omni-MATH36.7%—
MATH Level 570%—
FrontierMath (Feb 2025 set)1%—

Knowledge Grok 4 Fast leads

GPT-4.1 nano: 21.8 (#273), Grok 4 Fast: 32.0 (#214)

BenchmarkGPT-4.1 nanoGrok 4 Fast
LMArena Expert12721411
GPQA Diamond48.9%—
SimpleQA Verified6%—
MMLU-Pro55%—
Vectara Hallucination Rate—19.7%
GPQA (HELM)50.7%—

Multimodal Not comparable

GPT-4.1 nano: 29.2 (#113), Grok 4 Fast: —

BenchmarkGPT-4.1 nanoGrok 4 Fast
LMArena Vision1063—

Multilingual Grok 4 Fast leads

GPT-4.1 nano: 41.6 (#205), Grok 4 Fast: 51.3 (#111)

BenchmarkGPT-4.1 nanoGrok 4 Fast
LMArena Non-English12601396
LMArena Chinese12701457
LMArena German12881383
LMArena Japanese11981352
LMArena Russian12611389
LMArena French—1431
LMArena Korean—1357
LMArena Spanish—1415

Instruction Following Grok 4 Fast leads

GPT-4.1 nano: 67.8 (#193), Grok 4 Fast: 73.2 (#121)

BenchmarkGPT-4.1 nanoGrok 4 Fast
LMArena Instruction Following12671387
IFEval84.3%—

Long Context Grok 4 Fast leads

GPT-4.1 nano: 23.7 (#296), Grok 4 Fast: 63.2 (#3)

BenchmarkGPT-4.1 nanoGrok 4 Fast
Fiction.LiveBench25%94.4%
LMArena Longer Query12831415

Writing & Preference Grok 4 Fast leads

GPT-4.1 nano: 40.5 (#243), Grok 4 Fast: 60.0 (#102)

BenchmarkGPT-4.1 nanoGrok 4 Fast
LMArena Text12851407
LMArena Creative Writing12601387
LMArena Multi-Turn12771414
EQ-Bench Creative Writing946—
WildBench81.2%—

Frequently asked questions

Is GPT-4.1 nano better than Grok 4 Fast?

Grok 4 Fast is the stronger model overall, scoring 39.4 to 27.9 on the Noometry Index.

Is GPT-4.1 nano or Grok 4 Fast better for coding?

Grok 4 Fast scores higher on coding benchmarks: 32.5 versus 24.1 in the Noometry coding category.

How many benchmarks do GPT-4.1 nano and Grok 4 Fast share?

21 benchmarks have published results for both models. GPT-4.1 nano has 38 scored results on Noometry and Grok 4 Fast has 30.

Related comparisons

Go deeper