Noometry

Model comparison

GPT-5.4 nano vs Grok Build 0.1

GPT-5.4 nano is the stronger model overall, scoring 41.9 to 36.4 on the Noometry Index.

Last verified . 2 shared benchmarks.

GPT-5.4 nano OpenAI

41.9

Rank #125 Confirmed

Grok Build 0.1 xAI

36.4

Rank #216 Reported

Summary

  • They share 2 benchmarks with published results for both. GPT-5.4 nano scores higher in 1 category and Grok Build 0.1 in 1 category; one gap is clear of the uncertainty.
  • The widest gap is in reasoning, where Grok Build 0.1 leads 32.2 to 23.7.
  • GPT-5.4 nano is cheaper at $0.20 / $1.25 per million input/output tokens, against $1 / $2 for Grok Build 0.1.
  • GPT-5.4 nano accepts more context: 400K tokens versus 256K.

Side by side

GPT-5.4 nanoGrok Build 0.1
ProviderOpenAIxAI
Noometry Index41.936.4
Released2026-03-172026-04-16
WeightsProprietaryProprietary
Context window400K256K
Max output128K256K
Input $ / M tokens$0.20$1
Output $ / M tokens$1.25$2
Results tracked403

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

GPT-5.4 nano: 43.6 (#84), Grok Build 0.1: 43.1 (#91)

BenchmarkGPT-5.4 nanoGrok Build 0.1
SciCode46.9%50.2%
WeirdML49.2%—
LMArena Coding1405—
ALE-Bench1,005—

Agentic & Tool Use Not comparable

GPT-5.4 nano: —, Grok Build 0.1: 22.7 (#129)

BenchmarkGPT-5.4 nanoGrok Build 0.1
GBAEval—2.4%

Reasoning Grok Build 0.1 leads

GPT-5.4 nano: 23.7 (#173), Grok Build 0.1: 32.2 (#77)

BenchmarkGPT-5.4 nanoGrok Build 0.1
CritPt9.3%9.1%
ARC-AGI-25.7%—
Kagi LLM Benchmark39.7%—
ARC-AGI-151.5%—
Chess Puzzles30%—
LMArena Hard Prompts1381—
Mystery Game Puzzles9%—
DTBench80.3%—
LMCA36.9%—
Epoch Capabilities Index145.81—
ForecastBench57.3—

Math Not comparable

GPT-5.4 nano: 40.9 (#88), Grok Build 0.1: —

BenchmarkGPT-5.4 nanoGrok Build 0.1
FrontierMath (Tiers 1-3)44.9%—
FrontierMath Tier 412.2%—
OTIS Mock AIME 2024-202587.8%—
ProofBench5%—
LMArena Math1406—
FrontierMath (Feb 2025 set)25.9%—
FrontierMath Tier 4 (v1)6.3%—

Knowledge Not comparable

GPT-5.4 nano: 41.9 (#103), Grok Build 0.1: —

BenchmarkGPT-5.4 nanoGrok Build 0.1
GPQA Diamond78.5%—
SimpleQA Verified11.7%—
Vectara Hallucination Rate3.1%—
LMArena Expert1396—

Multimodal Not comparable

GPT-5.4 nano: 36.7 (#78), Grok Build 0.1: —

BenchmarkGPT-5.4 nanoGrok Build 0.1
LMArena Vision1196—

Multilingual Not comparable

GPT-5.4 nano: 48.6 (#140), Grok Build 0.1: —

BenchmarkGPT-5.4 nanoGrok Build 0.1
LMArena Non-English1359—
LMArena Chinese1392—
LMArena French1396—
LMArena German1367—
LMArena Japanese1343—
LMArena Korean1320—
LMArena Russian1363—
LMArena Spanish1371—

Instruction Following Not comparable

GPT-5.4 nano: 71.9 (#144), Grok Build 0.1: —

BenchmarkGPT-5.4 nanoGrok Build 0.1
LMArena Instruction Following1362—

Long Context Not comparable

GPT-5.4 nano: 41.6 (#137), Grok Build 0.1: —

BenchmarkGPT-5.4 nanoGrok Build 0.1
LMArena Longer Query1366—

Writing & Preference Not comparable

GPT-5.4 nano: 55.7 (#142), Grok Build 0.1: —

BenchmarkGPT-5.4 nanoGrok Build 0.1
LMArena Text1372—
LMArena Creative Writing1314—
LMArena Multi-Turn1382—

Frequently asked questions

Is GPT-5.4 nano better than Grok Build 0.1?

GPT-5.4 nano is the stronger model overall, scoring 41.9 to 36.4 on the Noometry Index.

Which is cheaper, GPT-5.4 nano or Grok Build 0.1?

GPT-5.4 nano is cheaper. It lists at $0.20 per million input tokens and $1.25 per million output tokens; Grok Build 0.1 lists at $1 and $2.

Is GPT-5.4 nano or Grok Build 0.1 better for coding?

They score almost the same on coding (43.6 vs 43.1); test both on your own repository before choosing.

Which has the bigger context window?

GPT-5.4 nano does, with 400K tokens against 256K.

How many benchmarks do GPT-5.4 nano and Grok Build 0.1 share?

2 benchmarks have published results for both models. GPT-5.4 nano has 40 scored results on Noometry and Grok Build 0.1 has 3.

Related comparisons

Go deeper