Noometry

Model comparison

GPT-6 Sol vs Grok 4.7

GPT-6 Sol is the stronger model overall, scoring 61.8 to 53.1 on the Noometry Index.

Last verified . 36 shared benchmarks.

GPT-6 Sol OpenAI

61.8

Rank #12 Confirmed

Grok 4.7 xAI

53.1

Rank #37 Confirmed

Summary

  • They share 36 benchmarks with published results for both. GPT-6 Sol scores higher in 8 categories and Grok 4.7 in 2 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-6 Sol leads 87.2 to 57.8.
  • The biggest single-benchmark swing is FrontierMath Tier 4: 90% for GPT-6 Sol and 17.1% for Grok 4.7.
  • Grok 4.7 is cheaper at $2 / $6 per million input/output tokens, against $2 / $10 for GPT-6 Sol.
  • GPT-6 Sol accepts more context: 1.05M tokens versus 500K.

Side by side

GPT-6 SolGrok 4.7
ProviderOpenAIxAI
Noometry Index61.853.1
Released2026-09-222026-09-21
WeightsProprietaryProprietary
Context window1.05M500K
Max output128K500K
Input $ / M tokens$2$2
Output $ / M tokens$10$6
Results tracked4539

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-6 Sol leads

GPT-6 Sol: 60.1 (#11), Grok 4.7: 58.0 (#18)

BenchmarkGPT-6 SolGrok 4.7
FrontierCode49.3%47.6%
LMArena WebDev16881639
SciCode57.6%57.8%
LMArena Coding14471427
DeepSWE68.8%—
CursorBench—46.3%
FrontierSWE—29.5%
ALE-Bench2,462—

Agentic & Tool Use Too close to call

GPT-6 Sol: 37.2 (#36), Grok 4.7: 36.7 (#37)

BenchmarkGPT-6 SolGrok 4.7
APEX-Agents54.3%54.6%
GDP.pdf26.4%22.8%
Vending-Bench 214,42810,537

Reasoning GPT-6 Sol leads

GPT-6 Sol: 74.0 (#9), Grok 4.7: 49.1 (#40)

BenchmarkGPT-6 SolGrok 4.7
NYT Connections (extended)90.1%76.8%
CritPt30.9%18%
LMArena Hard Prompts14181413
Mystery Game Puzzles56%29%
DTBench97.3%96%
LMCA59.1%49.4%
Epoch Capabilities Index162.72153.53
ARC-AGI-289.6%—
ARC-AGI-195.5%—
Chess Puzzles—38%
EBR-Bench53.3%—

Math GPT-6 Sol leads

GPT-6 Sol: 87.2 (#7), Grok 4.7: 57.8 (#39)

BenchmarkGPT-6 SolGrok 4.7
FrontierMath (Tiers 1-3)89.8%53%
FrontierMath Tier 490%17.1%
OTIS Mock AIME 2024-2025100%98.1%
ProofBench83%34%
LMArena Math14021407

Knowledge GPT-6 Sol leads

GPT-6 Sol: 64.8 (#15), Grok 4.7: 62.8 (#22)

BenchmarkGPT-6 SolGrok 4.7
GPQA Diamond94.3%92.7%
SimpleQA Verified60.7%56%
LMArena Expert14391422
Vectara Hallucination Rate6.5%—

Multimodal GPT-6 Sol leads

GPT-6 Sol: 47.6 (#10), Grok 4.7: 35.5 (#87)

BenchmarkGPT-6 SolGrok 4.7
LMArena Vision12451228
Blueprint-Bench 236.9%32.5%
Furniture Assembly58.3%20.8%

Multilingual Too close to call

GPT-6 Sol: 50.5 (#118), Grok 4.7: 50.8 (#116)

BenchmarkGPT-6 SolGrok 4.7
LMArena Non-English13851389
LMArena Chinese14051455
LMArena French14101455
LMArena Russian14011397
LMArena Spanish13841400
LMArena German1390—
LMArena Japanese1385—
LMArena Korean1341—

Instruction Following Too close to call

GPT-6 Sol: 74.5 (#94), Grok 4.7: 74.1 (#105)

BenchmarkGPT-6 SolGrok 4.7
LMArena Instruction Following14121404

Long Context Too close to call

GPT-6 Sol: 43.1 (#108), Grok 4.7: 43.1 (#104)

BenchmarkGPT-6 SolGrok 4.7
LMArena Longer Query14111413

Writing & Preference GPT-6 Sol leads

GPT-6 Sol: 71.9 (#18), Grok 4.7: 70.0 (#24)

BenchmarkGPT-6 SolGrok 4.7
LMArena Text13951399
LMArena Creative Writing13781391
EQ-Bench Creative Writing21252007
LMArena Multi-Turn14121393

Frequently asked questions

Is GPT-6 Sol better than Grok 4.7?

GPT-6 Sol is the stronger model overall, scoring 61.8 to 53.1 on the Noometry Index.

Which is cheaper, GPT-6 Sol or Grok 4.7?

Grok 4.7 is cheaper. It lists at $2 per million input tokens and $6 per million output tokens; GPT-6 Sol lists at $2 and $10.

Is GPT-6 Sol or Grok 4.7 better for coding?

GPT-6 Sol scores higher on coding benchmarks: 60.1 versus 58.0 in the Noometry coding category.

Which has the bigger context window?

GPT-6 Sol does, with 1.05M tokens against 500K.

How many benchmarks do GPT-6 Sol and Grok 4.7 share?

36 benchmarks have published results for both models. GPT-6 Sol has 45 scored results on Noometry and Grok 4.7 has 39.

Related comparisons

Go deeper