Model comparison

GPT-5.6 Sol vs Grok 4.7

GPT-5.6 Sol is the stronger model overall, scoring 64.4 to 46.6 on the Noometry Index. Grok 4.7 costs 2.7× less per token, which makes it the better buy when GPT-5.6 Sol's lead doesn't matter for your workload.

Last verified . 21 shared benchmarks.

GPT-5.6 Sol OpenAI

64.4

Rank #6 Confirmed

Grok 4.7 xAI

46.6

Rank #56 Confirmed

Summary

  • They share 21 benchmarks with published results for both. GPT-5.6 Sol scores higher in 9 categories and Grok 4.7 in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.6 Sol leads 85.5 to 41.1.
  • The biggest single-benchmark swing is ProofBench: 83% for GPT-5.6 Sol and 34% for Grok 4.7.
  • Grok 4.7 is cheaper at $2 / $6 per million input/output tokens, against $4 / $20 for GPT-5.6 Sol.
  • GPT-5.6 Sol accepts more context: 1.05M tokens versus 500K.

Side by side

GPT-5.6 Sol and Grok 4.7 specifications
GPT-5.6 SolGrok 4.7
ProviderOpenAIxAI
Noometry Index64.446.6
Released2026-07-092026-09-21
WeightsProprietaryProprietary
Context window1.05M500K
Max output128K500K
Input $ / M tokens$4$2
Output $ / M tokens$20$6
Results tracked6421

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.6 Sol leads

GPT-5.6 Sol: 61.1 (#7), Grok 4.7: 55.0 (#23)

Coding benchmarks
BenchmarkGPT-5.6 SolGrok 4.7
CursorBench41.7%46.3%
LMArena WebDev16191636
FrontierSWE32.2%29.5%
SciCode57.1%57.4%
LMArena Coding14931423
DeepSWE72.7%—
FrontierCode47.5%—
WeirdML89.4%—
MirrorCode20%—
ALE-Bench2,177—

Agentic & Tool Use Not comparable

GPT-5.6 Sol: 50.2 (#7), Grok 4.7: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.6 SolGrok 4.7
APEX-Agents51.4%—
OSWorld 2.027.3%—
τ²-bench Banking46.9%—
PostTrainBench36.2%—
BALROG60%—
GBAEval52.6%—
GDP.pdf30.7%—
LMArena Search1257—
Vending-Bench 29,619—

Reasoning GPT-5.6 Sol leads

GPT-5.6 Sol: 74.7 (#6), Grok 4.7: 40.1 (#49)

Reasoning benchmarks
BenchmarkGPT-5.6 SolGrok 4.7
NYT Connections (extended)93.8%76.8%
CritPt32.3%17.7%
LMArena Hard Prompts14811409
ARC-AGI-292.5%—
SimpleBench71.7%—
Kagi LLM Benchmark67%—
ARC-AGI-197.5%—
Chess Puzzles64%—
EnigmaEval37.1%—
EBR-Bench44.8%—
Mystery Game Puzzles58%—
DTBench96%—
LMCA59.2%—
Surface Evolver Bench93.1%—
Bench to the Future 30.14—
Epoch Capabilities Index161.99—

Math GPT-5.6 Sol leads

GPT-5.6 Sol: 85.5 (#7), Grok 4.7: 41.1 (#73)

Math benchmarks
BenchmarkGPT-5.6 SolGrok 4.7
ProofBench83%34%
LMArena Math14721393
FrontierMath (Tiers 1-3)89.1%—
FrontierMath Tier 482.9%—
OTIS Mock AIME 2024-2025100%—
FrontierMath Erdős0%—

Knowledge GPT-5.6 Sol leads

GPT-5.6 Sol: 64.3 (#16), Grok 4.7: 38.7 (#130)

Knowledge benchmarks
BenchmarkGPT-5.6 SolGrok 4.7
LMArena Expert15171413
GPQA Diamond93.5%—
SimpleQA Verified69.7%—
Vectara Hallucination Rate12.4%—

Multimodal GPT-5.6 Sol leads

GPT-5.6 Sol: 48.9 (#8), Grok 4.7: 28.8 (#107)

Multimodal benchmarks
BenchmarkGPT-5.6 SolGrok 4.7
Furniture Assembly56.7%20.8%
LMArena Vision1281—
Blueprint-Bench 233.6%—
LMArena Document1483—

Multilingual GPT-5.6 Sol leads

GPT-5.6 Sol: 55.4 (#32), Grok 4.7: 51.2 (#108)

Multilingual benchmarks
BenchmarkGPT-5.6 SolGrok 4.7
LMArena Non-English14501392
LMArena Chinese15231476
LMArena Russian14661396
LMArena French1475—
LMArena German1476—
LMArena Japanese1475—
LMArena Korean1434—
LMArena Spanish1449—

Instruction Following GPT-5.6 Sol leads

GPT-5.6 Sol: 77.8 (#16), Grok 4.7: 74.3 (#98)

Instruction Following benchmarks
BenchmarkGPT-5.6 SolGrok 4.7
LMArena Instruction Following14801406

Long Context GPT-5.6 Sol leads

GPT-5.6 Sol: 45.3 (#42), Grok 4.7: 43.2 (#97)

Long Context benchmarks
BenchmarkGPT-5.6 SolGrok 4.7
LMArena Longer Query14791416

Writing & Preference GPT-5.6 Sol leads

GPT-5.6 Sol: 73.5 (#12), Grok 4.7: 70.1 (#23)

Writing & Preference benchmarks
BenchmarkGPT-5.6 SolGrok 4.7
LMArena Text14561397
LMArena Creative Writing14501391
EQ-Bench Creative Writing19722007
LMArena Multi-Turn14561389
EQ-Bench 41250—

Frequently asked questions

Is GPT-5.6 Sol better than Grok 4.7?

GPT-5.6 Sol is the stronger model overall, scoring 64.4 to 46.6 on the Noometry Index. Grok 4.7 costs 2.7× less per token, which makes it the better buy when GPT-5.6 Sol's lead doesn't matter for your workload.

Which is cheaper, GPT-5.6 Sol or Grok 4.7?

Grok 4.7 is cheaper. It lists at $2 per million input tokens and $6 per million output tokens; GPT-5.6 Sol lists at $4 and $20.

Is GPT-5.6 Sol or Grok 4.7 better for coding?

GPT-5.6 Sol scores higher on coding benchmarks: 61.1 versus 55.0 in the Noometry coding category.

Which has the bigger context window?

GPT-5.6 Sol does, with 1.05M tokens against 500K.

How many benchmarks do GPT-5.6 Sol and Grok 4.7 share?

21 benchmarks have published results for both models. GPT-5.6 Sol has 64 scored results on Noometry and Grok 4.7 has 21.

Related comparisons

Go deeper