Noometry

Model comparison

GPT-6.1 Sol vs Grok 4.5

GPT-6.1 Sol is the stronger model overall, scoring 65.6 to 55.0 on the Noometry Index.

Last verified . 32 shared benchmarks.

GPT-6.1 Sol OpenAI

65.6

Rank #6 Confirmed

Grok 4.5 xAI

55.0

Rank #25 Confirmed

Summary

  • They share 32 benchmarks with published results for both. GPT-6.1 Sol scores higher in 7 categories and Grok 4.5 in 3 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-6.1 Sol leads 93.7 to 60.9.
  • The biggest single-benchmark swing is FrontierMath Tier 4: 100% for GPT-6.1 Sol and 24.4% for Grok 4.5.
  • Grok 4.5 is cheaper at $2 / $6 per million input/output tokens, against $2 / $10 for GPT-6.1 Sol.
  • GPT-6.1 Sol accepts more context: 1.05M tokens versus 500K.

Side by side

GPT-6.1 SolGrok 4.5
ProviderOpenAIxAI
Noometry Index65.655.0
Released2026-09-292026-07-08
WeightsProprietaryProprietary
Context window1.05M500K
Max output128K500K
Input $ / M tokens$2$2
Output $ / M tokens$10$6
Results tracked3452

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-6.1 Sol leads

GPT-6.1 Sol: 63.2 (#8), Grok 4.5: 52.2 (#35)

BenchmarkGPT-6.1 SolGrok 4.5
DeepSWE75.2%53.8%
FrontierCode50.2%42.4%
LMArena WebDev17551553
SciCode55.8%54.1%
LMArena Coding14871474
WeirdML—46.4%
ALE-Bench—1,309

Agentic & Tool Use Grok 4.5 leads

GPT-6.1 Sol: 39.6 (#26), Grok 4.5: 44.4 (#17)

BenchmarkGPT-6.1 SolGrok 4.5
APEX-Agents60%56.2%
GDP.pdf32%14%
τ²-bench Banking—47.9%
PostTrainBench—23.4%
GBAEval—65.4%
LMArena Search—1213
Vending-Bench 2—3,887

Reasoning GPT-6.1 Sol leads

GPT-6.1 Sol: 81.9 (#2), Grok 4.5: 56.1 (#25)

BenchmarkGPT-6.1 SolGrok 4.5
ARC-AGI-294.2%52.6%
NYT Connections (extended)95.5%79.9%
ARC-AGI-198.5%87.2%
CritPt31.7%15.4%
Chess Puzzles61%36%
LMArena Hard Prompts14661462
Epoch Capabilities Index166.09153.92
SimpleBench—70%
Kagi LLM Benchmark—83.5%
EBR-Bench54.3%—
Mystery Game Puzzles80%—
DTBench—96.5%
LMCA—45.2%
Surface Evolver Bench—74.4%

Math GPT-6.1 Sol leads

GPT-6.1 Sol: 93.7 (#1), Grok 4.5: 60.9 (#35)

BenchmarkGPT-6.1 SolGrok 4.5
FrontierMath (Tiers 1-3)93.7%57.2%
FrontierMath Tier 4100%24.4%
OTIS Mock AIME 2024-2025100%97.8%
ProofBench99%31%
LMArena Math14641459

Knowledge GPT-6.1 Sol leads

GPT-6.1 Sol: 71.8 (#4), Grok 4.5: 62.3 (#24)

BenchmarkGPT-6.1 SolGrok 4.5
GPQA Diamond95.4%93.4%
SimpleQA Verified73.9%48.3%
LMArena Expert15021466

Multimodal GPT-6.1 Sol leads

GPT-6.1 Sol: 52.7 (#5), Grok 4.5: 37.6 (#72)

BenchmarkGPT-6.1 SolGrok 4.5
LMArena Vision12881288
Furniture Assembly80%22.5%
Blueprint-Bench 2—27.3%
LMArena Document—1452

Multilingual Too close to call

GPT-6.1 Sol: 54.3 (#46), Grok 4.5: 54.4 (#42)

BenchmarkGPT-6.1 SolGrok 4.5
LMArena Non-English14381440
LMArena Chinese14771496
LMArena Russian14551448
LMArena French—1456
LMArena German—1446
LMArena Japanese—1428
LMArena Korean—1404
LMArena Spanish—1450

Instruction Following GPT-6.1 Sol leads

GPT-6.1 Sol: 77.0 (#29), Grok 4.5: 76.0 (#48)

BenchmarkGPT-6.1 SolGrok 4.5
LMArena Instruction Following14681446

Long Context Too close to call

GPT-6.1 Sol: 44.9 (#54), Grok 4.5: 44.8 (#56)

BenchmarkGPT-6.1 SolGrok 4.5
LMArena Longer Query14651463

Writing & Preference Grok 4.5 leads

GPT-6.1 Sol: 63.6 (#63), Grok 4.5: 65.8 (#42)

BenchmarkGPT-6.1 SolGrok 4.5
LMArena Text14471448
LMArena Creative Writing14321442
LMArena Multi-Turn14491456
EQ-Bench Creative Writing—1579

Frequently asked questions

Is GPT-6.1 Sol better than Grok 4.5?

GPT-6.1 Sol is the stronger model overall, scoring 65.6 to 55.0 on the Noometry Index.

Which is cheaper, GPT-6.1 Sol or Grok 4.5?

Grok 4.5 is cheaper. It lists at $2 per million input tokens and $6 per million output tokens; GPT-6.1 Sol lists at $2 and $10.

Is GPT-6.1 Sol or Grok 4.5 better for coding?

GPT-6.1 Sol scores higher on coding benchmarks: 63.2 versus 52.2 in the Noometry coding category.

Which has the bigger context window?

GPT-6.1 Sol does, with 1.05M tokens against 500K.

How many benchmarks do GPT-6.1 Sol and Grok 4.5 share?

32 benchmarks have published results for both models. GPT-6.1 Sol has 34 scored results on Noometry and Grok 4.5 has 52.

Related comparisons

Go deeper