Noometry

Model comparison

GPT-6.1 Sol vs Grok 4.1 Fast

Grok 4.1 Fast has enough public results to be ranked (#131); GPT-6.1 Sol does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

GPT-6.1 Sol OpenAI

42.1

Unranked Sparse

Grok 4.1 Fast xAI

40.9

Rank #131 Confirmed

Summary

  • The widest gap is in coding, where GPT-6.1 Sol leads 51.4 to 33.8.
  • Grok 4.1 Fast is cheaper at $0.20 / $0.50 per million input/output tokens, against $2 / $10 for GPT-6.1 Sol.
  • GPT-6.1 Sol accepts more context: 1.05M tokens versus 128K.

Side by side

GPT-6.1 SolGrok 4.1 Fast
ProviderOpenAIxAI
Noometry Index42.140.9
Released2026-09-292025-06-27
WeightsProprietaryProprietary
Context window1.05M128K
Max output128K30K
Input $ / M tokens$2$0.20
Output $ / M tokens$10$0.50
Results tracked232

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-6.1 Sol leads

GPT-6.1 Sol: 51.4, Grok 4.1 Fast: 33.8 (#236)

BenchmarkGPT-6.1 SolGrok 4.1 Fast
DeepSWE75.2%—
LMArena WebDev—1241
LMArena Coding—1411
ALE-Bench—394.93

Agentic & Tool Use Grok 4.1 Fast leads

GPT-6.1 Sol: 34.3, Grok 4.1 Fast: 36.1 (#35)

BenchmarkGPT-6.1 SolGrok 4.1 Fast
Berkeley Function Calling Leaderboard—69.6%
τ²-bench Banking—13.1%
GDP.pdf32%—
LMArena Search—1171
Vending-Bench 2—1,107

Reasoning Not comparable

GPT-6.1 Sol: —, Grok 4.1 Fast: 42.3 (#45)

BenchmarkGPT-6.1 SolGrok 4.1 Fast
SimpleBench—56%
NYT Connections (extended)—87.4%
LMArena Hard Prompts—1407
DTBench—87.7%
ForecastBench—61

Math Not comparable

GPT-6.1 Sol: —, Grok 4.1 Fast: 30.9 (#201)

BenchmarkGPT-6.1 SolGrok 4.1 Fast
MathArena Final-Answer Competitions—60.9%
ProofBench—4%
LMArena Math—1408

Knowledge Not comparable

GPT-6.1 Sol: —, Grok 4.1 Fast: 32.6 (#203)

BenchmarkGPT-6.1 SolGrok 4.1 Fast
Vectara Hallucination Rate—17.8%
LMArena Expert—1398

Multimodal Not comparable

GPT-6.1 Sol: —, Grok 4.1 Fast: 36.3 (#71)

BenchmarkGPT-6.1 SolGrok 4.1 Fast
LMArena Vision—1201

Multilingual Not comparable

GPT-6.1 Sol: —, Grok 4.1 Fast: 51.1 (#110)

BenchmarkGPT-6.1 SolGrok 4.1 Fast
LMArena Non-English—1391
LMArena Chinese—1441
LMArena French—1416
LMArena German—1404
LMArena Japanese—1347
LMArena Korean—1361
LMArena Russian—1387
LMArena Spanish—1411

Instruction Following Not comparable

GPT-6.1 Sol: —, Grok 4.1 Fast: 72.8 (#127)

BenchmarkGPT-6.1 SolGrok 4.1 Fast
LMArena Instruction Following—1376

Long Context Not comparable

GPT-6.1 Sol: —, Grok 4.1 Fast: 42.4 (#121)

BenchmarkGPT-6.1 SolGrok 4.1 Fast
LMArena Longer Query—1390

Writing & Preference Not comparable

GPT-6.1 Sol: —, Grok 4.1 Fast: 57.4 (#126)

BenchmarkGPT-6.1 SolGrok 4.1 Fast
LMArena Text—1408
LMArena Creative Writing—1394
EQ-Bench Creative Writing—1327
LMArena Multi-Turn—1389

Frequently asked questions

Is GPT-6.1 Sol better than Grok 4.1 Fast?

Grok 4.1 Fast has enough public results to be ranked (#131); GPT-6.1 Sol does not yet, so treat this comparison as directional.

Which is cheaper, GPT-6.1 Sol or Grok 4.1 Fast?

Grok 4.1 Fast is cheaper. It lists at $0.20 per million input tokens and $0.50 per million output tokens; GPT-6.1 Sol lists at $2 and $10.

Is GPT-6.1 Sol or Grok 4.1 Fast better for coding?

GPT-6.1 Sol scores higher on coding benchmarks: 51.4 versus 33.8 in the Noometry coding category.

Which has the bigger context window?

GPT-6.1 Sol does, with 1.05M tokens against 128K.

How many benchmarks do GPT-6.1 Sol and Grok 4.1 Fast share?

0 benchmarks have published results for both models. GPT-6.1 Sol has 2 scored results on Noometry and Grok 4.1 Fast has 32.

Related comparisons

Go deeper