Noometry

Model comparison

Gemini 1.0 Pro vs Grok 4.1 Fast

Grok 4.1 Fast is the stronger model overall, scoring 41.4 to 27.3 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemini 1.0 Pro Google

27.3

Rank #332 Confirmed

Grok 4.1 Fast xAI

41.4

Rank #136 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemini 1.0 Pro scores higher in 0 categories and Grok 4.1 Fast in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.1 Fast leads 43.4 to 17.1.
  • The biggest single-benchmark swing is DTBench: 45.9% for Gemini 1.0 Pro and 87.7% for Grok 4.1 Fast.

Side by side

Gemini 1.0 ProGrok 4.1 Fast
ProviderGooglexAI
Noometry Index27.341.4
Released2023-12-132025-06-27
WeightsProprietaryProprietary
Context window—128K
Max output—30K
Input $ / M tokens—$0.20
Output $ / M tokens—$0.50
Results tracked2432

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.1 Fast leads

Gemini 1.0 Pro: 32.2 (#275), Grok 4.1 Fast: 34.1 (#245)

BenchmarkGemini 1.0 ProGrok 4.1 Fast
LMArena Coding11081411
LMArena WebDev—1242
ALE-Bench—394.93
HumanEval+55.5%—
MBPP+61.4%—

Agentic & Tool Use Not comparable

Gemini 1.0 Pro: —, Grok 4.1 Fast: 36.3 (#39)

BenchmarkGemini 1.0 ProGrok 4.1 Fast
Berkeley Function Calling Leaderboard—69.6%
τ²-bench Banking—13.1%
LMArena Search—1171
Vending-Bench 2—1,107

Reasoning Grok 4.1 Fast leads

Gemini 1.0 Pro: 17.1 (#296), Grok 4.1 Fast: 43.4 (#49)

BenchmarkGemini 1.0 ProGrok 4.1 Fast
LMArena Hard Prompts11091407
DTBench45.9%87.7%
SimpleBench—56%
NYT Connections (extended)—87.4%
Epoch Capabilities Index117.04—
ForecastBench—61

Math Grok 4.1 Fast leads

Gemini 1.0 Pro: 9.3 (#321), Grok 4.1 Fast: 31.9 (#221)

BenchmarkGemini 1.0 ProGrok 4.1 Fast
LMArena Math11321408
MathArena Final-Answer Competitions—60.9%
OTIS Mock AIME 2024-20251.1%—
ProofBench—4%
MATH Level 511.2%—

Knowledge Grok 4.1 Fast leads

Gemini 1.0 Pro: 15.6 (#291), Grok 4.1 Fast: 33.1 (#207)

BenchmarkGemini 1.0 ProGrok 4.1 Fast
LMArena Expert10591399
GPQA Diamond34%—
Vectara Hallucination Rate—17.8%
MMLU70%—

Multimodal Not comparable

Gemini 1.0 Pro: —, Grok 4.1 Fast: 37.0 (#76)

BenchmarkGemini 1.0 ProGrok 4.1 Fast
LMArena Vision—1201

Multilingual Grok 4.1 Fast leads

Gemini 1.0 Pro: 33.4 (#252), Grok 4.1 Fast: 51.0 (#114)

BenchmarkGemini 1.0 ProGrok 4.1 Fast
LMArena Non-English11381391
LMArena Chinese11241441
LMArena French11451415
LMArena German11251404
LMArena Japanese10231349
LMArena Russian11861387
LMArena Spanish11191413
LMArena Korean—1361

Instruction Following Grok 4.1 Fast leads

Gemini 1.0 Pro: 57.6 (#267), Grok 4.1 Fast: 72.7 (#133)

BenchmarkGemini 1.0 ProGrok 4.1 Fast
LMArena Instruction Following11141376

Long Context Grok 4.1 Fast leads

Gemini 1.0 Pro: 34.3 (#249), Grok 4.1 Fast: 42.4 (#126)

BenchmarkGemini 1.0 ProGrok 4.1 Fast
LMArena Longer Query11321390

Writing & Preference Grok 4.1 Fast leads

Gemini 1.0 Pro: 36.0 (#264), Grok 4.1 Fast: 57.2 (#131)

BenchmarkGemini 1.0 ProGrok 4.1 Fast
LMArena Text11491408
LMArena Creative Writing11311394
LMArena Multi-Turn11391389
EQ-Bench Creative Writing—1327

Frequently asked questions

Is Gemini 1.0 Pro better than Grok 4.1 Fast?

Grok 4.1 Fast is the stronger model overall, scoring 41.4 to 27.3 on the Noometry Index.

Is Gemini 1.0 Pro or Grok 4.1 Fast better for coding?

Grok 4.1 Fast scores higher on coding benchmarks: 34.1 versus 32.2 in the Noometry coding category.

How many benchmarks do Gemini 1.0 Pro and Grok 4.1 Fast share?

17 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and Grok 4.1 Fast has 32.

Related comparisons

Go deeper