Model comparison

Gemini 1.0 Pro vs Grok 4 Fast

Grok 4 Fast is the stronger model overall, scoring 39.4 to 27.3 on the Noometry Index.

Last verified . 18 shared benchmarks.

Gemini 1.0 Pro Google

27.3

Rank #332 Confirmed

Grok 4 Fast xAI

39.4

Rank #167 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Gemini 1.0 Pro scores higher in 0 categories and Grok 4 Fast in 8 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Grok 4 Fast leads 38.9 to 9.3.
  • The biggest single-benchmark swing is DTBench: 45.9% for Gemini 1.0 Pro and 82.7% for Grok 4 Fast.

Side by side

Gemini 1.0 Pro and Grok 4 Fast specifications
Gemini 1.0 ProGrok 4 Fast
ProviderGooglexAI
Noometry Index27.339.4
Released2023-12-132025-09-19
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2430

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Gemini 1.0 Pro: 32.2 (#275), Grok 4 Fast: 32.5 (#271)

Coding benchmarks
BenchmarkGemini 1.0 ProGrok 4 Fast
LMArena Coding11081429
LMArena WebDev—1159
WeirdML—42.9%
HumanEval+55.5%—
MBPP+61.4%—

Agentic & Tool Use Not comparable

Gemini 1.0 Pro: —, Grok 4 Fast: 29.5 (#86)

Agentic & Tool Use benchmarks
BenchmarkGemini 1.0 ProGrok 4 Fast
τ²-bench Banking—15.7%
Cybench—30%
LMArena Search—1171

Reasoning Grok 4 Fast leads

Gemini 1.0 Pro: 17.1 (#296), Grok 4 Fast: 22.2 (#201)

Reasoning benchmarks
BenchmarkGemini 1.0 ProGrok 4 Fast
LMArena Hard Prompts11091412
DTBench45.9%82.7%
Epoch Capabilities Index117.04144.2
ARC-AGI-2—5.3%
Kagi LLM Benchmark—66.1%
ARC-AGI-1—48.5%
ForecastBench—60.5

Math Grok 4 Fast leads

Gemini 1.0 Pro: 9.3 (#321), Grok 4 Fast: 38.9 (#123)

Math benchmarks
BenchmarkGemini 1.0 ProGrok 4 Fast
LMArena Math11321419
OTIS Mock AIME 2024-20251.1%—
MATH Level 511.2%—

Knowledge Grok 4 Fast leads

Gemini 1.0 Pro: 15.6 (#291), Grok 4 Fast: 32.0 (#214)

Knowledge benchmarks
BenchmarkGemini 1.0 ProGrok 4 Fast
LMArena Expert10591411
GPQA Diamond34%—
Vectara Hallucination Rate—19.7%
MMLU70%—

Multilingual Grok 4 Fast leads

Gemini 1.0 Pro: 33.4 (#252), Grok 4 Fast: 51.3 (#111)

Multilingual benchmarks
BenchmarkGemini 1.0 ProGrok 4 Fast
LMArena Non-English11381396
LMArena Chinese11241457
LMArena French11451431
LMArena German11251383
LMArena Japanese10231352
LMArena Russian11861389
LMArena Spanish11191415
LMArena Korean—1357

Instruction Following Grok 4 Fast leads

Gemini 1.0 Pro: 57.6 (#267), Grok 4 Fast: 73.2 (#121)

Instruction Following benchmarks
BenchmarkGemini 1.0 ProGrok 4 Fast
LMArena Instruction Following11141387

Long Context Grok 4 Fast leads

Gemini 1.0 Pro: 34.3 (#249), Grok 4 Fast: 63.2 (#3)

Long Context benchmarks
BenchmarkGemini 1.0 ProGrok 4 Fast
LMArena Longer Query11321415
Fiction.LiveBench—94.4%

Writing & Preference Grok 4 Fast leads

Gemini 1.0 Pro: 36.0 (#264), Grok 4 Fast: 60.0 (#102)

Writing & Preference benchmarks
BenchmarkGemini 1.0 ProGrok 4 Fast
LMArena Text11491407
LMArena Creative Writing11311387
LMArena Multi-Turn11391414

Frequently asked questions

Is Gemini 1.0 Pro better than Grok 4 Fast?

Grok 4 Fast is the stronger model overall, scoring 39.4 to 27.3 on the Noometry Index.

Is Gemini 1.0 Pro or Grok 4 Fast better for coding?

They score almost the same on coding (32.2 vs 32.5); test both on your own repository before choosing.

How many benchmarks do Gemini 1.0 Pro and Grok 4 Fast share?

18 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and Grok 4 Fast has 30.

Related comparisons

Go deeper