Noometry

Model comparison

Gemini 2.5 Flash vs Grok 4

Grok 4 is the stronger model overall, scoring 48.1 to 39.3 on the Noometry Index.

Last verified . 41 shared benchmarks.

Gemini 2.5 Flash Google

39.3

Rank #170 Confirmed

Grok 4 xAI

48.1

Rank #56 Confirmed

Summary

  • They share 41 benchmarks with published results for both. Gemini 2.5 Flash scores higher in 2 categories and Grok 4 in 8 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4 leads 36.7 to 18.1.
  • The biggest single-benchmark swing is GPQA (HELM): 39% for Gemini 2.5 Flash and 72.7% for Grok 4.

Side by side

Gemini 2.5 FlashGrok 4
ProviderGooglexAI
Noometry Index39.348.1
Released2025-04-172025-07-09
WeightsProprietaryProprietary
Context window1.05M—
Max output66K—
Input $ / M tokens$0.30—
Output $ / M tokens$2.50—
Results tracked5448

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4 leads

Gemini 2.5 Flash: 35.8 (#220), Grok 4: 50.3 (#46)

BenchmarkGemini 2.5 FlashGrok 4
Aider Polyglot55.1%79.6%
WeirdML41.9%45.7%
LMArena Coding14241408
SWE-bench Verified (bash only)28.7%—
ALE-Bench661.88—

Agentic & Tool Use Grok 4 leads

Gemini 2.5 Flash: 30.8 (#74), Grok 4: 32.3 (#68)

BenchmarkGemini 2.5 FlashGrok 4
Terminal-Bench17.1%27.2%
Berkeley Function Calling Leaderboard56.2%63%
BALROG33.5%43.6%
GDPval—21.1%
TheAgentCompany41.1%—
Cybench—43%
DeepResearch Bench—47.3%
LMArena Search—1142
METR Time Horizons—66.6%
Vending-Bench 2548.84—

Reasoning Grok 4 leads

Gemini 2.5 Flash: 18.1 (#286), Grok 4: 36.7 (#65)

BenchmarkGemini 2.5 FlashGrok 4
ARC-AGI-22.5%16%
SimpleBench41.2%60.5%
Kagi LLM Benchmark56.8%73.6%
ARC-AGI-133.3%66.7%
LMArena Hard Prompts14221409
Epoch Capabilities Index143.03146.44
ForecastBench60.660.9
CritPt1.1%—
Chess Puzzles—28%
EnigmaEval2.7%—
DTBench76.5%—
LMCA27.5%—

Math Grok 4 leads

Gemini 2.5 Flash: 39.9 (#98), Grok 4: 48.4 (#64)

BenchmarkGemini 2.5 FlashGrok 4
OTIS Mock AIME 2024-202573.1%84%
Omni-MATH38.5%60.3%
LMArena Math14151422
FrontierMath (Feb 2025 set)4.8%19.7%
FrontierMath Tier 4 (v1)4.2%2.1%

Knowledge Grok 4 leads

Gemini 2.5 Flash: 36.4 (#168), Grok 4: 53.8 (#55)

BenchmarkGemini 2.5 FlashGrok 4
MMLU-Pro63.9%85.1%
Confabulations16.8%12.4%
GPQA (HELM)39%72.7%
LMArena Expert14261415
GPQA Diamond—87%
Humanity's Last Exam12.1%—
Vectara Hallucination Rate7.8%—

Multimodal Gemini 2.5 Flash leads

Gemini 2.5 Flash: 41.8 (#32), Grok 4: 33.7 (#94)

BenchmarkGemini 2.5 FlashGrok 4
LMArena Vision12531210
GeoBench76%45%
VPCT46.2%—
SpatialViz-Bench36.9%—

Multilingual Too close to call

Gemini 2.5 Flash: 52.3 (#88), Grok 4: 51.8 (#103)

BenchmarkGemini 2.5 FlashGrok 4
LMArena Non-English14091403
LMArena Chinese14501427
LMArena French14331418
LMArena German14181429
LMArena Japanese14051394
LMArena Korean13851377
LMArena Russian14151410
LMArena Spanish14211420

Instruction Following Grok 4 leads

Gemini 2.5 Flash: 75.7 (#54), Grok 4: 79.2 (#5)

BenchmarkGemini 2.5 FlashGrok 4
IFEval89.8%94.9%
LMArena Instruction Following14051387

Long Context Grok 4 leads

Gemini 2.5 Flash: 47.5 (#17), Grok 4: 63.1 (#4)

BenchmarkGemini 2.5 FlashGrok 4
Fiction.LiveBench77.8%94.4%
LMArena Longer Query14191409

Writing & Preference Grok 4 leads

Gemini 2.5 Flash: 53.8 (#157), Grok 4: 58.5 (#116)

BenchmarkGemini 2.5 FlashGrok 4
LMArena Text14171411
LMArena Creative Writing14001397
Short-Story Creative Writing76.5%76.9%
WildBench81.7%79.7%
LMArena Multi-Turn14081416
EQ-Bench Creative Writing1137—

Frequently asked questions

Is Gemini 2.5 Flash better than Grok 4?

Grok 4 is the stronger model overall, scoring 48.1 to 39.3 on the Noometry Index.

Is Gemini 2.5 Flash or Grok 4 better for coding?

Grok 4 scores higher on coding benchmarks: 50.3 versus 35.8 in the Noometry coding category.

How many benchmarks do Gemini 2.5 Flash and Grok 4 share?

41 benchmarks have published results for both models. Gemini 2.5 Flash has 54 scored results on Noometry and Grok 4 has 48.

Related comparisons

Go deeper