Noometry

Model comparison

Gemini 2.5 Flash vs Grok 4.1

Grok 4.1 is the stronger model overall, scoring 41.5 to 39.3 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemini 2.5 Flash Google

39.3

Rank #170 Confirmed

Grok 4.1 xAI

41.5

Rank #134 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemini 2.5 Flash scores higher in 4 categories and Grok 4.1 in 5 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.1 leads 29.5 to 18.1.

Side by side

Gemini 2.5 FlashGrok 4.1
ProviderGooglexAI
Noometry Index39.341.5
Released2025-04-172025-11-17
WeightsProprietaryProprietary
Context window1.05M—
Max output66K—
Input $ / M tokens$0.30—
Output $ / M tokens$2.50—
Results tracked5419

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash leads

Gemini 2.5 Flash: 35.8 (#220), Grok 4.1: 33.7 (#253)

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Coding14241445
SWE-bench Verified (bash only)28.7%—
Aider Polyglot55.1%—
LMArena WebDev—1214
WeirdML41.9%—
ALE-Bench661.88—

Agentic & Tool Use Grok 4.1 leads

Gemini 2.5 Flash: 30.8 (#74), Grok 4.1: 34.1 (#49)

BenchmarkGemini 2.5 FlashGrok 4.1
Terminal-Bench17.1%—
Berkeley Function Calling Leaderboard56.2%—
TheAgentCompany41.1%—
Cybench—39%
BALROG33.5%—
Vending-Bench 2548.84—

Reasoning Grok 4.1 leads

Gemini 2.5 Flash: 18.1 (#286), Grok 4.1: 29.5 (#91)

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Hard Prompts14221435
ARC-AGI-22.5%—
SimpleBench41.2%—
Kagi LLM Benchmark56.8%—
ARC-AGI-133.3%—
CritPt1.1%—
EnigmaEval2.7%—
DTBench76.5%—
LMCA27.5%—
Epoch Capabilities Index143.03—
ForecastBench60.6—

Math Too close to call

Gemini 2.5 Flash: 39.9 (#98), Grok 4.1: 38.9 (#120)

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Math14151422
OTIS Mock AIME 2024-202573.1%—
Omni-MATH38.5%—
FrontierMath (Feb 2025 set)4.8%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Grok 4.1 leads

Gemini 2.5 Flash: 36.4 (#168), Grok 4.1: 39.5 (#133)

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Expert14261417
Humanity's Last Exam12.1%—
MMLU-Pro63.9%—
Confabulations16.8%—
Vectara Hallucination Rate7.8%—
GPQA (HELM)39%—

Multimodal Not comparable

Gemini 2.5 Flash: 41.8 (#32), Grok 4.1: —

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Vision1253—
GeoBench76%—
VPCT46.2%—
SpatialViz-Bench36.9%—

Multilingual Grok 4.1 leads

Gemini 2.5 Flash: 52.3 (#88), Grok 4.1: 53.4 (#68)

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Non-English14091425
LMArena Chinese14501465
LMArena French14331448
LMArena German14181446
LMArena Japanese14051397
LMArena Korean13851407
LMArena Russian14151434
LMArena Spanish14211438

Instruction Following Gemini 2.5 Flash leads

Gemini 2.5 Flash: 75.7 (#54), Grok 4.1: 73.8 (#111)

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Instruction Following14051400
IFEval89.8%—

Long Context Gemini 2.5 Flash leads

Gemini 2.5 Flash: 47.5 (#17), Grok 4.1: 43.2 (#100)

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Longer Query14191416
Fiction.LiveBench77.8%—

Writing & Preference Grok 4.1 leads

Gemini 2.5 Flash: 53.8 (#157), Grok 4.1: 62.4 (#75)

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Text14171437
LMArena Creative Writing14001411
LMArena Multi-Turn14081437
Short-Story Creative Writing76.5%—
EQ-Bench Creative Writing1137—
WildBench81.7%—

Frequently asked questions

Is Gemini 2.5 Flash better than Grok 4.1?

Grok 4.1 is the stronger model overall, scoring 41.5 to 39.3 on the Noometry Index.

Is Gemini 2.5 Flash or Grok 4.1 better for coding?

Gemini 2.5 Flash scores higher on coding benchmarks: 35.8 versus 33.7 in the Noometry coding category.

How many benchmarks do Gemini 2.5 Flash and Grok 4.1 share?

17 benchmarks have published results for both models. Gemini 2.5 Flash has 54 scored results on Noometry and Grok 4.1 has 19.

Related comparisons

Go deeper