Noometry

Model comparison

Gemini 1.5 Flash 8B vs Grok 4.5

Grok 4.5 is the stronger model overall, scoring 55.0 to 29.9 on the Noometry Index.

Last verified . 21 shared benchmarks.

Gemini 1.5 Flash 8B Google

29.9

Rank #301 Confirmed

Grok 4.5 xAI

55.0

Rank #25 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 0 categories and Grok 4.5 in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Grok 4.5 leads 60.9 to 14.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.6% for Gemini 1.5 Flash 8B and 97.8% for Grok 4.5.

Side by side

Gemini 1.5 Flash 8BGrok 4.5
ProviderGooglexAI
Noometry Index29.955.0
Released2024-10-032026-07-08
WeightsProprietaryProprietary
Context window—500K
Max output—500K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked2152

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.5 leads

Gemini 1.5 Flash 8B: 35.5 (#225), Grok 4.5: 52.2 (#35)

BenchmarkGemini 1.5 Flash 8BGrok 4.5
LMArena Coding12181474
DeepSWE—53.8%
FrontierCode—42.4%
LMArena WebDev—1553
SciCode—54.1%
WeirdML—46.4%
ALE-Bench—1,309

Agentic & Tool Use Not comparable

Gemini 1.5 Flash 8B: —, Grok 4.5: 44.4 (#17)

BenchmarkGemini 1.5 Flash 8BGrok 4.5
APEX-Agents—56.2%
τ²-bench Banking—47.9%
PostTrainBench—23.4%
GBAEval—65.4%
GDP.pdf—14%
LMArena Search—1213
Vending-Bench 2—3,887

Reasoning Grok 4.5 leads

Gemini 1.5 Flash 8B: 20.0 (#244), Grok 4.5: 56.1 (#25)

BenchmarkGemini 1.5 Flash 8BGrok 4.5
LMArena Hard Prompts12091462
DTBench50%96.5%
ARC-AGI-2—52.6%
SimpleBench—70%
Kagi LLM Benchmark—83.5%
NYT Connections (extended)—79.9%
ARC-AGI-1—87.2%
CritPt—15.4%
Chess Puzzles—36%
LMCA—45.2%
Surface Evolver Bench—74.4%
Epoch Capabilities Index—153.92

Math Grok 4.5 leads

Gemini 1.5 Flash 8B: 14.2 (#302), Grok 4.5: 60.9 (#35)

BenchmarkGemini 1.5 Flash 8BGrok 4.5
OTIS Mock AIME 2024-20254.6%97.8%
LMArena Math12071459
FrontierMath (Tiers 1-3)—57.2%
FrontierMath Tier 4—24.4%
ProofBench—31%

Knowledge Grok 4.5 leads

Gemini 1.5 Flash 8B: 16.0 (#289), Grok 4.5: 62.3 (#24)

BenchmarkGemini 1.5 Flash 8BGrok 4.5
GPQA Diamond33%93.4%
LMArena Expert11851466
SimpleQA Verified—48.3%

Multimodal Grok 4.5 leads

Gemini 1.5 Flash 8B: 28.2 (#115), Grok 4.5: 37.6 (#72)

BenchmarkGemini 1.5 Flash 8BGrok 4.5
LMArena Vision10441288
Blueprint-Bench 2—27.3%
Furniture Assembly—22.5%
LMArena Document—1452

Multilingual Grok 4.5 leads

Gemini 1.5 Flash 8B: 38.5 (#229), Grok 4.5: 54.4 (#42)

BenchmarkGemini 1.5 Flash 8BGrok 4.5
LMArena Non-English12151440
LMArena Chinese12311496
LMArena French12341456
LMArena German12061446
LMArena Japanese11501428
LMArena Korean11401404
LMArena Russian12361448
LMArena Spanish12121450

Instruction Following Grok 4.5 leads

Gemini 1.5 Flash 8B: 62.8 (#236), Grok 4.5: 76.0 (#48)

BenchmarkGemini 1.5 Flash 8BGrok 4.5
LMArena Instruction Following11991446

Long Context Grok 4.5 leads

Gemini 1.5 Flash 8B: 37.0 (#225), Grok 4.5: 44.8 (#56)

BenchmarkGemini 1.5 Flash 8BGrok 4.5
LMArena Longer Query12191463

Writing & Preference Grok 4.5 leads

Gemini 1.5 Flash 8B: 42.8 (#232), Grok 4.5: 65.8 (#42)

BenchmarkGemini 1.5 Flash 8BGrok 4.5
LMArena Text12261448
LMArena Creative Writing12181442
LMArena Multi-Turn11851456
EQ-Bench Creative Writing—1579

Frequently asked questions

Is Gemini 1.5 Flash 8B better than Grok 4.5?

Grok 4.5 is the stronger model overall, scoring 55.0 to 29.9 on the Noometry Index.

Is Gemini 1.5 Flash 8B or Grok 4.5 better for coding?

Grok 4.5 scores higher on coding benchmarks: 52.2 versus 35.5 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash 8B and Grok 4.5 share?

21 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and Grok 4.5 has 52.

Related comparisons

Go deeper