Noometry

Model comparison

Gemini 2.5 Flash-Lite vs Grok-3 mini

Grok-3 mini is the stronger model overall, scoring 41.2 to 37.0 on the Noometry Index.

Last verified . 26 shared benchmarks.

Gemini 2.5 Flash-Lite Google

37.0

Rank #211 Confirmed

Grok-3 mini xAI

41.2

Rank #141 Confirmed

Summary

  • They share 26 benchmarks with published results for both. Gemini 2.5 Flash-Lite scores higher in 3 categories and Grok-3 mini in 5 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Grok-3 mini leads 46.4 to 32.5.
  • The biggest single-benchmark swing is GPQA (HELM): 30.9% for Gemini 2.5 Flash-Lite and 67.5% for Grok-3 mini.

Side by side

Gemini 2.5 Flash-LiteGrok-3 mini
ProviderGooglexAI
Noometry Index37.041.2
Released2025-06-172025-04-09
WeightsProprietaryProprietary
Context window1.05M—
Max output66K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.40—
Results tracked3335

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok-3 mini leads

Gemini 2.5 Flash-Lite: 38.5 (#173), Grok-3 mini: 40.8 (#131)

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
WeirdML35.2%42.6%
LMArena Coding13731379
Aider Polyglot—49.3%
ALE-Bench325.9—

Agentic & Tool Use Not comparable

Gemini 2.5 Flash-Lite: 28.0 (#96), Grok-3 mini: —

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
Berkeley Function Calling Leaderboard36.9%—

Reasoning Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 22.2 (#205), Grok-3 mini: 13.6 (#334)

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
Kagi LLM Benchmark40.5%61.3%
LMArena Hard Prompts13771375
Epoch Capabilities Index133.94140.35
ARC-AGI-2—0.4%
ARC-AGI-1—16.5%
DTBench62.8%—
LMCA18.1%—

Math Grok-3 mini leads

Gemini 2.5 Flash-Lite: 38.0 (#144), Grok-3 mini: 42.1 (#85)

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
Omni-MATH48%31.8%
LMArena Math13731386
OTIS Mock AIME 2024-2025—77.8%
MATH Level 5—90.9%
FrontierMath (Feb 2025 set)—5.9%

Knowledge Grok-3 mini leads

Gemini 2.5 Flash-Lite: 32.5 (#210), Grok-3 mini: 46.4 (#81)

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
MMLU-Pro53.7%79.9%
GPQA (HELM)30.9%67.5%
LMArena Expert13731395
GPQA Diamond—76.3%
Confabulations—10.8%
Vectara Hallucination Rate3.3%—

Multimodal Not comparable

Gemini 2.5 Flash-Lite: 29.1 (#114), Grok-3 mini: —

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
LMArena Vision1198—
VPCT30%—

Multilingual Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 49.3 (#134), Grok-3 mini: 48.1 (#145)

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
LMArena Non-English13691352
LMArena Chinese14041387
LMArena French13881357
LMArena German13891349
LMArena Japanese13591342
LMArena Korean13601335
LMArena Russian13731353
LMArena Spanish13961381

Instruction Following Grok-3 mini leads

Gemini 2.5 Flash-Lite: 70.0 (#168), Grok-3 mini: 78.5 (#9)

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
IFEval81%95.1%
LMArena Instruction Following13671357

Long Context Grok-3 mini leads

Gemini 2.5 Flash-Lite: 33.3 (#262), Grok-3 mini: 41.0 (#147)

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
Fiction.LiveBench47.2%66.7%
LMArena Longer Query13731372

Writing & Preference Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 56.8 (#135), Grok-3 mini: 52.5 (#169)

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
LMArena Text13791370
LMArena Creative Writing13671342
WildBench81.8%65.1%
LMArena Multi-Turn13661355
Short-Story Creative Writing—73.5%

Frequently asked questions

Is Gemini 2.5 Flash-Lite better than Grok-3 mini?

Grok-3 mini is the stronger model overall, scoring 41.2 to 37.0 on the Noometry Index.

Is Gemini 2.5 Flash-Lite or Grok-3 mini better for coding?

Grok-3 mini scores higher on coding benchmarks: 40.8 versus 38.5 in the Noometry coding category.

How many benchmarks do Gemini 2.5 Flash-Lite and Grok-3 mini share?

26 benchmarks have published results for both models. Gemini 2.5 Flash-Lite has 33 scored results on Noometry and Grok-3 mini has 35.

Related comparisons

Go deeper