Model comparison

Gemini 3.1 Flash Lite vs Grok 2 Mini 2024 08 13

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.8 to 37.7 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemini 3.1 Flash Lite Google

40.8

Rank #144 Confirmed

Grok 2 Mini 2024 08 13 xAI

37.7

Rank #198 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemini 3.1 Flash Lite scores higher in 7 categories and Grok 2 Mini 2024 08 13 in 1 category; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemini 3.1 Flash Lite leads 60.9 to 47.3.

Side by side

Gemini 3.1 Flash Lite and Grok 2 Mini 2024 08 13 specifications
Gemini 3.1 Flash LiteGrok 2 Mini 2024 08 13
ProviderGooglexAI
Noometry Index40.837.7
Released2026-03-032024-08-13
WeightsProprietaryProprietary
Context window1.05M—
Max output66K—
Input $ / M tokens$0.25—
Output $ / M tokens$1.50—
Results tracked3817

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Gemini 3.1 Flash Lite: 37.8 (#188), Grok 2 Mini 2024 08 13: 37.0 (#199)

Coding benchmarks
BenchmarkGemini 3.1 Flash LiteGrok 2 Mini 2024 08 13
LMArena Coding14001269
LMArena WebDev1256—
SciCode41.9%—
WeirdML52.2%—
ALE-Bench797.73—

Agentic & Tool Use Not comparable

Gemini 3.1 Flash Lite: 30.2 (#79), Grok 2 Mini 2024 08 13: —

Agentic & Tool Use benchmarks
BenchmarkGemini 3.1 Flash LiteGrok 2 Mini 2024 08 13
DeepResearch Bench37.3%—

Reasoning Grok 2 Mini 2024 08 13 leads

Gemini 3.1 Flash Lite: 22.9 (#186), Grok 2 Mini 2024 08 13: 24.8 (#159)

Reasoning benchmarks
BenchmarkGemini 3.1 Flash LiteGrok 2 Mini 2024 08 13
LMArena Hard Prompts14071255
Kagi LLM Benchmark67.2%—
NYT Connections (extended)8.2%—
CritPt1.1%—
Chess Puzzles25%—
EnigmaEval3%—
Thematic Generalization63.3%—
DTBench76.8%—
LMCA35%—
Epoch Capabilities Index144.47—
ForecastBench54.4—

Math Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 40.7 (#90), Grok 2 Mini 2024 08 13: 35.4 (#185)

Math benchmarks
BenchmarkGemini 3.1 Flash LiteGrok 2 Mini 2024 08 13
LMArena Math14281265
FrontierMath (Tiers 1-3)27.7%—
OTIS Mock AIME 2024-202580%—

Knowledge Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 41.9 (#104), Grok 2 Mini 2024 08 13: 33.9 (#200)

Knowledge benchmarks
BenchmarkGemini 3.1 Flash LiteGrok 2 Mini 2024 08 13
LMArena Expert13981238
GPQA Diamond81.8%—
Humanity's Last Exam8.6%—
Vectara Hallucination Rate8.2%—

Multimodal Not comparable

Gemini 3.1 Flash Lite: 39.4 (#60), Grok 2 Mini 2024 08 13: —

Multimodal benchmarks
BenchmarkGemini 3.1 Flash LiteGrok 2 Mini 2024 08 13
LMArena Vision1240—

Multilingual Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 52.3 (#86), Grok 2 Mini 2024 08 13: 41.4 (#208)

Multilingual benchmarks
BenchmarkGemini 3.1 Flash LiteGrok 2 Mini 2024 08 13
LMArena Non-English14111257
LMArena Chinese14611262
LMArena French14241286
LMArena German14291273
LMArena Japanese14131213
LMArena Korean13921195
LMArena Russian14201261
LMArena Spanish14211279

Instruction Following Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 72.7 (#131), Grok 2 Mini 2024 08 13: 65.5 (#220)

Instruction Following benchmarks
BenchmarkGemini 3.1 Flash LiteGrok 2 Mini 2024 08 13
LMArena Instruction Following13771245

Long Context Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 42.5 (#122), Grok 2 Mini 2024 08 13: 38.4 (#196)

Long Context benchmarks
BenchmarkGemini 3.1 Flash LiteGrok 2 Mini 2024 08 13
LMArena Longer Query13941266

Writing & Preference Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 60.9 (#94), Grok 2 Mini 2024 08 13: 47.3 (#211)

Writing & Preference benchmarks
BenchmarkGemini 3.1 Flash LiteGrok 2 Mini 2024 08 13
LMArena Text14161281
LMArena Creative Writing14011242
LMArena Multi-Turn14171265

Frequently asked questions

Is Gemini 3.1 Flash Lite better than Grok 2 Mini 2024 08 13?

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.8 to 37.7 on the Noometry Index.

Is Gemini 3.1 Flash Lite or Grok 2 Mini 2024 08 13 better for coding?

They score almost the same on coding (37.8 vs 37.0); test both on your own repository before choosing.

How many benchmarks do Gemini 3.1 Flash Lite and Grok 2 Mini 2024 08 13 share?

17 benchmarks have published results for both models. Gemini 3.1 Flash Lite has 38 scored results on Noometry and Grok 2 Mini 2024 08 13 has 17.

Related comparisons

Go deeper