Noometry

Model comparison

Gemini 1.5 Flash 8B vs Grok 4.3

Grok 4.3 is the stronger model overall, scoring 43.6 to 29.7 on the Noometry Index.

Last verified . 21 shared benchmarks.

Gemini 1.5 Flash 8B Google

29.7

Rank #292 Confirmed

Grok 4.3 xAI

43.6

Rank #80 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 0 categories and Grok 4.3 in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Grok 4.3 leads 52.5 to 16.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.6% for Gemini 1.5 Flash 8B and 93.3% for Grok 4.3.

Side by side

Gemini 1.5 Flash 8BGrok 4.3
ProviderGooglexAI
Noometry Index29.743.6
Released2024-10-032026-04-17
WeightsProprietaryProprietary
Context window—1M
Max output—30K
Input $ / M tokens—$1.25
Output $ / M tokens—$2.50
Results tracked2140

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.3 leads

Gemini 1.5 Flash 8B: 34.9 (#221), Grok 4.3: 41.3 (#117)

BenchmarkGemini 1.5 Flash 8BGrok 4.3
LMArena Coding12181415
LMArena WebDev—1357
SciCode—47.3%
WeirdML—49.9%
ALE-Bench—944.17

Agentic & Tool Use Not comparable

Gemini 1.5 Flash 8B: —, Grok 4.3: 27.6 (#93)

BenchmarkGemini 1.5 Flash 8BGrok 4.3
GDP.pdf—8%
LMArena Search—1165
Vending-Bench 2—35.26

Reasoning Grok 4.3 leads

Gemini 1.5 Flash 8B: 19.2 (#242), Grok 4.3: 34.9 (#60)

BenchmarkGemini 1.5 Flash 8BGrok 4.3
LMArena Hard Prompts12101397
DTBench50%90.7%
NYT Connections (extended)—55.2%
CritPt—8%
Chess Puzzles—25%
LMCA—38.3%
Epoch Capabilities Index—149.13
ForecastBench—60.3

Math Grok 4.3 leads

Gemini 1.5 Flash 8B: 13.3 (#296), Grok 4.3: 45.8 (#60)

BenchmarkGemini 1.5 Flash 8BGrok 4.3
OTIS Mock AIME 2024-20254.6%93.3%
LMArena Math12071388
FrontierMath (Tiers 1-3)—42.8%
FrontierMath Tier 4—14.6%
ProofBench—11%

Knowledge Grok 4.3 leads

Gemini 1.5 Flash 8B: 16.0 (#285), Grok 4.3: 52.5 (#57)

BenchmarkGemini 1.5 Flash 8BGrok 4.3
GPQA Diamond33%88.8%
LMArena Expert11851385
SimpleQA Verified—33.2%

Multimodal Grok 4.3 leads

Gemini 1.5 Flash 8B: 27.6 (#110), Grok 4.3: 31.6 (#96)

BenchmarkGemini 1.5 Flash 8BGrok 4.3
LMArena Vision10441231
Blueprint-Bench 2—0%

Multilingual Grok 4.3 leads

Gemini 1.5 Flash 8B: 38.6 (#224), Grok 4.3: 50.7 (#114)

BenchmarkGemini 1.5 Flash 8BGrok 4.3
LMArena Non-English12151385
LMArena Chinese12311423
LMArena French12331412
LMArena German12061395
LMArena Japanese11501379
LMArena Korean11401357
LMArena Russian12361399
LMArena Spanish12121402

Instruction Following Grok 4.3 leads

Gemini 1.5 Flash 8B: 63.1 (#231), Grok 4.3: 72.3 (#135)

BenchmarkGemini 1.5 Flash 8BGrok 4.3
LMArena Instruction Following11991366

Long Context Grok 4.3 leads

Gemini 1.5 Flash 8B: 36.9 (#220), Grok 4.3: 42.5 (#118)

BenchmarkGemini 1.5 Flash 8BGrok 4.3
LMArena Longer Query12191393

Writing & Preference Grok 4.3 leads

Gemini 1.5 Flash 8B: 43.0 (#227), Grok 4.3: 58.6 (#112)

BenchmarkGemini 1.5 Flash 8BGrok 4.3
LMArena Text12261397
LMArena Creative Writing12181380
LMArena Multi-Turn11851406
EQ-Bench 4—1075

Frequently asked questions

Is Gemini 1.5 Flash 8B better than Grok 4.3?

Grok 4.3 is the stronger model overall, scoring 43.6 to 29.7 on the Noometry Index.

Is Gemini 1.5 Flash 8B or Grok 4.3 better for coding?

Grok 4.3 scores higher on coding benchmarks: 41.3 versus 34.9 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash 8B and Grok 4.3 share?

21 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and Grok 4.3 has 40.

Related comparisons

Go deeper