Noometry

Model comparison

Gemini 3 Flash Preview vs Grok 4.20 (Non-Reasoning)

Gemini 3 Flash Preview is the stronger model overall, scoring 52.3 to 48.5 on the Noometry Index.

Last verified . 41 shared benchmarks.

Gemini 3 Flash Preview Google

52.3

Rank #33 Confirmed

Grok 4.20 (Non-Reasoning) xAI

48.5

Rank #48 Confirmed

Summary

  • They share 41 benchmarks with published results for both. Gemini 3 Flash Preview scores higher in 7 categories and Grok 4.20 (Non-Reasoning) in 3 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in multimodal, where Gemini 3 Flash Preview leads 45.3 to 33.2.
  • The biggest single-benchmark swing is SimpleQA Verified: 66.8% for Gemini 3 Flash Preview and 30.2% for Grok 4.20 (Non-Reasoning).
  • Gemini 3 Flash Preview is cheaper at $0.50 / $3 per million input/output tokens, against $1.25 / $2.50 for Grok 4.20 (Non-Reasoning).
  • Gemini 3 Flash Preview accepts more context: 1.05M tokens versus 1M.

Side by side

Gemini 3 Flash PreviewGrok 4.20 (Non-Reasoning)
ProviderGooglexAI
Noometry Index52.348.5
Released2025-12-172026-02-17
WeightsProprietaryProprietary
Context window1.05M1M
Max output66K30K
Input $ / M tokens$0.50$1.25
Output $ / M tokens$3$2.50
Results tracked5946

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 51.5 (#35), Grok 4.20 (Non-Reasoning): 41.8 (#104)

BenchmarkGemini 3 Flash PreviewGrok 4.20 (Non-Reasoning)
LMArena WebDev14391374
WeirdML61.6%52.3%
LMArena Coding14601458
ALE-Bench1,3671,150
SWE-bench Verified75.4%—
SWE-bench Verified (bash only)75.8%—
SWE-bench Multilingual72.7%—
GSO9.8%—

Agentic & Tool Use Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 38.6 (#27), Grok 4.20 (Non-Reasoning): 34.3 (#43)

BenchmarkGemini 3 Flash PreviewGrok 4.20 (Non-Reasoning)
Terminal-Bench64.3%57.3%
τ²-bench Banking27.3%18%
LMArena Search11981189
Vending-Bench 23,6354,663
τ²-bench Airline82.5%—
τ²-bench Retail76.8%—
τ²-bench Telecom91.2%—
DeepResearch Bench49.8%—
BALROG48.1%—
GDP.pdf10%—

Reasoning Grok 4.20 (Non-Reasoning) leads

Gemini 3 Flash Preview: 49.2 (#35), Grok 4.20 (Non-Reasoning): 52.2 (#30)

BenchmarkGemini 3 Flash PreviewGrok 4.20 (Non-Reasoning)
ARC-AGI-233.6%65.1%
NYT Connections (extended)83.1%85.4%
ARC-AGI-184.7%89.5%
Chess Puzzles40%24%
LMArena Hard Prompts14651451
DTBench89.1%90.1%
LMCA43.1%38.7%
Epoch Capabilities Index151.83152.01
ForecastBench58.561.4
SimpleBench61.1%—
Kagi LLM Benchmark—75%
Thematic Generalization—63.8%
Mystery Game Puzzles26%—

Math Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 51.4 (#42), Grok 4.20 (Non-Reasoning): 48.0 (#54)

BenchmarkGemini 3 Flash PreviewGrok 4.20 (Non-Reasoning)
FrontierMath (Tiers 1-3)51.2%44.9%
FrontierMath Tier 417.1%17.1%
OTIS Mock AIME 2024-202595.6%92.2%
ProofBench15%14%
LMArena Math14721455
MathArena Final-Answer Competitions67.6%—
FrontierMath (Feb 2025 set)35.6%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 58.8 (#30), Grok 4.20 (Non-Reasoning): 52.8 (#54)

BenchmarkGemini 3 Flash PreviewGrok 4.20 (Non-Reasoning)
GPQA Diamond89.4%89.3%
SimpleQA Verified66.8%30.2%
LMArena Expert14611440
Vectara Hallucination Rate13.5%—

Multimodal Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 45.3 (#15), Grok 4.20 (Non-Reasoning): 33.2 (#88)

BenchmarkGemini 3 Flash PreviewGrok 4.20 (Non-Reasoning)
LMArena Vision12851263
Blueprint-Bench 20%0%
LMArena Document14131416
GeoBench88%—
VPCT72.6%—

Multilingual Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 55.9 (#26), Grok 4.20 (Non-Reasoning): 54.7 (#38)

BenchmarkGemini 3 Flash PreviewGrok 4.20 (Non-Reasoning)
LMArena Non-English14581440
LMArena Chinese15101481
LMArena French14781477
LMArena German14971463
LMArena Japanese14881450
LMArena Korean14431417
LMArena Russian14801457
LMArena Spanish14701442

Instruction Following Too close to call

Gemini 3 Flash Preview: 75.8 (#52), Grok 4.20 (Non-Reasoning): 75.0 (#79)

BenchmarkGemini 3 Flash PreviewGrok 4.20 (Non-Reasoning)
LMArena Instruction Following14371420

Long Context Grok 4.20 (Non-Reasoning) leads

Gemini 3 Flash Preview: 44.4 (#63), Grok 4.20 (Non-Reasoning): 45.4 (#33)

BenchmarkGemini 3 Flash PreviewGrok 4.20 (Non-Reasoning)
LMArena Longer Query14521436
CL-bench—22.2%
CL-bench Life—11.9%

Writing & Preference Too close to call

Gemini 3 Flash Preview: 65.6 (#44), Grok 4.20 (Non-Reasoning): 65.9 (#42)

BenchmarkGemini 3 Flash PreviewGrok 4.20 (Non-Reasoning)
LMArena Text14661451
LMArena Creative Writing14571439
LMArena Multi-Turn14711456
EQ-Bench Creative Writing—1574

Frequently asked questions

Is Gemini 3 Flash Preview better than Grok 4.20 (Non-Reasoning)?

Gemini 3 Flash Preview is the stronger model overall, scoring 52.3 to 48.5 on the Noometry Index.

Which is cheaper, Gemini 3 Flash Preview or Grok 4.20 (Non-Reasoning)?

Gemini 3 Flash Preview is cheaper. It lists at $0.50 per million input tokens and $3 per million output tokens; Grok 4.20 (Non-Reasoning) lists at $1.25 and $2.50.

Is Gemini 3 Flash Preview or Grok 4.20 (Non-Reasoning) better for coding?

Gemini 3 Flash Preview scores higher on coding benchmarks: 51.5 versus 41.8 in the Noometry coding category.

Which has the bigger context window?

Gemini 3 Flash Preview does, with 1.05M tokens against 1M.

How many benchmarks do Gemini 3 Flash Preview and Grok 4.20 (Non-Reasoning) share?

41 benchmarks have published results for both models. Gemini 3 Flash Preview has 59 scored results on Noometry and Grok 4.20 (Non-Reasoning) has 46.

Related comparisons

Go deeper