Model comparison

Gemini 2.0 Pro vs Step 3.5 Flash

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 39.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemini 2.0 Pro Google

39.1

Rank #173 Confirmed

Step 3.5 Flash StepFun

42.3

Rank #116 Confirmed

Summary

  • The widest gap is in long context, where Step 3.5 Flash leads 42.8 to 29.2.
  • Step 3.5 Flash has downloadable open weights; the other is API-only.

Side by side

Gemini 2.0 Pro and Step 3.5 Flash specifications
Gemini 2.0 ProStep 3.5 Flash
ProviderGoogleStepFun
Noometry Index39.142.3
Released2025-02-052026-01-29
WeightsProprietaryOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.30
Results tracked1419

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.5 Flash leads

Gemini 2.0 Pro: 37.8 (#187), Step 3.5 Flash: 42.4 (#105)

Coding benchmarks
BenchmarkGemini 2.0 ProStep 3.5 Flash
Aider Polyglot35.6%—
LiveBench Coding63.5%—
LMArena Coding—1436

Reasoning Too close to call

Gemini 2.0 Pro: 22.3 (#198), Step 3.5 Flash: 22.2 (#202)

Reasoning benchmarks
BenchmarkGemini 2.0 ProStep 3.5 Flash
NYT Connections (extended)—28.4%
EnigmaEval0.7%—
LiveBench Reasoning60.1%—
LMArena Hard Prompts—1411
LiveBench Data Analysis68%—
Epoch Capabilities Index135.06—
LiveBench65.1%—

Math Step 3.5 Flash leads

Gemini 2.0 Pro: 39.7 (#100), Step 3.5 Flash: 42.6 (#84)

Math benchmarks
BenchmarkGemini 2.0 ProStep 3.5 Flash
MathArena Final-Answer Competitions—66.8%
LiveBench Math71%—
LMArena Math—1408
MATH Level 583.5%—

Knowledge Step 3.5 Flash leads

Gemini 2.0 Pro: 36.5 (#167), Step 3.5 Flash: 39.6 (#132)

Knowledge benchmarks
BenchmarkGemini 2.0 ProStep 3.5 Flash
GPQA Diamond65.7%—
Confabulations18.4%—
LMArena Expert—1421

Multilingual Not comparable

Gemini 2.0 Pro: —, Step 3.5 Flash: 50.5 (#119)

Multilingual benchmarks
BenchmarkGemini 2.0 ProStep 3.5 Flash
LMArena Non-English—1385
LMArena Chinese—1447
LMArena French—1421
LMArena German—1405
LMArena Japanese—1354
LMArena Korean—1352
LMArena Russian—1385
LMArena Spanish—1419

Instruction Following Gemini 2.0 Pro leads

Gemini 2.0 Pro: 75.5 (#59), Step 3.5 Flash: 73.1 (#124)

Instruction Following benchmarks
BenchmarkGemini 2.0 ProStep 3.5 Flash
LiveBench Instruction Following83.4%—
LMArena Instruction Following—1385

Long Context Step 3.5 Flash leads

Gemini 2.0 Pro: 29.2 (#292), Step 3.5 Flash: 42.8 (#117)

Long Context benchmarks
BenchmarkGemini 2.0 ProStep 3.5 Flash
Fiction.LiveBench41.7%—
LMArena Longer Query—1402

Writing & Preference Step 3.5 Flash leads

Gemini 2.0 Pro: 52.7 (#165), Step 3.5 Flash: 58.8 (#113)

Writing & Preference benchmarks
BenchmarkGemini 2.0 ProStep 3.5 Flash
LMArena Text—1403
LMArena Creative Writing—1357
LMArena Multi-Turn—1405
LiveBench Language44.9%—

Frequently asked questions

Is Gemini 2.0 Pro better than Step 3.5 Flash?

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 39.1 on the Noometry Index.

Is Gemini 2.0 Pro or Step 3.5 Flash better for coding?

Step 3.5 Flash scores higher on coding benchmarks: 42.4 versus 37.8 in the Noometry coding category.

How many benchmarks do Gemini 2.0 Pro and Step 3.5 Flash share?

0 benchmarks have published results for both models. Gemini 2.0 Pro has 14 scored results on Noometry and Step 3.5 Flash has 19.

Related comparisons

Go deeper