Model comparison

Gemini 1.0 Pro vs Step 3.7 Flash

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 27.3 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemini 1.0 Pro Google

27.3

Rank #332 Confirmed

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • The widest gap is in math, where Step 3.7 Flash leads 42.9 to 9.3.
  • Step 3.7 Flash has downloadable open weights; the other is API-only.

Side by side

Gemini 1.0 Pro and Step 3.7 Flash specifications
Gemini 1.0 ProStep 3.7 Flash
ProviderGoogleStepFun
Noometry Index27.337.3
Released2023-12-132026-05-29
WeightsProprietaryOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.18
Output $ / M tokens—$1.11
Results tracked245

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.7 Flash leads

Gemini 1.0 Pro: 32.2 (#275), Step 3.7 Flash: 40.0 (#150)

Coding benchmarks
BenchmarkGemini 1.0 ProStep 3.7 Flash
SciCode—40%
LMArena Coding1108—
ALE-Bench—694.12
HumanEval+55.5%—
MBPP+61.4%—

Reasoning Step 3.7 Flash leads

Gemini 1.0 Pro: 17.1 (#296), Step 3.7 Flash: 21.6 (#219)

Reasoning benchmarks
BenchmarkGemini 1.0 ProStep 3.7 Flash
NYT Connections (extended)—39.7%
CritPt—2.3%
LMArena Hard Prompts1109—
DTBench45.9%—
Epoch Capabilities Index117.04—

Math Step 3.7 Flash leads

Gemini 1.0 Pro: 9.3 (#321), Step 3.7 Flash: 42.9 (#82)

Math benchmarks
BenchmarkGemini 1.0 ProStep 3.7 Flash
MathArena Final-Answer Competitions—68.5%
OTIS Mock AIME 2024-20251.1%—
LMArena Math1132—
MATH Level 511.2%—

Knowledge Not comparable

Gemini 1.0 Pro: 15.6 (#291), Step 3.7 Flash: —

Knowledge benchmarks
BenchmarkGemini 1.0 ProStep 3.7 Flash
GPQA Diamond34%—
LMArena Expert1059—
MMLU70%—

Multilingual Not comparable

Gemini 1.0 Pro: 33.4 (#252), Step 3.7 Flash: —

Multilingual benchmarks
BenchmarkGemini 1.0 ProStep 3.7 Flash
LMArena Non-English1138—
LMArena Chinese1124—
LMArena French1145—
LMArena German1125—
LMArena Japanese1023—
LMArena Russian1186—
LMArena Spanish1119—

Instruction Following Not comparable

Gemini 1.0 Pro: 57.6 (#267), Step 3.7 Flash: —

Instruction Following benchmarks
BenchmarkGemini 1.0 ProStep 3.7 Flash
LMArena Instruction Following1114—

Long Context Not comparable

Gemini 1.0 Pro: 34.3 (#249), Step 3.7 Flash: —

Long Context benchmarks
BenchmarkGemini 1.0 ProStep 3.7 Flash
LMArena Longer Query1132—

Writing & Preference Not comparable

Gemini 1.0 Pro: 36.0 (#264), Step 3.7 Flash: —

Writing & Preference benchmarks
BenchmarkGemini 1.0 ProStep 3.7 Flash
LMArena Text1149—
LMArena Creative Writing1131—
LMArena Multi-Turn1139—

Frequently asked questions

Is Gemini 1.0 Pro better than Step 3.7 Flash?

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 27.3 on the Noometry Index.

Is Gemini 1.0 Pro or Step 3.7 Flash better for coding?

Step 3.7 Flash scores higher on coding benchmarks: 40.0 versus 32.2 in the Noometry coding category.

How many benchmarks do Gemini 1.0 Pro and Step 3.7 Flash share?

0 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper