Model comparison

Gemma 3 1B vs Step 3.5 Flash

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 21.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 3 1B Google

21.1

Rank #353 Reported

Step 3.5 Flash StepFun

42.3

Rank #116 Confirmed

Summary

  • The widest gap is in knowledge, where Step 3.5 Flash leads 39.6 to 7.0.

Side by side

Gemma 3 1B and Step 3.5 Flash specifications
Gemma 3 1BStep 3.5 Flash
ProviderGoogleStepFun
Noometry Index21.142.3
Released2025-03-122026-01-29
WeightsOpenOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.30
Results tracked419

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Step 3.5 Flash: 42.4 (#105)

Coding benchmarks
BenchmarkGemma 3 1BStep 3.5 Flash
LMArena Coding—1436

Agentic & Tool Use Not comparable

Gemma 3 1B: 13.7 (#152), Step 3.5 Flash: —

Agentic & Tool Use benchmarks
BenchmarkGemma 3 1BStep 3.5 Flash
Berkeley Function Calling Leaderboard7.2%—

Reasoning Step 3.5 Flash leads

Gemma 3 1B: 19.2 (#264), Step 3.5 Flash: 22.2 (#202)

Reasoning benchmarks
BenchmarkGemma 3 1BStep 3.5 Flash
NYT Connections (extended)—28.4%
Chess Puzzles0%—
LMArena Hard Prompts—1411

Math Step 3.5 Flash leads

Gemma 3 1B: 10.2 (#316), Step 3.5 Flash: 42.6 (#84)

Math benchmarks
BenchmarkGemma 3 1BStep 3.5 Flash
MathArena Final-Answer Competitions—66.8%
OTIS Mock AIME 2024-20251.1%—
LMArena Math—1408

Knowledge Step 3.5 Flash leads

Gemma 3 1B: 7.0 (#314), Step 3.5 Flash: 39.6 (#132)

Knowledge benchmarks
BenchmarkGemma 3 1BStep 3.5 Flash
GPQA Diamond19.9%—
LMArena Expert—1421

Multilingual Not comparable

Gemma 3 1B: —, Step 3.5 Flash: 50.5 (#119)

Multilingual benchmarks
BenchmarkGemma 3 1BStep 3.5 Flash
LMArena Non-English—1385
LMArena Chinese—1447
LMArena French—1421
LMArena German—1405
LMArena Japanese—1354
LMArena Korean—1352
LMArena Russian—1385
LMArena Spanish—1419

Instruction Following Not comparable

Gemma 3 1B: —, Step 3.5 Flash: 73.1 (#124)

Instruction Following benchmarks
BenchmarkGemma 3 1BStep 3.5 Flash
LMArena Instruction Following—1385

Long Context Not comparable

Gemma 3 1B: —, Step 3.5 Flash: 42.8 (#117)

Long Context benchmarks
BenchmarkGemma 3 1BStep 3.5 Flash
LMArena Longer Query—1402

Writing & Preference Not comparable

Gemma 3 1B: —, Step 3.5 Flash: 58.8 (#113)

Writing & Preference benchmarks
BenchmarkGemma 3 1BStep 3.5 Flash
LMArena Text—1403
LMArena Creative Writing—1357
LMArena Multi-Turn—1405

Frequently asked questions

Is Gemma 3 1B better than Step 3.5 Flash?

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 21.1 on the Noometry Index.

How many benchmarks do Gemma 3 1B and Step 3.5 Flash share?

0 benchmarks have published results for both models. Gemma 3 1B has 4 scored results on Noometry and Step 3.5 Flash has 19.

Related comparisons

Go deeper