Model comparison

Gemma 3 27B vs Step 3.7 Flash

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 30.8 on the Noometry Index. Gemma 3 27B costs 4.2× less per token, which makes it the better buy when Step 3.7 Flash's lead doesn't matter for your workload.

Last verified . 2 shared benchmarks.

Gemma 3 27B Google

30.8

Rank #284 Confirmed

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • They share 2 benchmarks with published results for both. Gemma 3 27B scores higher in 0 categories and Step 3.7 Flash in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Step 3.7 Flash leads 40.0 to 22.5.
  • The biggest single-benchmark swing is SciCode: 21.2% for Gemma 3 27B and 40% for Step 3.7 Flash.
  • Gemma 3 27B is cheaper at $0.08 / $0.16 per million input/output tokens, against $0.18 / $1.11 for Step 3.7 Flash.
  • Step 3.7 Flash accepts more context: 256K tokens versus 131K.

Side by side

Gemma 3 27B and Step 3.7 Flash specifications
Gemma 3 27BStep 3.7 Flash
ProviderGoogleStepFun
Noometry Index30.837.3
Released2025-03-112026-05-29
WeightsOpenOpen
Context window131K256K
Max output8K256K
Input $ / M tokens$0.08$0.18
Output $ / M tokens$0.16$1.11
Results tracked435

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.7 Flash leads

Gemma 3 27B: 22.5 (#334), Step 3.7 Flash: 40.0 (#150)

Coding benchmarks
BenchmarkGemma 3 27BStep 3.7 Flash
SciCode21.2%40%
Aider Polyglot4.9%—
LiveBench Coding39.9%—
LMArena Coding1322—
ALE-Bench—694.12

Agentic & Tool Use Not comparable

Gemma 3 27B: 25.1 (#110), Step 3.7 Flash: —

Agentic & Tool Use benchmarks
BenchmarkGemma 3 27BStep 3.7 Flash
Berkeley Function Calling Leaderboard29.5%—

Reasoning Step 3.7 Flash leads

Gemma 3 27B: 16.7 (#301), Step 3.7 Flash: 21.6 (#219)

Reasoning benchmarks
BenchmarkGemma 3 27BStep 3.7 Flash
CritPt0%2.3%
Kagi LLM Benchmark40.4%—
NYT Connections (extended)—39.7%
Chess Puzzles0%—
LiveBench Reasoning43.8%—
LMArena Hard Prompts1340—
DTBench52.5%—
LiveBench Data Analysis51.5%—
LMCA12.3%—
Epoch Capabilities Index130.04—
LiveBench50%—

Math Step 3.7 Flash leads

Gemma 3 27B: 25.9 (#265), Step 3.7 Flash: 42.9 (#82)

Math benchmarks
BenchmarkGemma 3 27BStep 3.7 Flash
MathArena Final-Answer Competitions—68.5%
OTIS Mock AIME 2024-202522.5%—
LiveBench Math55.4%—
LMArena Math1312—
MATH Level 574%—

Knowledge Not comparable

Gemma 3 27B: 25.5 (#261), Step 3.7 Flash: —

Knowledge benchmarks
BenchmarkGemma 3 27BStep 3.7 Flash
GPQA Diamond47.7%—
Confabulations40.3%—
Vectara Hallucination Rate7.4%—
LMArena Expert1304—

Multimodal Not comparable

Gemma 3 27B: 32.6 (#100), Step 3.7 Flash: —

Multimodal benchmarks
BenchmarkGemma 3 27BStep 3.7 Flash
LMArena Vision1164—
GeoBench52%—

Multilingual Not comparable

Gemma 3 27B: 46.9 (#155), Step 3.7 Flash: —

Multilingual benchmarks
BenchmarkGemma 3 27BStep 3.7 Flash
LMArena Non-English1334—
LMArena Chinese1346—
LMArena French1368—
LMArena German1362—
LMArena Japanese1287—
LMArena Korean1308—
LMArena Russian1349—
LMArena Spanish1349—

Instruction Following Not comparable

Gemma 3 27B: 70.6 (#160), Step 3.7 Flash: —

Instruction Following benchmarks
BenchmarkGemma 3 27BStep 3.7 Flash
LiveBench Instruction Following74.9%—
LMArena Instruction Following1321—

Long Context Not comparable

Gemma 3 27B: 27.6 (#293), Step 3.7 Flash: —

Long Context benchmarks
BenchmarkGemma 3 27BStep 3.7 Flash
Fiction.LiveBench33.3%—
LMArena Longer Query1333—

Writing & Preference Not comparable

Gemma 3 27B: 52.5 (#168), Step 3.7 Flash: —

Writing & Preference benchmarks
BenchmarkGemma 3 27BStep 3.7 Flash
LMArena Text1358—
LMArena Creative Writing1346—
Short-Story Creative Writing79.9%—
EQ-Bench Creative Writing1266—
LMArena Multi-Turn1345—
LiveBench Language34.6%—

Frequently asked questions

Is Gemma 3 27B better than Step 3.7 Flash?

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 30.8 on the Noometry Index. Gemma 3 27B costs 4.2× less per token, which makes it the better buy when Step 3.7 Flash's lead doesn't matter for your workload.

Which is cheaper, Gemma 3 27B or Step 3.7 Flash?

Gemma 3 27B is cheaper. It lists at $0.08 per million input tokens and $0.16 per million output tokens; Step 3.7 Flash lists at $0.18 and $1.11.

Is Gemma 3 27B or Step 3.7 Flash better for coding?

Step 3.7 Flash scores higher on coding benchmarks: 40.0 versus 22.5 in the Noometry coding category.

Which has the bigger context window?

Step 3.7 Flash does, with 256K tokens against 131K.

How many benchmarks do Gemma 3 27B and Step 3.7 Flash share?

2 benchmarks have published results for both models. Gemma 3 27B has 43 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper