Noometry

Model comparison

GLM-4.7 vs Step 3.5 Flash

GLM-4.7 and Step 3.5 Flash score almost the same on the Noometry Index (42.0 vs 42.3), so choose on price, context window or the category you care about most.

Last verified . 17 shared benchmarks.

GLM-4.7 Z.ai (Zhipu)

42.0

Rank #124 Confirmed

Step 3.5 Flash StepFun

42.3

Rank #116 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GLM-4.7 scores higher in 6 categories and Step 3.5 Flash in 2 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-4.7 leads 47.0 to 39.6.
  • Step 3.5 Flash is cheaper at $0.10 / $0.30 per million input/output tokens, against $0.60 / $2.20 for GLM-4.7.
  • Step 3.5 Flash accepts more context: 256K tokens versus 205K.

Side by side

GLM-4.7Step 3.5 Flash
ProviderZ.ai (Zhipu)StepFun
Noometry Index42.042.3
Released2025-12-222026-01-29
WeightsOpenOpen
Context window205K256K
Max output131K256K
Input $ / M tokens$0.60$0.10
Output $ / M tokens$2.20$0.30
Results tracked3619

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.7 leads

GLM-4.7: 44.0 (#79), Step 3.5 Flash: 42.4 (#105)

BenchmarkGLM-4.7Step 3.5 Flash
LMArena Coding14541436
LMArena WebDev1435—
SciCode45.1%—
ALE-Bench399.48—

Agentic & Tool Use Not comparable

GLM-4.7: 26.5 (#103), Step 3.5 Flash: —

BenchmarkGLM-4.7Step 3.5 Flash
Terminal-Bench33.4%—
Vending-Bench 22,377—

Reasoning GLM-4.7 leads

GLM-4.7: 24.3 (#164), Step 3.5 Flash: 22.2 (#202)

BenchmarkGLM-4.7Step 3.5 Flash
LMArena Hard Prompts14431411
SimpleBench47.7%—
NYT Connections (extended)—28.4%
CritPt1.7%—
Chess Puzzles6%—
Epoch Capabilities Index143.51—

Math Step 3.5 Flash leads

GLM-4.7: 38.6 (#135), Step 3.5 Flash: 42.6 (#84)

BenchmarkGLM-4.7Step 3.5 Flash
LMArena Math14231408
MathArena Final-Answer Competitions—66.8%
OTIS Mock AIME 2024-202583.3%—
ProofBench6%—
FrontierMath (Feb 2025 set)2.4%—
FrontierMath Tier 4 (v1)0%—

Knowledge GLM-4.7 leads

GLM-4.7: 47.0 (#80), Step 3.5 Flash: 39.6 (#132)

BenchmarkGLM-4.7Step 3.5 Flash
LMArena Expert14241421
GPQA Diamond83.3%—
SimpleQA Verified32.2%—
Vectara Hallucination Rate11.7%—

Multilingual GLM-4.7 leads

GLM-4.7: 52.8 (#79), Step 3.5 Flash: 50.5 (#119)

BenchmarkGLM-4.7Step 3.5 Flash
LMArena Non-English14171385
LMArena Chinese14951447
LMArena French14321421
LMArena German14241405
LMArena Japanese14391354
LMArena Korean13991352
LMArena Russian14231385
LMArena Spanish14341419

Instruction Following GLM-4.7 leads

GLM-4.7: 74.4 (#95), Step 3.5 Flash: 73.1 (#124)

BenchmarkGLM-4.7Step 3.5 Flash
LMArena Instruction Following14111385

Long Context Too close to call

GLM-4.7: 42.8 (#116), Step 3.5 Flash: 42.8 (#117)

BenchmarkGLM-4.7Step 3.5 Flash
LMArena Longer Query14321402
CL-bench15.9%—
CL-bench Life10.9%—

Writing & Preference GLM-4.7 leads

GLM-4.7: 60.9 (#93), Step 3.5 Flash: 58.8 (#113)

BenchmarkGLM-4.7Step 3.5 Flash
LMArena Text14351403
LMArena Creative Writing14011357
LMArena Multi-Turn14461405
EQ-Bench Creative Writing1413—

Frequently asked questions

Is GLM-4.7 better than Step 3.5 Flash?

GLM-4.7 and Step 3.5 Flash score almost the same on the Noometry Index (42.0 vs 42.3), so choose on price, context window or the category you care about most.

Which is cheaper, GLM-4.7 or Step 3.5 Flash?

Step 3.5 Flash is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; GLM-4.7 lists at $0.60 and $2.20.

Is GLM-4.7 or Step 3.5 Flash better for coding?

GLM-4.7 scores higher on coding benchmarks: 44.0 versus 42.4 in the Noometry coding category.

Which has the bigger context window?

Step 3.5 Flash does, with 256K tokens against 205K.

How many benchmarks do GLM-4.7 and Step 3.5 Flash share?

17 benchmarks have published results for both models. GLM-4.7 has 36 scored results on Noometry and Step 3.5 Flash has 19.

Related comparisons

Go deeper