Noometry

Model comparison

GLM-4.6 vs Step 3.5 Flash

GLM-4.6 and Step 3.5 Flash score almost the same on the Noometry Index (41.4 vs 42.3), so choose on price, context window or the category you care about most.

Last verified . 17 shared benchmarks.

GLM-4.6 Z.ai (Zhipu)

41.4

Rank #135 Confirmed

Step 3.5 Flash StepFun

42.3

Rank #116 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GLM-4.6 scores higher in 6 categories and Step 3.5 Flash in 2 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in math, where Step 3.5 Flash leads 42.6 to 39.1.
  • Step 3.5 Flash is cheaper at $0.10 / $0.30 per million input/output tokens, against $0.60 / $2.20 for GLM-4.6.
  • Step 3.5 Flash accepts more context: 256K tokens versus 205K.

Side by side

GLM-4.6Step 3.5 Flash
ProviderZ.ai (Zhipu)StepFun
Noometry Index41.442.3
Released2025-09-302026-01-29
WeightsOpenOpen
Context window205K256K
Max output131K256K
Input $ / M tokens$0.60$0.10
Output $ / M tokens$2.20$0.30
Results tracked2919

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.5 Flash leads

GLM-4.6: 40.1 (#148), Step 3.5 Flash: 42.4 (#105)

BenchmarkGLM-4.6Step 3.5 Flash
LMArena Coding14491436
SWE-bench Verified (bash only)55.4%—
LMArena WebDev1340—
SciCode38.4%—
ALE-Bench340.82—

Agentic & Tool Use Not comparable

GLM-4.6: 32.3 (#66), Step 3.5 Flash: —

BenchmarkGLM-4.6Step 3.5 Flash
Terminal-Bench24.5%—
Berkeley Function Calling Leaderboard72.4%—

Reasoning GLM-4.6 leads

GLM-4.6: 23.7 (#172), Step 3.5 Flash: 22.2 (#202)

BenchmarkGLM-4.6Step 3.5 Flash
LMArena Hard Prompts14401411
Kagi LLM Benchmark47.4%—
NYT Connections (extended)—28.4%
CritPt1.1%—

Math Step 3.5 Flash leads

GLM-4.6: 39.1 (#111), Step 3.5 Flash: 42.6 (#84)

BenchmarkGLM-4.6Step 3.5 Flash
LMArena Math14321408
MathArena Final-Answer Competitions—66.8%
FrontierMath (Feb 2025 set)3.8%—
FrontierMath Tier 4 (v1)2.1%—

Knowledge Too close to call

GLM-4.6: 40.2 (#124), Step 3.5 Flash: 39.6 (#132)

BenchmarkGLM-4.6Step 3.5 Flash
LMArena Expert14311421
Vectara Hallucination Rate9.5%—

Multilingual GLM-4.6 leads

GLM-4.6: 53.5 (#66), Step 3.5 Flash: 50.5 (#119)

BenchmarkGLM-4.6Step 3.5 Flash
LMArena Non-English14261385
LMArena Chinese14991447
LMArena French14591421
LMArena German14471405
LMArena Japanese13931354
LMArena Korean14001352
LMArena Russian14191385
LMArena Spanish14361419

Instruction Following GLM-4.6 leads

GLM-4.6: 74.3 (#98), Step 3.5 Flash: 73.1 (#124)

BenchmarkGLM-4.6Step 3.5 Flash
LMArena Instruction Following14101385

Long Context Too close to call

GLM-4.6: 43.4 (#94), Step 3.5 Flash: 42.8 (#117)

BenchmarkGLM-4.6Step 3.5 Flash
LMArena Longer Query14221402

Writing & Preference GLM-4.6 leads

GLM-4.6: 61.1 (#90), Step 3.5 Flash: 58.8 (#113)

BenchmarkGLM-4.6Step 3.5 Flash
LMArena Text14401403
LMArena Creative Writing14111357
LMArena Multi-Turn14271405
EQ-Bench Creative Writing1411—

Frequently asked questions

Is GLM-4.6 better than Step 3.5 Flash?

GLM-4.6 and Step 3.5 Flash score almost the same on the Noometry Index (41.4 vs 42.3), so choose on price, context window or the category you care about most.

Which is cheaper, GLM-4.6 or Step 3.5 Flash?

Step 3.5 Flash is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; GLM-4.6 lists at $0.60 and $2.20.

Is GLM-4.6 or Step 3.5 Flash better for coding?

Step 3.5 Flash scores higher on coding benchmarks: 42.4 versus 40.1 in the Noometry coding category.

Which has the bigger context window?

Step 3.5 Flash does, with 256K tokens against 205K.

How many benchmarks do GLM-4.6 and Step 3.5 Flash share?

17 benchmarks have published results for both models. GLM-4.6 has 29 scored results on Noometry and Step 3.5 Flash has 19.

Related comparisons

Go deeper