Model comparison

GLM-4.6V vs Step 2 16k Exp 202412

GLM-4.6V is the stronger model overall, scoring 40.9 to 38.6 on the Noometry Index.

Last verified . 11 shared benchmarks.

GLM-4.6V Z.ai (Zhipu)

40.9

Rank #133 Confirmed

Step 2 16k Exp 202412 StepFun

38.6

Rank #173 Confirmed

Summary

  • They share 11 benchmarks with published results for both. GLM-4.6V scores higher in 7 categories and Step 2 16k Exp 202412 in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where GLM-4.6V leads 48.8 to 43.9.
  • GLM-4.6V has downloadable open weights; the other is API-only.

Side by side

GLM-4.6V and Step 2 16k Exp 202412 specifications
GLM-4.6VStep 2 16k Exp 202412
ProviderZ.ai (Zhipu)StepFun
Noometry Index40.938.6
Released2025-12-08—
WeightsOpenProprietary
Context window128K—
Max output33K—
Input $ / M tokens$0.30—
Output $ / M tokens$0.90—
Results tracked1212

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.6V leads

GLM-4.6V: 40.2 (#128), Step 2 16k Exp 202412: 37.9 (#170)

Coding benchmarks
BenchmarkGLM-4.6VStep 2 16k Exp 202412
LMArena Coding13901316

Reasoning GLM-4.6V leads

GLM-4.6V: 26.5 (#117), Step 2 16k Exp 202412: 24.8 (#140)

Reasoning benchmarks
BenchmarkGLM-4.6VStep 2 16k Exp 202412
LMArena Hard Prompts13681299

Math Not comparable

GLM-4.6V: —, Step 2 16k Exp 202412: 33.6 (#171)

Math benchmarks
BenchmarkGLM-4.6VStep 2 16k Exp 202412
LMArena Math—1305

Knowledge GLM-4.6V leads

GLM-4.6V: 37.4 (#148), Step 2 16k Exp 202412: 34.6 (#187)

Knowledge benchmarks
BenchmarkGLM-4.6VStep 2 16k Exp 202412
LMArena Expert13721279

Multimodal Not comparable

GLM-4.6V: 34.2 (#83), Step 2 16k Exp 202412: —

Multimodal benchmarks
BenchmarkGLM-4.6VStep 2 16k Exp 202412
LMArena Vision1164—

Multilingual GLM-4.6V leads

GLM-4.6V: 48.8 (#135), Step 2 16k Exp 202412: 43.9 (#176)

Multilingual benchmarks
BenchmarkGLM-4.6VStep 2 16k Exp 202412
LMArena Non-English13591290
LMArena Chinese14261331
LMArena Russian13411324

Instruction Following GLM-4.6V leads

GLM-4.6V: 71.6 (#145), Step 2 16k Exp 202412: 68.1 (#187)

Instruction Following benchmarks
BenchmarkGLM-4.6VStep 2 16k Exp 202412
LMArena Instruction Following13511287

Long Context GLM-4.6V leads

GLM-4.6V: 41.3 (#138), Step 2 16k Exp 202412: 39.7 (#165)

Long Context benchmarks
BenchmarkGLM-4.6VStep 2 16k Exp 202412
LMArena Longer Query13581307

Writing & Preference GLM-4.6V leads

GLM-4.6V: 56.8 (#132), Step 2 16k Exp 202412: 52.5 (#168)

Writing & Preference benchmarks
BenchmarkGLM-4.6VStep 2 16k Exp 202412
LMArena Text13771321
LMArena Creative Writing13471328
LMArena Multi-Turn13591292

Frequently asked questions

Is GLM-4.6V better than Step 2 16k Exp 202412?

GLM-4.6V is the stronger model overall, scoring 40.9 to 38.6 on the Noometry Index.

Is GLM-4.6V or Step 2 16k Exp 202412 better for coding?

GLM-4.6V scores higher on coding benchmarks: 40.2 versus 37.9 in the Noometry coding category.

How many benchmarks do GLM-4.6V and Step 2 16k Exp 202412 share?

11 benchmarks have published results for both models. GLM-4.6V has 12 scored results on Noometry and Step 2 16k Exp 202412 has 12.

Related comparisons

Go deeper