Model comparison

GLM-4.6 vs Qwen3-1.7B

GLM-4.6 is the stronger model overall, scoring 40.9 to 26.2 on the Noometry Index.

Last verified . 1 shared benchmarks.

GLM-4.6 Z.ai (Zhipu)

40.9

Rank #132 Confirmed

Qwen3-1.7B Alibaba (Qwen)

26.2

Rank #331 Reported

Summary

  • They share 1 benchmark with published results for both. GLM-4.6 scores higher in 4 categories and Qwen3-1.7B in 0 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where GLM-4.6 leads 36.4 to 15.4.
  • The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 72.4% for GLM-4.6 and 28.4% for Qwen3-1.7B.

Side by side

GLM-4.6 and Qwen3-1.7B specifications
GLM-4.6Qwen3-1.7B
ProviderZ.ai (Zhipu)Alibaba (Qwen)
Noometry Index40.926.2
Released2025-09-302025-04-29
WeightsOpenOpen
Context window205K—
Max output131K—
Input $ / M tokens$0.60—
Output $ / M tokens$2.20—
Results tracked294

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

GLM-4.6: 39.9 (#137), Qwen3-1.7B: —

Coding benchmarks
BenchmarkGLM-4.6Qwen3-1.7B
SWE-bench Verified (bash only)55.4%—
LMArena WebDev1339—
SciCode38.4%—
LMArena Coding1449—
ALE-Bench340.82—

Agentic & Tool Use GLM-4.6 leads

GLM-4.6: 32.1 (#60), Qwen3-1.7B: 24.5 (#108)

Agentic & Tool Use benchmarks
BenchmarkGLM-4.6Qwen3-1.7B
Berkeley Function Calling Leaderboard72.4%28.4%
Terminal-Bench24.5%—

Reasoning GLM-4.6 leads

GLM-4.6: 23.1 (#168), Qwen3-1.7B: 18.5 (#263)

Reasoning benchmarks
BenchmarkGLM-4.6Qwen3-1.7B
Kagi LLM Benchmark47.4%—
CritPt1.1%—
Chess Puzzles—0%
LMArena Hard Prompts1440—

Math GLM-4.6 leads

GLM-4.6: 36.4 (#115), Qwen3-1.7B: 15.4 (#288)

Math benchmarks
BenchmarkGLM-4.6Qwen3-1.7B
OTIS Mock AIME 2024-2025—8.1%
LMArena Math1431—
FrontierMath (Feb 2025 set)3.8%—
FrontierMath Tier 4 (v1)2.1%—

Knowledge GLM-4.6 leads

GLM-4.6: 39.6 (#118), Qwen3-1.7B: 19.6 (#273)

Knowledge benchmarks
BenchmarkGLM-4.6Qwen3-1.7B
GPQA Diamond—38%
Vectara Hallucination Rate9.5%—
LMArena Expert1432—

Multilingual Not comparable

GLM-4.6: 53.6 (#62), Qwen3-1.7B: —

Multilingual benchmarks
BenchmarkGLM-4.6Qwen3-1.7B
LMArena Non-English1426—
LMArena Chinese1500—
LMArena French1459—
LMArena German1447—
LMArena Japanese1394—
LMArena Korean1401—
LMArena Russian1418—
LMArena Spanish1436—

Instruction Following Not comparable

GLM-4.6: 74.5 (#93), Qwen3-1.7B: —

Instruction Following benchmarks
BenchmarkGLM-4.6Qwen3-1.7B
LMArena Instruction Following1410—

Long Context Not comparable

GLM-4.6: 43.4 (#91), Qwen3-1.7B: —

Long Context benchmarks
BenchmarkGLM-4.6Qwen3-1.7B
LMArena Longer Query1423—

Writing & Preference Not comparable

GLM-4.6: 61.3 (#86), Qwen3-1.7B: —

Writing & Preference benchmarks
BenchmarkGLM-4.6Qwen3-1.7B
LMArena Text1440—
LMArena Creative Writing1411—
EQ-Bench Creative Writing1411—
LMArena Multi-Turn1427—

Frequently asked questions

Is GLM-4.6 better than Qwen3-1.7B?

GLM-4.6 is the stronger model overall, scoring 40.9 to 26.2 on the Noometry Index.

How many benchmarks do GLM-4.6 and Qwen3-1.7B share?

1 benchmark has published results for both models. GLM-4.6 has 29 scored results on Noometry and Qwen3-1.7B has 4.

Related comparisons

Go deeper