Model comparison

GLM-4.6 vs Yi-34B

GLM-4.6 is the stronger model overall, scoring 41.4 to 27.8 on the Noometry Index.

Last verified . 17 shared benchmarks.

GLM-4.6 Z.ai (Zhipu)

41.4

Rank #135 Confirmed

Yi-34B 01.AI

27.8

Rank #329 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GLM-4.6 scores higher in 8 categories and Yi-34B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-4.6 leads 40.2 to 7.5.

Side by side

GLM-4.6 and Yi-34B specifications
GLM-4.6Yi-34B
ProviderZ.ai (Zhipu)01.AI
Noometry Index41.427.8
Released2025-09-302023-11-02
WeightsOpenOpen
Context window205K—
Max output131K—
Input $ / M tokens$0.60—
Output $ / M tokens$2.20—
Results tracked2923

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.6 leads

GLM-4.6: 40.1 (#148), Yi-34B: 32.3 (#274)

Coding benchmarks
BenchmarkGLM-4.6Yi-34B
LMArena Coding14491112
SWE-bench Verified (bash only)55.4%—
LMArena WebDev1340—
SciCode38.4%—
ALE-Bench340.82—

Agentic & Tool Use Not comparable

GLM-4.6: 32.3 (#66), Yi-34B: —

Agentic & Tool Use benchmarks
BenchmarkGLM-4.6Yi-34B
Terminal-Bench24.5%—
Berkeley Function Calling Leaderboard72.4%—

Reasoning GLM-4.6 leads

GLM-4.6: 23.7 (#172), Yi-34B: 21.2 (#226)

Reasoning benchmarks
BenchmarkGLM-4.6Yi-34B
LMArena Hard Prompts14401104
Kagi LLM Benchmark47.4%—
CritPt1.1%—
BIG-Bench Hard—71.7%
Epoch Capabilities Index—117.39

Math GLM-4.6 leads

GLM-4.6: 39.1 (#111), Yi-34B: 21.6 (#282)

Math benchmarks
BenchmarkGLM-4.6Yi-34B
LMArena Math14321114
MATH Level 5—5.1%
FrontierMath (Feb 2025 set)3.8%—
FrontierMath Tier 4 (v1)2.1%—
GSM8K—76%

Knowledge GLM-4.6 leads

GLM-4.6: 40.2 (#124), Yi-34B: 7.5 (#309)

Knowledge benchmarks
BenchmarkGLM-4.6Yi-34B
LMArena Expert14311061
GPQA Diamond—14.7%
Vectara Hallucination Rate9.5%—
MMLU—76.3%

Multilingual GLM-4.6 leads

GLM-4.6: 53.5 (#66), Yi-34B: 29.7 (#264)

Multilingual benchmarks
BenchmarkGLM-4.6Yi-34B
LMArena Non-English14261079
LMArena Chinese14991176
LMArena French14591081
LMArena German14471042
LMArena Japanese1393993
LMArena Korean1400959
LMArena Russian14191050
LMArena Spanish14361070

Instruction Following GLM-4.6 leads

GLM-4.6: 74.3 (#98), Yi-34B: 56.2 (#274)

Instruction Following benchmarks
BenchmarkGLM-4.6Yi-34B
LMArena Instruction Following14101091

Long Context GLM-4.6 leads

GLM-4.6: 43.4 (#94), Yi-34B: 33.2 (#264)

Long Context benchmarks
BenchmarkGLM-4.6Yi-34B
LMArena Longer Query14221094

Writing & Preference GLM-4.6 leads

GLM-4.6: 61.1 (#90), Yi-34B: 34.1 (#273)

Writing & Preference benchmarks
BenchmarkGLM-4.6Yi-34B
LMArena Text14401129
LMArena Creative Writing14111108
LMArena Multi-Turn14271113
EQ-Bench Creative Writing1411—

Frequently asked questions

Is GLM-4.6 better than Yi-34B?

GLM-4.6 is the stronger model overall, scoring 41.4 to 27.8 on the Noometry Index.

Is GLM-4.6 or Yi-34B better for coding?

GLM-4.6 scores higher on coding benchmarks: 40.1 versus 32.3 in the Noometry coding category.

How many benchmarks do GLM-4.6 and Yi-34B share?

17 benchmarks have published results for both models. GLM-4.6 has 29 scored results on Noometry and Yi-34B has 23.

Related comparisons

Go deeper