Model comparison

GLM-5.2 vs Phi 3 Medium 4k Instruct

GLM-5.2 is the stronger model overall, scoring 51.1 to 33.0 on the Noometry Index.

Last verified . 17 shared benchmarks.

GLM-5.2 Z.ai (Zhipu)

51.1

Rank #44 Confirmed

Phi 3 Medium 4k Instruct Microsoft

33.0

Rank #250 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GLM-5.2 scores higher in 8 categories and Phi 3 Medium 4k Instruct in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GLM-5.2 leads 70.4 to 34.1.

Side by side

GLM-5.2 and Phi 3 Medium 4k Instruct specifications
GLM-5.2Phi 3 Medium 4k Instruct
ProviderZ.ai (Zhipu)Microsoft
Noometry Index51.133.0
Released2026-06-13—
WeightsOpenOpen
Context window1M—
Max output131K—
Input $ / M tokens$1.40—
Output $ / M tokens$4.40—
Results tracked5117

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5.2 leads

GLM-5.2: 51.3 (#41), Phi 3 Medium 4k Instruct: 32.9 (#268)

Coding benchmarks
BenchmarkGLM-5.2Phi 3 Medium 4k Instruct
LMArena Coding14851130
SWE-bench Verified78.7%—
DeepSWE43.8%—
FrontierCode24.5%—
LMArena WebDev1603—
SciCode50.5%—
WeirdML70.1%—
ALE-Bench1,047—

Agentic & Tool Use Not comparable

GLM-5.2: 32.4 (#63), Phi 3 Medium 4k Instruct: —

Agentic & Tool Use benchmarks
BenchmarkGLM-5.2Phi 3 Medium 4k Instruct
APEX-Agents45.2%—
τ²-bench Banking37.1%—
PostTrainBench31.7%—
GBAEval0%—
Vending-Bench 28,314—

Reasoning GLM-5.2 leads

GLM-5.2: 42.3 (#52), Phi 3 Medium 4k Instruct: 21.7 (#214)

Reasoning benchmarks
BenchmarkGLM-5.2Phi 3 Medium 4k Instruct
LMArena Hard Prompts14801127
ARC-AGI-222.8%—
SimpleBench58.8%—
Kagi LLM Benchmark62.6%—
NYT Connections (extended)74.3%—
ARC-AGI-177%—
CritPt20.9%—
Chess Puzzles21%—
EBR-Bench9.5%—
Mystery Game Puzzles19%—
DTBench93.6%—
LMCA45.8%—
Surface Evolver Bench55.6%—
Epoch Capabilities Index151.78—

Math GLM-5.2 leads

GLM-5.2: 55.7 (#43), Phi 3 Medium 4k Instruct: 33.4 (#202)

Math benchmarks
BenchmarkGLM-5.2Phi 3 Medium 4k Instruct
LMArena Math14821173
FrontierMath (Tiers 1-3)59.2%—
FrontierMath Tier 429.3%—
MathArena Final-Answer Competitions67.6%—
OTIS Mock AIME 2024-202586.4%—
ProofBench35%—

Knowledge GLM-5.2 leads

GLM-5.2: 57.1 (#40), Phi 3 Medium 4k Instruct: 30.2 (#229)

Knowledge benchmarks
BenchmarkGLM-5.2Phi 3 Medium 4k Instruct
LMArena Expert14861108
GPQA Diamond91.9%—
SimpleQA Verified34.2%—

Multilingual GLM-5.2 leads

GLM-5.2: 55.8 (#26), Phi 3 Medium 4k Instruct: 30.6 (#263)

Multilingual benchmarks
BenchmarkGLM-5.2Phi 3 Medium 4k Instruct
LMArena Non-English14591094
LMArena Chinese15191108
LMArena French14791110
LMArena German14681101
LMArena Japanese14511042
LMArena Korean1445954
LMArena Russian14661145
LMArena Spanish14771095

Instruction Following GLM-5.2 leads

GLM-5.2: 76.9 (#34), Phi 3 Medium 4k Instruct: 57.6 (#268)

Instruction Following benchmarks
BenchmarkGLM-5.2Phi 3 Medium 4k Instruct
LMArena Instruction Following14651113

Long Context GLM-5.2 leads

GLM-5.2: 45.3 (#43), Phi 3 Medium 4k Instruct: 34.0 (#255)

Long Context benchmarks
BenchmarkGLM-5.2Phi 3 Medium 4k Instruct
LMArena Longer Query14791120

Writing & Preference GLM-5.2 leads

GLM-5.2: 70.4 (#21), Phi 3 Medium 4k Instruct: 34.1 (#272)

Writing & Preference benchmarks
BenchmarkGLM-5.2Phi 3 Medium 4k Instruct
LMArena Text14701138
LMArena Creative Writing14621107
LMArena Multi-Turn14691088
EQ-Bench Creative Writing1757—
EQ-Bench 41222—

Frequently asked questions

Is GLM-5.2 better than Phi 3 Medium 4k Instruct?

GLM-5.2 is the stronger model overall, scoring 51.1 to 33.0 on the Noometry Index.

Is GLM-5.2 or Phi 3 Medium 4k Instruct better for coding?

GLM-5.2 scores higher on coding benchmarks: 51.3 versus 32.9 in the Noometry coding category.

How many benchmarks do GLM-5.2 and Phi 3 Medium 4k Instruct share?

17 benchmarks have published results for both models. GLM-5.2 has 51 scored results on Noometry and Phi 3 Medium 4k Instruct has 17.

Related comparisons

Go deeper