Model comparison

GLM-4.5V vs phi-3-medium 14B

GLM-4.5V is the stronger model overall, scoring 39.8 to 29.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

GLM-4.5V Z.ai (Zhipu)

39.8

Rank #158 Confirmed

phi-3-medium 14B Microsoft

29.7

Rank #306 Reported

Summary

  • The widest gap is in knowledge, where GLM-4.5V leads 37.5 to 9.1.

Side by side

GLM-4.5V and phi-3-medium 14B specifications
GLM-4.5Vphi-3-medium 14B
ProviderZ.ai (Zhipu)Microsoft
Noometry Index39.829.7
Released2025-08-112024-04-23
WeightsOpenOpen
Context window64K—
Max output16K—
Input $ / M tokens$0.60—
Output $ / M tokens$1.80—
Results tracked1513

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.5V leads

GLM-4.5V: 39.5 (#155), phi-3-medium 14B: 36.8 (#201)

Coding benchmarks
BenchmarkGLM-4.5Vphi-3-medium 14B
BigCodeBench Instruct—37.6%
LMArena Coding1347—
BigCodeBench Complete—48.7%

Reasoning Not comparable

GLM-4.5V: 27.4 (#119), phi-3-medium 14B: —

Reasoning benchmarks
BenchmarkGLM-4.5Vphi-3-medium 14B
Kagi LLM Benchmark59.8%—
LMArena Hard Prompts1334—
Adversarial NLI—55.8%
BIG-Bench Hard—81.4%
Epoch Capabilities Index—121.23
HellaSwag—82.4%
WinoGrande—81.5%

Math GLM-4.5V leads

GLM-4.5V: 37.4 (#159), phi-3-medium 14B: 27.3 (#250)

Math benchmarks
BenchmarkGLM-4.5Vphi-3-medium 14B
LMArena Math1354—
MATH Level 5—17.6%

Knowledge GLM-4.5V leads

GLM-4.5V: 37.5 (#156), phi-3-medium 14B: 9.1 (#306)

Knowledge benchmarks
BenchmarkGLM-4.5Vphi-3-medium 14B
GPQA Diamond—27.6%
LMArena Expert1353—
ARC (AI2) Challenge—91.6%
MMLU—78%
OpenBookQA—87.4%
TriviaQA—73.9%

Multimodal Not comparable

GLM-4.5V: 34.3 (#92), phi-3-medium 14B: —

Multimodal benchmarks
BenchmarkGLM-4.5Vphi-3-medium 14B
LMArena Vision1154—

Multilingual Not comparable

GLM-4.5V: 44.6 (#177), phi-3-medium 14B: —

Multilingual benchmarks
BenchmarkGLM-4.5Vphi-3-medium 14B
LMArena Non-English1303—
LMArena Chinese1337—
LMArena Russian1298—
LMArena Spanish1336—

Instruction Following Not comparable

GLM-4.5V: 69.2 (#175), phi-3-medium 14B: —

Instruction Following benchmarks
BenchmarkGLM-4.5Vphi-3-medium 14B
LMArena Instruction Following1311—

Long Context Not comparable

GLM-4.5V: 39.6 (#171), phi-3-medium 14B: —

Long Context benchmarks
BenchmarkGLM-4.5Vphi-3-medium 14B
LMArena Longer Query1304—

Writing & Preference Not comparable

GLM-4.5V: 52.5 (#170), phi-3-medium 14B: —

Writing & Preference benchmarks
BenchmarkGLM-4.5Vphi-3-medium 14B
LMArena Text1333—
LMArena Creative Writing1295—
LMArena Multi-Turn1332—

Frequently asked questions

Is GLM-4.5V better than phi-3-medium 14B?

GLM-4.5V is the stronger model overall, scoring 39.8 to 29.7 on the Noometry Index.

Is GLM-4.5V or phi-3-medium 14B better for coding?

GLM-4.5V scores higher on coding benchmarks: 39.5 versus 36.8 in the Noometry coding category.

How many benchmarks do GLM-4.5V and phi-3-medium 14B share?

0 benchmarks have published results for both models. GLM-4.5V has 15 scored results on Noometry and phi-3-medium 14B has 13.

Related comparisons

Go deeper