Model comparison

GLM-4.5V vs Phi 3 Mini 4k Instruct June 2024

GLM-4.5V is the stronger model overall, scoring 39.8 to 31.3 on the Noometry Index.

Last verified . 12 shared benchmarks.

GLM-4.5V Z.ai (Zhipu)

39.8

Rank #158 Confirmed

Summary

  • They share 12 benchmarks with published results for both. GLM-4.5V scores higher in 8 categories and Phi 3 Mini 4k Instruct June 2024 in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GLM-4.5V leads 52.5 to 29.6.

Side by side

GLM-4.5V and Phi 3 Mini 4k Instruct June 2024 specifications
GLM-4.5VPhi 3 Mini 4k Instruct June 2024
ProviderZ.ai (Zhipu)Microsoft
Noometry Index39.831.3
Released2025-08-11—
WeightsOpenOpen
Context window64K—
Max output16K—
Input $ / M tokens$0.60—
Output $ / M tokens$1.80—
Results tracked1515

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.5V leads

GLM-4.5V: 39.5 (#155), Phi 3 Mini 4k Instruct June 2024: 31.8 (#279)

Coding benchmarks
BenchmarkGLM-4.5VPhi 3 Mini 4k Instruct June 2024
LMArena Coding13471093

Reasoning GLM-4.5V leads

GLM-4.5V: 27.4 (#119), Phi 3 Mini 4k Instruct June 2024: 20.8 (#231)

Reasoning benchmarks
BenchmarkGLM-4.5VPhi 3 Mini 4k Instruct June 2024
LMArena Hard Prompts13341087
Kagi LLM Benchmark59.8%—

Math GLM-4.5V leads

GLM-4.5V: 37.4 (#159), Phi 3 Mini 4k Instruct June 2024: 33.0 (#208)

Math benchmarks
BenchmarkGLM-4.5VPhi 3 Mini 4k Instruct June 2024
LMArena Math13541152

Knowledge GLM-4.5V leads

GLM-4.5V: 37.5 (#156), Phi 3 Mini 4k Instruct June 2024: 28.6 (#244)

Knowledge benchmarks
BenchmarkGLM-4.5VPhi 3 Mini 4k Instruct June 2024
LMArena Expert13531051

Multimodal Not comparable

GLM-4.5V: 34.3 (#92), Phi 3 Mini 4k Instruct June 2024: —

Multimodal benchmarks
BenchmarkGLM-4.5VPhi 3 Mini 4k Instruct June 2024
LMArena Vision1154—

Multilingual GLM-4.5V leads

GLM-4.5V: 44.6 (#177), Phi 3 Mini 4k Instruct June 2024: 25.9 (#282)

Multilingual benchmarks
BenchmarkGLM-4.5VPhi 3 Mini 4k Instruct June 2024
LMArena Non-English13031013
LMArena Chinese13371033
LMArena Russian12981019
LMArena German—1031
LMArena Japanese—954
LMArena Korean—880
LMArena Spanish1336—

Instruction Following GLM-4.5V leads

GLM-4.5V: 69.2 (#175), Phi 3 Mini 4k Instruct June 2024: 54.1 (#282)

Instruction Following benchmarks
BenchmarkGLM-4.5VPhi 3 Mini 4k Instruct June 2024
LMArena Instruction Following13111058

Long Context GLM-4.5V leads

GLM-4.5V: 39.6 (#171), Phi 3 Mini 4k Instruct June 2024: 31.7 (#277)

Long Context benchmarks
BenchmarkGLM-4.5VPhi 3 Mini 4k Instruct June 2024
LMArena Longer Query13041042

Writing & Preference GLM-4.5V leads

GLM-4.5V: 52.5 (#170), Phi 3 Mini 4k Instruct June 2024: 29.6 (#294)

Writing & Preference benchmarks
BenchmarkGLM-4.5VPhi 3 Mini 4k Instruct June 2024
LMArena Text13331080
LMArena Creative Writing12951045
LMArena Multi-Turn13321049

Frequently asked questions

Is GLM-4.5V better than Phi 3 Mini 4k Instruct June 2024?

GLM-4.5V is the stronger model overall, scoring 39.8 to 31.3 on the Noometry Index.

Is GLM-4.5V or Phi 3 Mini 4k Instruct June 2024 better for coding?

GLM-4.5V scores higher on coding benchmarks: 39.5 versus 31.8 in the Noometry coding category.

How many benchmarks do GLM-4.5V and Phi 3 Mini 4k Instruct June 2024 share?

12 benchmarks have published results for both models. GLM-4.5V has 15 scored results on Noometry and Phi 3 Mini 4k Instruct June 2024 has 15.

Related comparisons

Go deeper