Noometry

Model comparison

GLM-4.7-Flash vs Phi 3 Mini 4k Instruct

GLM-4.7-Flash is the stronger model overall, scoring 38.8 to 27.9 on the Noometry Index.

Last verified . 17 shared benchmarks.

GLM-4.7-Flash Z.ai (Zhipu)

38.8

Rank #180 Confirmed

Phi 3 Mini 4k Instruct Microsoft

27.9

Rank #328 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GLM-4.7-Flash scores higher in 8 categories and Phi 3 Mini 4k Instruct in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in instruction following, where GLM-4.7-Flash leads 70.1 to 47.7.

Side by side

GLM-4.7-FlashPhi 3 Mini 4k Instruct
ProviderZ.ai (Zhipu)Microsoft
Noometry Index38.827.9
Released2026-01-192024-04-23
WeightsOpenOpen
Context window200K—
Max output131K—
Input $ / M tokens$0.06—
Output $ / M tokens$0.40—
Results tracked2135

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.7-Flash leads

GLM-4.7-Flash: 40.6 (#135), Phi 3 Mini 4k Instruct: 26.6 (#323)

BenchmarkGLM-4.7-FlashPhi 3 Mini 4k Instruct
LMArena Coding13831093
LiveBench Coding—15.5%
HumanEval+—59.1%
MBPP+—54.2%

Reasoning GLM-4.7-Flash leads

GLM-4.7-Flash: 20.9 (#229), Phi 3 Mini 4k Instruct: 14.1 (#328)

BenchmarkGLM-4.7-FlashPhi 3 Mini 4k Instruct
Chess Puzzles0%0%
LMArena Hard Prompts13561072
LiveBench Reasoning—26.8%
LiveBench Data Analysis—34.7%
Adversarial NLI—52.8%
BIG-Bench Hard—71.7%
HellaSwag—76.7%
LiveBench—22.4%
WinoGrande—70.8%

Math GLM-4.7-Flash leads

GLM-4.7-Flash: 36.1 (#173), Phi 3 Mini 4k Instruct: 26.6 (#257)

BenchmarkGLM-4.7-FlashPhi 3 Mini 4k Instruct
LMArena Math13551111
OTIS Mock AIME 2024-202558.3%—
LiveBench Math—15.7%

Knowledge GLM-4.7-Flash leads

GLM-4.7-Flash: 35.5 (#184), Phi 3 Mini 4k Instruct: 28.5 (#246)

BenchmarkGLM-4.7-FlashPhi 3 Mini 4k Instruct
LMArena Expert13571045
GPQA Diamond60.5%—
Vectara Hallucination Rate9.3%—
ARC (AI2) Challenge—84.9%
MMLU—68.8%
OpenBookQA—88%
TriviaQA—64%

Multilingual GLM-4.7-Flash leads

GLM-4.7-Flash: 46.5 (#158), Phi 3 Mini 4k Instruct: 26.3 (#280)

BenchmarkGLM-4.7-FlashPhi 3 Mini 4k Instruct
LMArena Non-English13301021
LMArena Chinese14031021
LMArena French13321076
LMArena German13371044
LMArena Korean1283905
LMArena Russian13321022
LMArena Spanish13501085
LMArena Japanese—935

Instruction Following GLM-4.7-Flash leads

GLM-4.7-Flash: 70.1 (#167), Phi 3 Mini 4k Instruct: 47.7 (#303)

BenchmarkGLM-4.7-FlashPhi 3 Mini 4k Instruct
LMArena Instruction Following13271053
LiveBench Instruction Following—39.1%

Long Context GLM-4.7-Flash leads

GLM-4.7-Flash: 40.9 (#148), Phi 3 Mini 4k Instruct: 31.7 (#276)

BenchmarkGLM-4.7-FlashPhi 3 Mini 4k Instruct
LMArena Longer Query13451044

Writing & Preference GLM-4.7-Flash leads

GLM-4.7-Flash: 47.4 (#210), Phi 3 Mini 4k Instruct: 27.6 (#300)

BenchmarkGLM-4.7-FlashPhi 3 Mini 4k Instruct
LMArena Text13511073
LMArena Creative Writing12971037
LMArena Multi-Turn13421018
EQ-Bench Creative Writing1125—
LiveBench Language—9.2%

Frequently asked questions

Is GLM-4.7-Flash better than Phi 3 Mini 4k Instruct?

GLM-4.7-Flash is the stronger model overall, scoring 38.8 to 27.9 on the Noometry Index.

Is GLM-4.7-Flash or Phi 3 Mini 4k Instruct better for coding?

GLM-4.7-Flash scores higher on coding benchmarks: 40.6 versus 26.6 in the Noometry coding category.

How many benchmarks do GLM-4.7-Flash and Phi 3 Mini 4k Instruct share?

17 benchmarks have published results for both models. GLM-4.7-Flash has 21 scored results on Noometry and Phi 3 Mini 4k Instruct has 35.

Related comparisons

Go deeper