Model comparison

GLM-4.5 vs Llama 2-70B

GLM-4.5 is the stronger model overall, scoring 42.0 to 24.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

GLM-4.5 Z.ai (Zhipu)

42.0

Rank #122 Confirmed

Llama 2-70B Meta

24.4

Rank #349 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GLM-4.5 scores higher in 8 categories and Llama 2-70B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GLM-4.5 leads 39.0 to 8.1.

Side by side

GLM-4.5 and Llama 2-70B specifications
GLM-4.5Llama 2-70B
ProviderZ.ai (Zhipu)Meta
Noometry Index42.024.4
Released2025-07-272023-07-18
WeightsOpenOpen
Context window131K—
Max output98K—
Input $ / M tokens$0.60—
Output $ / M tokens$2.20—
Results tracked2735

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.5 leads

GLM-4.5: 41.4 (#125), Llama 2-70B: 31.4 (#286)

Coding benchmarks
BenchmarkGLM-4.5Llama 2-70B
LMArena Coding14341079
SWE-bench Verified (bash only)54.2%—
WeirdML40.6%—
ALE-Bench344.82—
AlgoTune1.52—

Reasoning GLM-4.5 leads

GLM-4.5: 28.6 (#100), Llama 2-70B: 14.4 (#325)

Reasoning benchmarks
BenchmarkGLM-4.5Llama 2-70B
LMArena Hard Prompts14291073
Kagi LLM Benchmark57.9%—
DTBench—41.6%
BIG-Bench Hard—64.9%
CommonsenseQA 2.0—50%
Epoch Capabilities Index—113.79
ForecastBench—51.4
HellaSwag—85.3%
LAMBADA—78.9%
PIQA—82.8%
WinoGrande—80.2%

Math GLM-4.5 leads

GLM-4.5: 39.0 (#116), Llama 2-70B: 8.1 (#326)

Math benchmarks
BenchmarkGLM-4.5Llama 2-70B
LMArena Math14271091
OTIS Mock AIME 2024-2025—0%
MATH Level 5—3.3%
GSM8K—69.6%

Knowledge GLM-4.5 leads

GLM-4.5: 35.9 (#179), Llama 2-70B: 7.4 (#310)

Knowledge benchmarks
BenchmarkGLM-4.5Llama 2-70B
LMArena Expert14331039
GPQA Diamond—26.3%
Humanity's Last Exam8.3%—
Confabulations11.3%—
ARC (AI2) Challenge—78.3%
BoolQ—88.6%
MMLU—69.9%
OpenBookQA—60.2%
TriviaQA—87.6%

Multilingual GLM-4.5 leads

GLM-4.5: 52.8 (#77), Llama 2-70B: 27.7 (#274)

Multilingual benchmarks
BenchmarkGLM-4.5Llama 2-70B
LMArena Non-English14171045
LMArena Chinese1465995
LMArena French14181090
LMArena German14071041
LMArena Japanese1415927
LMArena Korean1380964
LMArena Russian14141083
LMArena Spanish14541143

Instruction Following GLM-4.5 leads

GLM-4.5: 74.1 (#104), Llama 2-70B: 54.9 (#278)

Instruction Following benchmarks
BenchmarkGLM-4.5Llama 2-70B
LMArena Instruction Following14041071

Long Context GLM-4.5 leads

GLM-4.5: 38.2 (#201), Llama 2-70B: 32.3 (#270)

Long Context benchmarks
BenchmarkGLM-4.5Llama 2-70B
LMArena Longer Query14121062
Fiction.LiveBench58.3%—

Writing & Preference GLM-4.5 leads

GLM-4.5: 57.5 (#127), Llama 2-70B: 32.3 (#279)

Writing & Preference benchmarks
BenchmarkGLM-4.5Llama 2-70B
LMArena Text14301115
LMArena Creative Writing13951075
LMArena Multi-Turn14151088
Short-Story Creative Writing73.4%—
EQ-Bench Creative Writing1343—

Frequently asked questions

Is GLM-4.5 better than Llama 2-70B?

GLM-4.5 is the stronger model overall, scoring 42.0 to 24.4 on the Noometry Index.

Is GLM-4.5 or Llama 2-70B better for coding?

GLM-4.5 scores higher on coding benchmarks: 41.4 versus 31.4 in the Noometry coding category.

How many benchmarks do GLM-4.5 and Llama 2-70B share?

17 benchmarks have published results for both models. GLM-4.5 has 27 scored results on Noometry and Llama 2-70B has 35.

Related comparisons

Go deeper