Model comparison

GLM-5 vs gpt-oss-20b

GLM-5 is the stronger model overall, scoring 46.1 to 32.5 on the Noometry Index. gpt-oss-20b costs 43× less per token, which makes it the better buy when GLM-5's lead doesn't matter for your workload.

Last verified . 25 shared benchmarks.

GLM-5 Z.ai (Zhipu)

46.1

Rank #66 Confirmed

gpt-oss-20b OpenAI

32.5

Rank #255 Confirmed

Summary

  • They share 25 benchmarks with published results for both. GLM-5 scores higher in 9 categories and gpt-oss-20b in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GLM-5 leads 66.0 to 35.5.
  • The biggest single-benchmark swing is Terminal-Bench: 52.4% for GLM-5 and 3.4% for gpt-oss-20b.
  • gpt-oss-20b is cheaper at $0.018 / $0.09 per million input/output tokens, against $1 / $3.20 for GLM-5.
  • GLM-5 accepts more context: 205K tokens versus 131K.

Side by side

GLM-5 and gpt-oss-20b specifications
GLM-5gpt-oss-20b
ProviderZ.ai (Zhipu)OpenAI
Noometry Index46.132.5
Released2026-02-112025-08-05
WeightsOpenOpen
Context window205K131K
Max output131K16K
Input $ / M tokens$1$0.018
Output $ / M tokens$3.20$0.09
Results tracked4534

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5 leads

GLM-5: 49.0 (#52), gpt-oss-20b: 37.6 (#192)

Coding benchmarks
BenchmarkGLM-5gpt-oss-20b
WeirdML48.2%40.9%
LMArena Coding14611306
ALE-Bench765.62566.05
SWE-bench Verified72.1%—
SWE-bench Verified (bash only)72.8%—
LMArena WebDev1434—
SWE-bench Multilingual69.7%—
SciCode—34.4%

Agentic & Tool Use GLM-5 leads

GLM-5: 31.1 (#71), gpt-oss-20b: 9.3 (#154)

Agentic & Tool Use benchmarks
BenchmarkGLM-5gpt-oss-20b
Terminal-Bench52.4%3.4%
τ²-bench Airline82.5%—
τ²-bench Banking9.8%—
τ²-bench Retail73.7%—
τ²-bench Telecom86.8%—
Vending-Bench 24,432—

Reasoning GLM-5 leads

GLM-5: 27.6 (#116), gpt-oss-20b: 19.3 (#261)

Reasoning benchmarks
BenchmarkGLM-5gpt-oss-20b
Kagi LLM Benchmark75%53.2%
Chess Puzzles10%4%
LMArena Hard Prompts14521274
Epoch Capabilities Index145.83137.82
ARC-AGI-24.9%—
SimpleBench53.2%—
NYT Connections (extended)74.8%—
ARC-AGI-144.7%—
CritPt—1.4%
DTBench—68%
LMCA—14.5%
ForecastBench61—

Math GLM-5 leads

GLM-5: 46.4 (#71), gpt-oss-20b: 39.4 (#103)

Knowledge GLM-5 leads

GLM-5: 52.3 (#64), gpt-oss-20b: 34.6 (#195)

Knowledge benchmarks
BenchmarkGLM-5gpt-oss-20b
GPQA Diamond87.8%60.8%
LMArena Expert14541258
MMLU-Pro—74%
Vectara Hallucination Rate10.1%—
GPQA (HELM)—59.4%

Multilingual GLM-5 leads

GLM-5: 53.7 (#58), gpt-oss-20b: 42.2 (#197)

Multilingual benchmarks
BenchmarkGLM-5gpt-oss-20b
LMArena Non-English14301268
LMArena Chinese15111314
LMArena German14451255
LMArena Japanese14161244
LMArena Korean14231236
LMArena Russian14361278
LMArena Spanish14541267
LMArena French1455—

Instruction Following GLM-5 leads

GLM-5: 75.2 (#67), gpt-oss-20b: 61.8 (#240)

Instruction Following benchmarks
BenchmarkGLM-5gpt-oss-20b
LMArena Instruction Following14281236
IFEval—73.2%

Long Context GLM-5 leads

GLM-5: 44.7 (#60), gpt-oss-20b: 37.9 (#209)

Long Context benchmarks
BenchmarkGLM-5gpt-oss-20b
LMArena Longer Query14461250
CL-bench18.7%—

Writing & Preference GLM-5 leads

GLM-5: 66.0 (#38), gpt-oss-20b: 35.5 (#265)

Writing & Preference benchmarks
BenchmarkGLM-5gpt-oss-20b
LMArena Text14461287
LMArena Creative Writing14391201
EQ-Bench Creative Writing1601666
LMArena Multi-Turn14561268
WildBench—73.7%

Frequently asked questions

Is GLM-5 better than gpt-oss-20b?

GLM-5 is the stronger model overall, scoring 46.1 to 32.5 on the Noometry Index. gpt-oss-20b costs 43× less per token, which makes it the better buy when GLM-5's lead doesn't matter for your workload.

Which is cheaper, GLM-5 or gpt-oss-20b?

gpt-oss-20b is cheaper. It lists at $0.018 per million input tokens and $0.09 per million output tokens; GLM-5 lists at $1 and $3.20.

Is GLM-5 or gpt-oss-20b better for coding?

GLM-5 scores higher on coding benchmarks: 49.0 versus 37.6 in the Noometry coding category.

Which has the bigger context window?

GLM-5 does, with 205K tokens against 131K.

How many benchmarks do GLM-5 and gpt-oss-20b share?

25 benchmarks have published results for both models. GLM-5 has 45 scored results on Noometry and gpt-oss-20b has 34.

Related comparisons

Go deeper