Model comparison

Devstral Small 2505 vs GLM-4.5

GLM-4.5 is the stronger model overall, scoring 42.0 to 34.3 on the Noometry Index. Devstral Small 2505 costs 6.7× less per token, which makes it the better buy when GLM-4.5's lead doesn't matter for your workload.

Last verified October 10, 2026. 2 shared benchmarks.

Devstral Small 2505

Mistral AI

34.3

Rank #233 Reported

GLM-4.5 Z.ai (Zhipu)

42.0

Rank #122 Confirmed

Summary

They share 2 benchmarks with published results for both. Devstral Small 2505 scores higher in 0 categories and GLM-4.5 in 2 categories; 2 gaps are clear of the uncertainty.
The widest gap is in reasoning, where GLM-4.5 leads 28.6 to 19.7.
The biggest single-benchmark swing is Kagi LLM Benchmark: 37.7% for Devstral Small 2505 and 57.9% for GLM-4.5.
Devstral Small 2505 is cheaper at $0.10 / $0.30 per million input/output tokens, against $0.60 / $2.20 for GLM-4.5.
GLM-4.5 accepts more context: 131K tokens versus 128K.

Side by side

Devstral Small 2505 and GLM-4.5 specifications
	Devstral Small 2505	GLM-4.5
Provider	Mistral AI	Z.ai (Zhipu)
Noometry Index	34.3	42.0
Released	2025-05-07	2025-07-27
Weights	Open	Open
Context window	128K	131K
Max output	128K	98K
Input $ / M tokens	$0.10	$0.60
Output $ / M tokens	$0.30	$2.20
Results tracked	4	27

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.5 leads

Devstral Small 2505: 38.9 (#166), GLM-4.5: 41.4 (#125)

Coding benchmarks
Benchmark	Devstral Small 2505	GLM-4.5
SWE-bench Verified (bash only)	56.4%	54.2%
SciCode	28.8%	—
WeirdML	—	40.6%
LMArena Coding	—	1434
ALE-Bench	—	344.82
AlgoTune	—	1.52

Reasoning GLM-4.5 leads

Devstral Small 2505: 19.7 (#252), GLM-4.5: 28.6 (#100)

Reasoning benchmarks
Benchmark	Devstral Small 2505	GLM-4.5
Kagi LLM Benchmark	37.7%	57.9%
CritPt	0%	—
LMArena Hard Prompts	—	1429

Math Not comparable

Devstral Small 2505: —, GLM-4.5: 39.0 (#116)

Math benchmarks
Benchmark	Devstral Small 2505	GLM-4.5
LMArena Math	—	1427

Knowledge Not comparable

Devstral Small 2505: —, GLM-4.5: 35.9 (#179)

Knowledge benchmarks
Benchmark	Devstral Small 2505	GLM-4.5
Humanity's Last Exam	—	8.3%
Confabulations	—	11.3%
LMArena Expert	—	1433

Multilingual Not comparable

Devstral Small 2505: —, GLM-4.5: 52.8 (#77)

Multilingual benchmarks
Benchmark	Devstral Small 2505	GLM-4.5
LMArena Non-English	—	1417
LMArena Chinese	—	1465
LMArena French	—	1418
LMArena German	—	1407
LMArena Japanese	—	1415
LMArena Korean	—	1380
LMArena Russian	—	1414
LMArena Spanish	—	1454

Instruction Following Not comparable

Devstral Small 2505: —, GLM-4.5: 74.1 (#104)

Instruction Following benchmarks
Benchmark	Devstral Small 2505	GLM-4.5
LMArena Instruction Following	—	1404

Long Context Not comparable

Devstral Small 2505: —, GLM-4.5: 38.2 (#201)

Long Context benchmarks
Benchmark	Devstral Small 2505	GLM-4.5
Fiction.LiveBench	—	58.3%
LMArena Longer Query	—	1412

Writing & Preference Not comparable

Devstral Small 2505: —, GLM-4.5: 57.5 (#127)

Writing & Preference benchmarks
Benchmark	Devstral Small 2505	GLM-4.5
LMArena Text	—	1430
LMArena Creative Writing	—	1395
Short-Story Creative Writing	—	73.4%
EQ-Bench Creative Writing	—	1343
LMArena Multi-Turn	—	1415

Frequently asked questions

Is Devstral Small 2505 better than GLM-4.5?

Which is cheaper, Devstral Small 2505 or GLM-4.5?

Devstral Small 2505 is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; GLM-4.5 lists at $0.60 and $2.20.

Is Devstral Small 2505 or GLM-4.5 better for coding?

GLM-4.5 scores higher on coding benchmarks: 41.4 versus 38.9 in the Noometry coding category.

Which has the bigger context window?

GLM-4.5 does, with 131K tokens against 128K.

How many benchmarks do Devstral Small 2505 and GLM-4.5 share?

2 benchmarks have published results for both models. Devstral Small 2505 has 4 scored results on Noometry and GLM-4.5 has 27.