Model comparison

Codestral vs GLM-5

GLM-5 is the stronger model overall, scoring 45.9 to 30.1 on the Noometry Index. Codestral costs 3.4× less per token, which makes it the better buy when GLM-5's lead doesn't matter for your workload.

Last verified . 2 shared benchmarks.

Codestral Mistral AI

30.1

Rank #287 Reported

GLM-5 Z.ai (Zhipu)

45.9

Rank #59 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Codestral scores higher in 0 categories and GLM-5 in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in coding, where GLM-5 leads 49.0 to 26.9.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 32.5% for Codestral and 75% for GLM-5.
  • Codestral is cheaper at $0.30 / $0.90 per million input/output tokens, against $1 / $3.20 for GLM-5.
  • Codestral accepts more context: 256K tokens versus 205K.

Side by side

Codestral and GLM-5 specifications
CodestralGLM-5
ProviderMistral AIZ.ai (Zhipu)
Noometry Index30.145.9
Released2024-05-292026-02-11
WeightsOpenOpen
Context window256K205K
Max output4K131K
Input $ / M tokens$0.30$1
Output $ / M tokens$0.90$3.20
Results tracked745

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5 leads

Codestral: 26.9 (#316), GLM-5: 49.0 (#47)

Coding benchmarks
BenchmarkCodestralGLM-5
ALE-Bench137.78765.62
SWE-bench Verified—72.1%
SWE-bench Verified (bash only)—72.8%
Aider Polyglot11.1%—
LMArena WebDev—1434
SWE-bench Multilingual—69.7%
WeirdML—48.2%
BigCodeBench Instruct41.8%—
LMArena Coding—1461
BigCodeBench Complete52.5%—
HumanEval+73.8%—
MBPP+61.9%—

Agentic & Tool Use Not comparable

Codestral: —, GLM-5: 30.9 (#65)

Agentic & Tool Use benchmarks
BenchmarkCodestralGLM-5
Terminal-Bench—52.4%
τ²-bench Airline—82.5%
τ²-bench Banking—9.8%
τ²-bench Retail—73.7%
τ²-bench Telecom—86.8%
Vending-Bench 2—4,432

Reasoning GLM-5 leads

Codestral: 19.1 (#244), GLM-5: 27.6 (#100)

Reasoning benchmarks
BenchmarkCodestralGLM-5
Kagi LLM Benchmark32.5%75%
ARC-AGI-2—4.9%
SimpleBench—53.2%
NYT Connections (extended)—74.8%
ARC-AGI-1—44.7%
Chess Puzzles—10%
LMArena Hard Prompts—1451
Epoch Capabilities Index—145.84
ForecastBench—61

Math Not comparable

Codestral: —, GLM-5: 44.8 (#66)

Knowledge Not comparable

Codestral: —, GLM-5: 52.2 (#59)

Knowledge benchmarks
BenchmarkCodestralGLM-5
GPQA Diamond—87.8%
Vectara Hallucination Rate—10.1%
LMArena Expert—1454

Multilingual Not comparable

Codestral: —, GLM-5: 53.9 (#57)

Multilingual benchmarks
BenchmarkCodestralGLM-5
LMArena Non-English—1430
LMArena Chinese—1511
LMArena French—1455
LMArena German—1445
LMArena Japanese—1416
LMArena Korean—1421
LMArena Russian—1436
LMArena Spanish—1452

Instruction Following Not comparable

Codestral: —, GLM-5: 75.4 (#64)

Instruction Following benchmarks
BenchmarkCodestralGLM-5
LMArena Instruction Following—1427

Long Context Not comparable

Codestral: —, GLM-5: 44.6 (#58)

Long Context benchmarks
BenchmarkCodestralGLM-5
CL-bench—18.7%
LMArena Longer Query—1446

Writing & Preference Not comparable

Codestral: —, GLM-5: 66.2 (#38)

Writing & Preference benchmarks
BenchmarkCodestralGLM-5
LMArena Text—1446
LMArena Creative Writing—1438
EQ-Bench Creative Writing—1601
LMArena Multi-Turn—1456

Frequently asked questions

Is Codestral better than GLM-5?

GLM-5 is the stronger model overall, scoring 45.9 to 30.1 on the Noometry Index. Codestral costs 3.4× less per token, which makes it the better buy when GLM-5's lead doesn't matter for your workload.

Which is cheaper, Codestral or GLM-5?

Codestral is cheaper. It lists at $0.30 per million input tokens and $0.90 per million output tokens; GLM-5 lists at $1 and $3.20.

Is Codestral or GLM-5 better for coding?

GLM-5 scores higher on coding benchmarks: 49.0 versus 26.9 in the Noometry coding category.

Which has the bigger context window?

Codestral does, with 256K tokens against 205K.

How many benchmarks do Codestral and GLM-5 share?

2 benchmarks have published results for both models. Codestral has 7 scored results on Noometry and GLM-5 has 45.

Related comparisons

Go deeper