Model comparison

GLM-5.1 vs Mistral Small 3.2

GLM-5.1 is the stronger model overall, scoring 47.8 to 31.2 on the Noometry Index. Mistral Small 3.2 costs 16× less per token, which makes it the better buy when GLM-5.1's lead doesn't matter for your workload.

Last verified . 5 shared benchmarks.

GLM-5.1 Z.ai (Zhipu)

47.8

Rank #59 Confirmed

Mistral Small 3.2 Mistral AI

31.2

Rank #280 Confirmed

Summary

  • They share 5 benchmarks with published results for both. GLM-5.1 scores higher in 4 categories and Mistral Small 3.2 in 0 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-5.1 leads 54.9 to 26.7.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 93.3% for GLM-5.1 and 30.3% for Mistral Small 3.2.
  • Mistral Small 3.2 is cheaper at $0.0938 / $0.25 per million input/output tokens, against $1.40 / $4.40 for GLM-5.1.
  • Mistral Small 3.2 accepts more context: 256K tokens versus 200K.

Side by side

GLM-5.1 and Mistral Small 3.2 specifications
GLM-5.1Mistral Small 3.2
ProviderZ.ai (Zhipu)Mistral AI
Noometry Index47.831.2
Released2026-04-072025-06-20
WeightsOpenOpen
Context window200K256K
Max output131K16K
Input $ / M tokens$1.40$0.0938
Output $ / M tokens$4.40$0.25
Results tracked416

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

GLM-5.1: 48.7 (#55), Mistral Small 3.2: —

Coding benchmarks
BenchmarkGLM-5.1Mistral Small 3.2
SWE-bench Verified74.2%—
LMArena WebDev1508—
SciCode43.8%—
WeirdML57.1%—
LMArena Coding1485—
ALE-Bench887.1—

Agentic & Tool Use Not comparable

GLM-5.1: 24.9 (#113), Mistral Small 3.2: —

Agentic & Tool Use benchmarks
BenchmarkGLM-5.1Mistral Small 3.2
APEX-Agents40.9%—
ExploitBench18.1%—
GBAEval0%—
Vending-Bench 25,634—

Reasoning GLM-5.1 leads

GLM-5.1: 39.1 (#60), Mistral Small 3.2: 18.1 (#287)

Reasoning benchmarks
BenchmarkGLM-5.1Mistral Small 3.2
Chess Puzzles19%1%
Epoch Capabilities Index149.84131.74
SimpleBench55.1%—
Kagi LLM Benchmark—40.4%
NYT Connections (extended)77.7%—
CritPt4.6%—
Thematic Generalization69.8%—
LMArena Hard Prompts1472—

Math GLM-5.1 leads

GLM-5.1: 49.7 (#60), Mistral Small 3.2: 26.3 (#260)

Math benchmarks
BenchmarkGLM-5.1Mistral Small 3.2
OTIS Mock AIME 2024-202593.3%30.3%
FrontierMath (Tiers 1-3)36.8%—
MathArena Final-Answer Competitions67.1%—
ProofBench22.2%—
LMArena Math1473—
FrontierMath (Feb 2025 set)33.4%—
FrontierMath Tier 4 (v1)12.5%—

Knowledge GLM-5.1 leads

GLM-5.1: 54.9 (#50), Mistral Small 3.2: 26.7 (#256)

Knowledge benchmarks
BenchmarkGLM-5.1Mistral Small 3.2
GPQA Diamond89.9%49.1%
SimpleQA Verified34%—
LMArena Expert1476—

Multilingual Not comparable

GLM-5.1: 55.0 (#36), Mistral Small 3.2: —

Multilingual benchmarks
BenchmarkGLM-5.1Mistral Small 3.2
LMArena Non-English1447—
LMArena Chinese1515—
LMArena French1474—
LMArena German1465—
LMArena Japanese1434—
LMArena Korean1418—
LMArena Russian1454—
LMArena Spanish1469—

Instruction Following Not comparable

GLM-5.1: 76.3 (#42), Mistral Small 3.2: —

Instruction Following benchmarks
BenchmarkGLM-5.1Mistral Small 3.2
LMArena Instruction Following1451—

Long Context Not comparable

GLM-5.1: 44.9 (#53), Mistral Small 3.2: —

Long Context benchmarks
BenchmarkGLM-5.1Mistral Small 3.2
LMArena Longer Query1466—

Writing & Preference GLM-5.1 leads

GLM-5.1: 66.9 (#31), Mistral Small 3.2: 45.0 (#224)

Writing & Preference benchmarks
BenchmarkGLM-5.1Mistral Small 3.2
EQ-Bench Creative Writing15921255
LMArena Text1461—
LMArena Creative Writing1453—
LMArena Multi-Turn1472—

Frequently asked questions

Is GLM-5.1 better than Mistral Small 3.2?

GLM-5.1 is the stronger model overall, scoring 47.8 to 31.2 on the Noometry Index. Mistral Small 3.2 costs 16× less per token, which makes it the better buy when GLM-5.1's lead doesn't matter for your workload.

Which is cheaper, GLM-5.1 or Mistral Small 3.2?

Mistral Small 3.2 is cheaper. It lists at $0.0938 per million input tokens and $0.25 per million output tokens; GLM-5.1 lists at $1.40 and $4.40.

Which has the bigger context window?

Mistral Small 3.2 does, with 256K tokens against 200K.

How many benchmarks do GLM-5.1 and Mistral Small 3.2 share?

5 benchmarks have published results for both models. GLM-5.1 has 41 scored results on Noometry and Mistral Small 3.2 has 6.

Related comparisons

Go deeper