Noometry

Model comparison

GLM-5.1 vs Mixtral 8x22B

GLM-5.1 is the stronger model overall, scoring 47.8 to 27.1 on the Noometry Index.

Last verified . 20 shared benchmarks.

GLM-5.1 Z.ai (Zhipu)

47.8

Rank #59 Confirmed

Mixtral 8x22B Mistral AI

27.1

Rank #333 Confirmed

Summary

  • They share 20 benchmarks with published results for both. GLM-5.1 scores higher in 9 categories and Mixtral 8x22B in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-5.1 leads 54.9 to 15.1.
  • The biggest single-benchmark swing is GPQA Diamond: 89.9% for GLM-5.1 and 34.1% for Mixtral 8x22B.
  • GLM-5.1 is cheaper at $1.40 / $4.40 per million input/output tokens, against $2 / $6 for Mixtral 8x22B.
  • GLM-5.1 accepts more context: 200K tokens versus 64K.

Side by side

GLM-5.1Mixtral 8x22B
ProviderZ.ai (Zhipu)Mistral AI
Noometry Index47.827.1
Released2026-04-072024-04-17
WeightsOpenOpen
Context window200K64K
Max output131K64K
Input $ / M tokens$1.40$2
Output $ / M tokens$4.40$6
Results tracked4134

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5.1 leads

GLM-5.1: 48.7 (#55), Mixtral 8x22B: 24.2 (#329)

BenchmarkGLM-5.1Mixtral 8x22B
WeirdML57.1%3.2%
LMArena Coding14851166
SWE-bench Verified74.2%—
LMArena WebDev1508—
SciCode43.8%—
BigCodeBench Instruct—40.6%
BigCodeBench Complete—50.2%
ALE-Bench887.1—
HumanEval+—72%
MBPP+—64.3%

Agentic & Tool Use GLM-5.1 leads

GLM-5.1: 24.9 (#113), Mixtral 8x22B: 23.1 (#127)

BenchmarkGLM-5.1Mixtral 8x22B
APEX-Agents40.9%—
Cybench—7.5%
ExploitBench18.1%—
GBAEval0%—
Vending-Bench 25,634—

Reasoning GLM-5.1 leads

GLM-5.1: 39.1 (#60), Mixtral 8x22B: 19.9 (#248)

BenchmarkGLM-5.1Mixtral 8x22B
LMArena Hard Prompts14721150
Epoch Capabilities Index149.84122.03
SimpleBench55.1%—
NYT Connections (extended)77.7%—
CritPt4.6%—
Chess Puzzles19%—
Thematic Generalization69.8%—
DTBench—55.1%
ForecastBench—56.3

Math GLM-5.1 leads

GLM-5.1: 49.7 (#60), Mixtral 8x22B: 22.9 (#275)

BenchmarkGLM-5.1Mixtral 8x22B
LMArena Math14731184
FrontierMath (Tiers 1-3)36.8%—
MathArena Final-Answer Competitions67.1%—
OTIS Mock AIME 2024-202593.3%—
ProofBench22.2%—
Omni-MATH—16.3%
MATH Level 5—24.2%
FrontierMath (Feb 2025 set)33.4%—
FrontierMath Tier 4 (v1)12.5%—

Knowledge GLM-5.1 leads

GLM-5.1: 54.9 (#50), Mixtral 8x22B: 15.1 (#293)

BenchmarkGLM-5.1Mixtral 8x22B
GPQA Diamond89.9%34.1%
LMArena Expert14761113
SimpleQA Verified34%—
MMLU-Pro—46%
GPQA (HELM)—33.4%
MMLU—77.8%

Multilingual GLM-5.1 leads

GLM-5.1: 55.0 (#36), Mixtral 8x22B: 32.8 (#255)

BenchmarkGLM-5.1Mixtral 8x22B
LMArena Non-English14471128
LMArena Chinese15151116
LMArena French14741166
LMArena German14651141
LMArena Japanese14341037
LMArena Korean14181057
LMArena Russian14541158
LMArena Spanish14691151

Instruction Following GLM-5.1 leads

GLM-5.1: 76.3 (#42), Mixtral 8x22B: 57.7 (#266)

BenchmarkGLM-5.1Mixtral 8x22B
LMArena Instruction Following14511147
IFEval—72.4%

Long Context GLM-5.1 leads

GLM-5.1: 44.9 (#53), Mixtral 8x22B: 34.7 (#247)

BenchmarkGLM-5.1Mixtral 8x22B
LMArena Longer Query14661144

Writing & Preference GLM-5.1 leads

GLM-5.1: 66.9 (#31), Mixtral 8x22B: 36.9 (#262)

BenchmarkGLM-5.1Mixtral 8x22B
LMArena Text14611162
LMArena Creative Writing14531141
LMArena Multi-Turn14721130
EQ-Bench Creative Writing1592—
WildBench—71.1%

Frequently asked questions

Is GLM-5.1 better than Mixtral 8x22B?

GLM-5.1 is the stronger model overall, scoring 47.8 to 27.1 on the Noometry Index.

Which is cheaper, GLM-5.1 or Mixtral 8x22B?

GLM-5.1 is cheaper. It lists at $1.40 per million input tokens and $4.40 per million output tokens; Mixtral 8x22B lists at $2 and $6.

Is GLM-5.1 or Mixtral 8x22B better for coding?

GLM-5.1 scores higher on coding benchmarks: 48.7 versus 24.2 in the Noometry coding category.

Which has the bigger context window?

GLM-5.1 does, with 200K tokens against 64K.

How many benchmarks do GLM-5.1 and Mixtral 8x22B share?

20 benchmarks have published results for both models. GLM-5.1 has 41 scored results on Noometry and Mixtral 8x22B has 34.

Related comparisons

Go deeper