Model comparison

Amazon Nova Pro vs GLM-5

GLM-5 is the stronger model overall, scoring 46.1 to 31.0 on the Noometry Index.

Last verified . 19 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

GLM-5 Z.ai (Zhipu)

46.1

Rank #66 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Amazon Nova Pro scores higher in 0 categories and GLM-5 in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-5 leads 52.3 to 27.4.
  • The biggest single-benchmark swing is Vectara Hallucination Rate: 5.1% for Amazon Nova Pro and 10.1% for GLM-5.
  • Amazon Nova Pro is cheaper at $0.80 / $3.20 per million input/output tokens, against $1 / $3.20 for GLM-5.
  • Amazon Nova Pro accepts more context: 300K tokens versus 205K.
  • GLM-5 has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Pro and GLM-5 specifications
Amazon Nova ProGLM-5
ProviderAmazonZ.ai (Zhipu)
Noometry Index31.046.1
Released2024-12-032026-02-11
WeightsProprietaryOpen
Context window300K205K
Max output10K131K
Input $ / M tokens$0.80$1
Output $ / M tokens$3.20$3.20
Results tracked3845

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5 leads

Amazon Nova Pro: 35.1 (#229), GLM-5: 49.0 (#52)

Coding benchmarks
BenchmarkAmazon Nova ProGLM-5
LMArena Coding12701461
SWE-bench Verified—72.1%
SWE-bench Verified (bash only)—72.8%
LMArena WebDev—1434
SWE-bench Multilingual—69.7%
WeirdML—48.2%
LiveBench Coding38.1%—
ALE-Bench—765.62

Agentic & Tool Use GLM-5 leads

Amazon Nova Pro: 16.7 (#147), GLM-5: 31.1 (#71)

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova ProGLM-5
Terminal-Bench—52.4%
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—
τ²-bench Airline—82.5%
τ²-bench Banking—9.8%
τ²-bench Retail—73.7%
τ²-bench Telecom—86.8%
Vending-Bench 2—4,432

Reasoning GLM-5 leads

Amazon Nova Pro: 20.0 (#243), GLM-5: 27.6 (#116)

Reasoning benchmarks
BenchmarkAmazon Nova ProGLM-5
LMArena Hard Prompts12461452
Epoch Capabilities Index123.8145.83
ARC-AGI-2—4.9%
SimpleBench—53.2%
Kagi LLM Benchmark—75%
NYT Connections (extended)—74.8%
ARC-AGI-1—44.7%
Chess Puzzles—10%
LiveBench Reasoning32.6%—
LiveBench Data Analysis48.3%—
ForecastBench—61
LiveBench43.5%—

Math GLM-5 leads

Amazon Nova Pro: 28.5 (#243), GLM-5: 46.4 (#71)

Knowledge GLM-5 leads

Amazon Nova Pro: 27.4 (#250), GLM-5: 52.3 (#64)

Knowledge benchmarks
BenchmarkAmazon Nova ProGLM-5
Vectara Hallucination Rate5.1%10.1%
LMArena Expert12111454
GPQA Diamond—87.8%
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Confabulations30.1%—
GPQA (HELM)44.6%—
MMLU82%—

Multimodal Not comparable

Amazon Nova Pro: 25.0 (#126), GLM-5: —

Multimodal benchmarks
BenchmarkAmazon Nova ProGLM-5
LMArena Vision980—

Multilingual GLM-5 leads

Amazon Nova Pro: 39.7 (#223), GLM-5: 53.7 (#58)

Multilingual benchmarks
BenchmarkAmazon Nova ProGLM-5
LMArena Non-English12341430
LMArena Chinese12441511
LMArena French12711455
LMArena German12431445
LMArena Japanese12001416
LMArena Korean12031423
LMArena Russian12401436
LMArena Spanish11821454

Instruction Following GLM-5 leads

Amazon Nova Pro: 64.9 (#226), GLM-5: 75.2 (#67)

Instruction Following benchmarks
BenchmarkAmazon Nova ProGLM-5
LMArena Instruction Following12351428
LiveBench Instruction Following67.1%—
IFEval81.5%—

Long Context GLM-5 leads

Amazon Nova Pro: 38.1 (#205), GLM-5: 44.7 (#60)

Long Context benchmarks
BenchmarkAmazon Nova ProGLM-5
LMArena Longer Query12551446
CL-bench—18.7%

Writing & Preference GLM-5 leads

Amazon Nova Pro: 43.9 (#226), GLM-5: 66.0 (#38)

Writing & Preference benchmarks
BenchmarkAmazon Nova ProGLM-5
LMArena Text12591446
LMArena Creative Writing12121439
LMArena Multi-Turn12461456
Short-Story Creative Writing60.5%—
EQ-Bench Creative Writing—1601
WildBench77.7%—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than GLM-5?

GLM-5 is the stronger model overall, scoring 46.1 to 31.0 on the Noometry Index.

Which is cheaper, Amazon Nova Pro or GLM-5?

Amazon Nova Pro is cheaper. It lists at $0.80 per million input tokens and $3.20 per million output tokens; GLM-5 lists at $1 and $3.20.

Is Amazon Nova Pro or GLM-5 better for coding?

GLM-5 scores higher on coding benchmarks: 49.0 versus 35.1 in the Noometry coding category.

Which has the bigger context window?

Amazon Nova Pro does, with 300K tokens against 205K.

How many benchmarks do Amazon Nova Pro and GLM-5 share?

19 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and GLM-5 has 45.

Related comparisons

Go deeper