Noometry

Model comparison

GLM-4.7 vs Nemotron 3 Ultra

Nemotron 3 Ultra is the stronger model overall, scoring 44.7 to 41.7 on the Noometry Index.

Last verified . 24 shared benchmarks.

GLM-4.7 Z.ai (Zhipu)

41.7

Rank #117 Confirmed

Nemotron 3 Ultra NVIDIA

44.7

Rank #71 Confirmed

Summary

  • They share 24 benchmarks with published results for both. GLM-4.7 scores higher in 2 categories and Nemotron 3 Ultra in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Nemotron 3 Ultra leads 30.3 to 23.7.
  • The biggest single-benchmark swing is Chess Puzzles: 6% for GLM-4.7 and 12% for Nemotron 3 Ultra.
  • Both cost about the same: $0.60 input and $2.20 output per million tokens.
  • Nemotron 3 Ultra accepts more context: 262K tokens versus 205K.

Side by side

GLM-4.7Nemotron 3 Ultra
ProviderZ.ai (Zhipu)NVIDIA
Noometry Index41.744.7
Released2025-12-222026-06-04
WeightsOpenOpen
Context window205K262K
Max output131K128K
Input $ / M tokens$0.60$0.60
Output $ / M tokens$2.20$2.40
Results tracked3629

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.7 leads

GLM-4.7: 43.6 (#74), Nemotron 3 Ultra: 37.7 (#174)

BenchmarkGLM-4.7Nemotron 3 Ultra
SciCode45.1%40.3%
LMArena Coding14541468
FrontierCode—13.6%
LMArena WebDev1435—
WeirdML—43.5%
ALE-Bench399.48—

Agentic & Tool Use Not comparable

GLM-4.7: 26.4 (#96), Nemotron 3 Ultra: —

BenchmarkGLM-4.7Nemotron 3 Ultra
Terminal-Bench33.4%—
Vending-Bench 22,377—

Reasoning Nemotron 3 Ultra leads

GLM-4.7: 23.7 (#161), Nemotron 3 Ultra: 30.3 (#78)

BenchmarkGLM-4.7Nemotron 3 Ultra
CritPt1.7%3.1%
Chess Puzzles6%12%
LMArena Hard Prompts14431452
Epoch Capabilities Index143.53146.2
SimpleBench47.7%—
Mystery Game Puzzles—20%
DTBench—90.1%
LMCA—36.9%

Math GLM-4.7 leads

GLM-4.7: 37.7 (#92), Nemotron 3 Ultra: 34.4 (#160)

BenchmarkGLM-4.7Nemotron 3 Ultra
OTIS Mock AIME 2024-202583.3%86.7%
ProofBench6%2%
LMArena Math14231456
FrontierMath (Feb 2025 set)2.4%—
FrontierMath Tier 4 (v1)0%—

Knowledge Nemotron 3 Ultra leads

GLM-4.7: 47.0 (#74), Nemotron 3 Ultra: 52.5 (#56)

BenchmarkGLM-4.7Nemotron 3 Ultra
GPQA Diamond83.3%85.4%
LMArena Expert14241472
SimpleQA Verified32.2%—
Vectara Hallucination Rate11.7%—

Multilingual Too close to call

GLM-4.7: 53.0 (#75), Nemotron 3 Ultra: 53.7 (#61)

BenchmarkGLM-4.7Nemotron 3 Ultra
LMArena Non-English14171427
LMArena Chinese14951498
LMArena French14321475
LMArena German14261471
LMArena Korean14011387
LMArena Russian14231415
LMArena Spanish14331452
LMArena Japanese1439—

Instruction Following Too close to call

GLM-4.7: 74.6 (#90), Nemotron 3 Ultra: 74.9 (#84)

BenchmarkGLM-4.7Nemotron 3 Ultra
LMArena Instruction Following14111417

Long Context Nemotron 3 Ultra leads

GLM-4.7: 42.8 (#111), Nemotron 3 Ultra: 43.9 (#77)

BenchmarkGLM-4.7Nemotron 3 Ultra
LMArena Longer Query14321437
CL-bench15.9%—
CL-bench Life10.9%—

Writing & Preference Nemotron 3 Ultra leads

GLM-4.7: 61.1 (#89), Nemotron 3 Ultra: 66.3 (#35)

BenchmarkGLM-4.7Nemotron 3 Ultra
LMArena Text14361444
LMArena Creative Writing14011392
EQ-Bench Creative Writing14131692
LMArena Multi-Turn14461412

Frequently asked questions

Is GLM-4.7 better than Nemotron 3 Ultra?

Nemotron 3 Ultra is the stronger model overall, scoring 44.7 to 41.7 on the Noometry Index.

Which is cheaper, GLM-4.7 or Nemotron 3 Ultra?

GLM-4.7 is cheaper. It lists at $0.60 per million input tokens and $2.20 per million output tokens; Nemotron 3 Ultra lists at $0.60 and $2.40.

Is GLM-4.7 or Nemotron 3 Ultra better for coding?

GLM-4.7 scores higher on coding benchmarks: 43.6 versus 37.7 in the Noometry coding category.

Which has the bigger context window?

Nemotron 3 Ultra does, with 262K tokens against 205K.

How many benchmarks do GLM-4.7 and Nemotron 3 Ultra share?

24 benchmarks have published results for both models. GLM-4.7 has 36 scored results on Noometry and Nemotron 3 Ultra has 29.

Related comparisons

Go deeper