Model comparison

Grok Build 0.1 vs Qwen1.5-72B

Grok Build 0.1 is the stronger model overall, scoring 36.4 to 30.8 on the Noometry Index.

Last verified . 0 shared benchmarks.

Grok Build 0.1 xAI

36.4

Rank #216 Reported

Qwen1.5-72B Alibaba (Qwen)

30.8

Rank #285 Confirmed

Summary

  • The widest gap is in coding, where Grok Build 0.1 leads 43.1 to 31.9.
  • Qwen1.5-72B has downloadable open weights; the other is API-only.

Side by side

Grok Build 0.1 and Qwen1.5-72B specifications
Grok Build 0.1Qwen1.5-72B
ProviderxAIAlibaba (Qwen)
Noometry Index36.430.8
Released2026-04-162024-02-04
WeightsProprietaryOpen
Context window256K—
Max output256K—
Input $ / M tokens$1—
Output $ / M tokens$2—
Results tracked322

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok Build 0.1 leads

Grok Build 0.1: 43.1 (#91), Qwen1.5-72B: 31.9 (#277)

Coding benchmarks
BenchmarkGrok Build 0.1Qwen1.5-72B
SciCode50.2%—
BigCodeBench Instruct—33.2%
LMArena Coding—1165
BigCodeBench Complete—40.3%
HumanEval+—59.1%
MBPP+—61.6%

Agentic & Tool Use Not comparable

Grok Build 0.1: 22.7 (#129), Qwen1.5-72B: —

Agentic & Tool Use benchmarks
BenchmarkGrok Build 0.1Qwen1.5-72B
GBAEval2.4%—

Reasoning Grok Build 0.1 leads

Grok Build 0.1: 32.2 (#77), Qwen1.5-72B: 22.2 (#203)

Reasoning benchmarks
BenchmarkGrok Build 0.1Qwen1.5-72B
CritPt9.1%—
LMArena Hard Prompts—1148

Math Not comparable

Grok Build 0.1: —, Qwen1.5-72B: 33.2 (#205)

Math benchmarks
BenchmarkGrok Build 0.1Qwen1.5-72B
LMArena Math—1164

Knowledge Not comparable

Grok Build 0.1: —, Qwen1.5-72B: 11.5 (#300)

Knowledge benchmarks
BenchmarkGrok Build 0.1Qwen1.5-72B
GPQA Diamond—28.8%
LMArena Expert—1136

Multilingual Not comparable

Grok Build 0.1: —, Qwen1.5-72B: 33.2 (#253)

Multilingual benchmarks
BenchmarkGrok Build 0.1Qwen1.5-72B
LMArena Non-English—1135
LMArena Chinese—1186
LMArena French—1159
LMArena German—1084
LMArena Japanese—1061
LMArena Korean—1050
LMArena Russian—1104
LMArena Spanish—1110

Instruction Following Not comparable

Grok Build 0.1: —, Qwen1.5-72B: 59.3 (#256)

Instruction Following benchmarks
BenchmarkGrok Build 0.1Qwen1.5-72B
LMArena Instruction Following—1141

Long Context Not comparable

Grok Build 0.1: —, Qwen1.5-72B: 35.1 (#243)

Long Context benchmarks
BenchmarkGrok Build 0.1Qwen1.5-72B
LMArena Longer Query—1157

Writing & Preference Not comparable

Grok Build 0.1: —, Qwen1.5-72B: 37.3 (#258)

Writing & Preference benchmarks
BenchmarkGrok Build 0.1Qwen1.5-72B
LMArena Text—1166
LMArena Creative Writing—1137
LMArena Multi-Turn—1160

Frequently asked questions

Is Grok Build 0.1 better than Qwen1.5-72B?

Grok Build 0.1 is the stronger model overall, scoring 36.4 to 30.8 on the Noometry Index.

Is Grok Build 0.1 or Qwen1.5-72B better for coding?

Grok Build 0.1 scores higher on coding benchmarks: 43.1 versus 31.9 in the Noometry coding category.

How many benchmarks do Grok Build 0.1 and Qwen1.5-72B share?

0 benchmarks have published results for both models. Grok Build 0.1 has 3 scored results on Noometry and Qwen1.5-72B has 22.

Related comparisons

Go deeper