Model comparison

Grok Build 0.1 vs Qwen1.5-32B

Grok Build 0.1 is the stronger model overall, scoring 36.4 to 30.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

Grok Build 0.1 xAI

36.4

Rank #216 Reported

Qwen1.5-32B Alibaba (Qwen)

30.5

Rank #293 Confirmed

Summary

  • The widest gap is in coding, where Grok Build 0.1 leads 43.1 to 31.7.
  • Qwen1.5-32B has downloadable open weights; the other is API-only.

Side by side

Grok Build 0.1 and Qwen1.5-32B specifications
Grok Build 0.1Qwen1.5-32B
ProviderxAIAlibaba (Qwen)
Noometry Index36.430.5
Released2026-04-162024-02-04
WeightsProprietaryOpen
Context window256K—
Max output256K—
Input $ / M tokens$1—
Output $ / M tokens$2—
Results tracked321

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok Build 0.1 leads

Grok Build 0.1: 43.1 (#91), Qwen1.5-32B: 31.7 (#282)

Coding benchmarks
BenchmarkGrok Build 0.1Qwen1.5-32B
SciCode50.2%—
BigCodeBench Instruct—32.3%
LMArena Coding—1155
BigCodeBench Complete—42%

Agentic & Tool Use Not comparable

Grok Build 0.1: 22.7 (#129), Qwen1.5-32B: —

Agentic & Tool Use benchmarks
BenchmarkGrok Build 0.1Qwen1.5-32B
GBAEval2.4%—

Reasoning Grok Build 0.1 leads

Grok Build 0.1: 32.2 (#77), Qwen1.5-32B: 21.8 (#212)

Reasoning benchmarks
BenchmarkGrok Build 0.1Qwen1.5-32B
CritPt9.1%—
LMArena Hard Prompts—1130

Math Not comparable

Grok Build 0.1: —, Qwen1.5-32B: 33.0 (#207)

Math benchmarks
BenchmarkGrok Build 0.1Qwen1.5-32B
LMArena Math—1155

Knowledge Not comparable

Grok Build 0.1: —, Qwen1.5-32B: 13.5 (#296)

Knowledge benchmarks
BenchmarkGrok Build 0.1Qwen1.5-32B
GPQA Diamond—30.7%
LMArena Expert—1126
MMLU—74.4%

Multilingual Not comparable

Grok Build 0.1: —, Qwen1.5-32B: 31.4 (#259)

Multilingual benchmarks
BenchmarkGrok Build 0.1Qwen1.5-32B
LMArena Non-English—1106
LMArena Chinese—1177
LMArena French—1101
LMArena German—1058
LMArena Japanese—1027
LMArena Korean—1008
LMArena Russian—1073
LMArena Spanish—1089

Instruction Following Not comparable

Grok Build 0.1: —, Qwen1.5-32B: 57.7 (#265)

Instruction Following benchmarks
BenchmarkGrok Build 0.1Qwen1.5-32B
LMArena Instruction Following—1116

Long Context Not comparable

Grok Build 0.1: —, Qwen1.5-32B: 34.7 (#246)

Long Context benchmarks
BenchmarkGrok Build 0.1Qwen1.5-32B
LMArena Longer Query—1146

Writing & Preference Not comparable

Grok Build 0.1: —, Qwen1.5-32B: 34.2 (#271)

Writing & Preference benchmarks
BenchmarkGrok Build 0.1Qwen1.5-32B
LMArena Text—1137
LMArena Creative Writing—1083
LMArena Multi-Turn—1140

Frequently asked questions

Is Grok Build 0.1 better than Qwen1.5-32B?

Grok Build 0.1 is the stronger model overall, scoring 36.4 to 30.5 on the Noometry Index.

Is Grok Build 0.1 or Qwen1.5-32B better for coding?

Grok Build 0.1 scores higher on coding benchmarks: 43.1 versus 31.7 in the Noometry coding category.

How many benchmarks do Grok Build 0.1 and Qwen1.5-32B share?

0 benchmarks have published results for both models. Grok Build 0.1 has 3 scored results on Noometry and Qwen1.5-32B has 21.

Related comparisons

Go deeper