Model comparison

Grok 4.1 vs Qwen3.5 Max Preview

Qwen3.5 Max Preview is the stronger model overall, scoring 44.7 to 40.8 on the Noometry Index.

Last verified . 17 shared benchmarks.

Grok 4.1 xAI

40.8

Rank #135 Confirmed

Qwen3.5 Max Preview Alibaba (Qwen)

44.7

Rank #72 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Grok 4.1 scores higher in 0 categories and Qwen3.5 Max Preview in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Qwen3.5 Max Preview leads 43.4 to 33.4.

Side by side

Grok 4.1 and Qwen3.5 Max Preview specifications
Grok 4.1Qwen3.5 Max Preview
ProviderxAIAlibaba (Qwen)
Noometry Index40.844.7
Released2025-11-17—
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1917

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5 Max Preview leads

Grok 4.1: 33.4 (#246), Qwen3.5 Max Preview: 43.4 (#79)

Coding benchmarks
BenchmarkGrok 4.1Qwen3.5 Max Preview
LMArena Coding14451488
LMArena WebDev1214—

Agentic & Tool Use Not comparable

Grok 4.1: 33.8 (#47), Qwen3.5 Max Preview: —

Agentic & Tool Use benchmarks
BenchmarkGrok 4.1Qwen3.5 Max Preview
Cybench39%—

Reasoning Qwen3.5 Max Preview leads

Grok 4.1: 28.3 (#91), Qwen3.5 Max Preview: 29.6 (#81)

Reasoning benchmarks
BenchmarkGrok 4.1Qwen3.5 Max Preview
LMArena Hard Prompts14361483

Math Qwen3.5 Max Preview leads

Grok 4.1: 36.2 (#124), Qwen3.5 Max Preview: 37.3 (#99)

Math benchmarks
BenchmarkGrok 4.1Qwen3.5 Max Preview
LMArena Math14221473

Knowledge Qwen3.5 Max Preview leads

Grok 4.1: 38.9 (#129), Qwen3.5 Max Preview: 41.1 (#104)

Knowledge benchmarks
BenchmarkGrok 4.1Qwen3.5 Max Preview
LMArena Expert14171489

Multilingual Qwen3.5 Max Preview leads

Grok 4.1: 53.6 (#64), Qwen3.5 Max Preview: 56.4 (#21)

Multilingual benchmarks
BenchmarkGrok 4.1Qwen3.5 Max Preview
LMArena Non-English14251465
LMArena Chinese14641534
LMArena French14481483
LMArena German14471487
LMArena Japanese13961497
LMArena Korean14071438
LMArena Russian14341472
LMArena Spanish14381470

Instruction Following Qwen3.5 Max Preview leads

Grok 4.1: 74.0 (#106), Qwen3.5 Max Preview: 77.2 (#28)

Instruction Following benchmarks
BenchmarkGrok 4.1Qwen3.5 Max Preview
LMArena Instruction Following14001467

Long Context Qwen3.5 Max Preview leads

Grok 4.1: 43.2 (#96), Qwen3.5 Max Preview: 45.2 (#44)

Long Context benchmarks
BenchmarkGrok 4.1Qwen3.5 Max Preview
LMArena Longer Query14161477

Writing & Preference Qwen3.5 Max Preview leads

Grok 4.1: 62.6 (#71), Qwen3.5 Max Preview: 66.1 (#39)

Writing & Preference benchmarks
BenchmarkGrok 4.1Qwen3.5 Max Preview
LMArena Text14371471
LMArena Creative Writing14111464
LMArena Multi-Turn14381478

Frequently asked questions

Is Grok 4.1 better than Qwen3.5 Max Preview?

Qwen3.5 Max Preview is the stronger model overall, scoring 44.7 to 40.8 on the Noometry Index.

Is Grok 4.1 or Qwen3.5 Max Preview better for coding?

Qwen3.5 Max Preview scores higher on coding benchmarks: 43.4 versus 33.4 in the Noometry coding category.

How many benchmarks do Grok 4.1 and Qwen3.5 Max Preview share?

17 benchmarks have published results for both models. Grok 4.1 has 19 scored results on Noometry and Qwen3.5 Max Preview has 17.

Related comparisons

Go deeper