Noometry

Model comparison

Grok-2 (Dec 2024) vs Qwen3.5 122B-A10B

Qwen3.5 122B-A10B is the stronger model overall, scoring 41.6 to 33.4 on the Noometry Index.

Last verified . 18 shared benchmarks.

Grok-2 (Dec 2024) xAI

33.4

Rank #233 Confirmed

Qwen3.5 122B-A10B Alibaba (Qwen)

41.6

Rank #120 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Grok-2 (Dec 2024) scores higher in 0 categories and Qwen3.5 122B-A10B in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen3.5 122B-A10B leads 36.4 to 19.6.
  • The biggest single-benchmark swing is DTBench: 65.2% for Grok-2 (Dec 2024) and 84.3% for Qwen3.5 122B-A10B.
  • Qwen3.5 122B-A10B has downloadable open weights; the other is API-only.

Side by side

Grok-2 (Dec 2024)Qwen3.5 122B-A10B
ProviderxAIAlibaba (Qwen)
Noometry Index33.441.6
Released2024-08-132026-02-23
WeightsProprietaryOpen
Context window—262K
Max output—66K
Input $ / M tokens—$0.40
Output $ / M tokens—$3.20
Results tracked3427

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5 122B-A10B leads

Grok-2 (Dec 2024): 32.9 (#254), Qwen3.5 122B-A10B: 38.8 (#155)

BenchmarkGrok-2 (Dec 2024)Qwen3.5 122B-A10B
LMArena Coding12881436
LMArena WebDev—1360
SciCode—35.6%
WeirdML22.2%—
LiveBench Coding46.4%—

Reasoning Qwen3.5 122B-A10B leads

Grok-2 (Dec 2024): 16.4 (#294), Qwen3.5 122B-A10B: 26.4 (#121)

BenchmarkGrok-2 (Dec 2024)Qwen3.5 122B-A10B
LMArena Hard Prompts12721421
DTBench65.2%84.3%
SimpleBench22.7%—
NYT Connections (extended)—51.7%
CritPt—0.9%
Thematic Generalization—51.2%
LiveBench Reasoning54.8%—
Mystery Game Puzzles—17%
LiveBench Data Analysis54.5%—
LMCA—32.2%
Epoch Capabilities Index130.48—
LiveBench54.3%—

Math Qwen3.5 122B-A10B leads

Grok-2 (Dec 2024): 19.6 (#278), Qwen3.5 122B-A10B: 36.4 (#114)

BenchmarkGrok-2 (Dec 2024)Qwen3.5 122B-A10B
LMArena Math12831432
OTIS Mock AIME 2024-202511.5%—
LiveBench Math54.9%—
MATH Level 563.5%—
FrontierMath (Feb 2025 set)0.7%—

Knowledge Qwen3.5 122B-A10B leads

Grok-2 (Dec 2024): 29.8 (#225), Qwen3.5 122B-A10B: 38.2 (#138)

BenchmarkGrok-2 (Dec 2024)Qwen3.5 122B-A10B
LMArena Expert12541431
GPQA Diamond53.8%—
Confabulations20.1%—
Vectara Hallucination Rate—11.2%

Multimodal Not comparable

Grok-2 (Dec 2024): —, Qwen3.5 122B-A10B: 39.0 (#52)

BenchmarkGrok-2 (Dec 2024)Qwen3.5 122B-A10B
LMArena Vision—1245

Multilingual Qwen3.5 122B-A10B leads

Grok-2 (Dec 2024): 43.3 (#183), Qwen3.5 122B-A10B: 51.8 (#101)

BenchmarkGrok-2 (Dec 2024)Qwen3.5 122B-A10B
LMArena Non-English12821400
LMArena Chinese12891462
LMArena French13171442
LMArena German12871425
LMArena Japanese12441364
LMArena Korean12371353
LMArena Russian12861400
LMArena Spanish12811423

Instruction Following Qwen3.5 122B-A10B leads

Grok-2 (Dec 2024): 67.1 (#197), Qwen3.5 122B-A10B: 74.0 (#109)

BenchmarkGrok-2 (Dec 2024)Qwen3.5 122B-A10B
LMArena Instruction Following12701399
LiveBench Instruction Following69.6%—

Long Context Qwen3.5 122B-A10B leads

Grok-2 (Dec 2024): 38.7 (#186), Qwen3.5 122B-A10B: 43.0 (#105)

BenchmarkGrok-2 (Dec 2024)Qwen3.5 122B-A10B
LMArena Longer Query12761410

Writing & Preference Qwen3.5 122B-A10B leads

Grok-2 (Dec 2024): 48.8 (#192), Qwen3.5 122B-A10B: 60.2 (#98)

BenchmarkGrok-2 (Dec 2024)Qwen3.5 122B-A10B
LMArena Text13051417
LMArena Creative Writing12841369
LMArena Multi-Turn12901416
Short-Story Creative Writing63.6%—
LiveBench Language45.6%—

Frequently asked questions

Is Grok-2 (Dec 2024) better than Qwen3.5 122B-A10B?

Qwen3.5 122B-A10B is the stronger model overall, scoring 41.6 to 33.4 on the Noometry Index.

Is Grok-2 (Dec 2024) or Qwen3.5 122B-A10B better for coding?

Qwen3.5 122B-A10B scores higher on coding benchmarks: 38.8 versus 32.9 in the Noometry coding category.

How many benchmarks do Grok-2 (Dec 2024) and Qwen3.5 122B-A10B share?

18 benchmarks have published results for both models. Grok-2 (Dec 2024) has 34 scored results on Noometry and Qwen3.5 122B-A10B has 27.

Related comparisons

Go deeper