Noometry

Model comparison

Grok 4 Fast vs Qwen2.5-VL 72B Instruct

Grok 4 Fast is the stronger model overall, scoring 39.4 to 29.9 on the Noometry Index.

Last verified . 1 shared benchmarks.

Grok 4 Fast xAI

39.4

Rank #167 Confirmed

Qwen2.5-VL 72B Instruct Alibaba (Qwen)

29.9

Rank #302 Confirmed

Summary

  • They share 1 benchmark with published results for both. Grok 4 Fast scores higher in 2 categories and Qwen2.5-VL 72B Instruct in 0 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in agentic & tool use, where Grok 4 Fast leads 29.5 to 18.6.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 66.1% for Grok 4 Fast and 36% for Qwen2.5-VL 72B Instruct.
  • Qwen2.5-VL 72B Instruct has downloadable open weights; the other is API-only.

Side by side

Grok 4 FastQwen2.5-VL 72B Instruct
ProviderxAIAlibaba (Qwen)
Noometry Index39.429.9
Released2025-09-192024-09
WeightsProprietaryOpen
Context window—131K
Max output—8K
Input $ / M tokens—$2.80
Output $ / M tokens—$8.40
Results tracked306

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Grok 4 Fast: 32.5 (#271), Qwen2.5-VL 72B Instruct: —

BenchmarkGrok 4 FastQwen2.5-VL 72B Instruct
LMArena WebDev1159—
WeirdML42.9%—
LMArena Coding1429—

Agentic & Tool Use Grok 4 Fast leads

Grok 4 Fast: 29.5 (#86), Qwen2.5-VL 72B Instruct: 18.6 (#144)

BenchmarkGrok 4 FastQwen2.5-VL 72B Instruct
τ²-bench Banking15.7%—
Cybench30%—
OSWorld—5%
LMArena Search1171—

Reasoning Grok 4 Fast leads

Grok 4 Fast: 22.2 (#201), Qwen2.5-VL 72B Instruct: 20.7 (#233)

BenchmarkGrok 4 FastQwen2.5-VL 72B Instruct
Kagi LLM Benchmark66.1%36%
ARC-AGI-25.3%—
ARC-AGI-148.5%—
LMArena Hard Prompts1412—
DTBench82.7%—
Epoch Capabilities Index144.2—
ForecastBench60.5—

Math Not comparable

Grok 4 Fast: 38.9 (#123), Qwen2.5-VL 72B Instruct: —

BenchmarkGrok 4 FastQwen2.5-VL 72B Instruct
LMArena Math1419—

Knowledge Not comparable

Grok 4 Fast: 32.0 (#214), Qwen2.5-VL 72B Instruct: —

BenchmarkGrok 4 FastQwen2.5-VL 72B Instruct
Vectara Hallucination Rate19.7%—
LMArena Expert1411—

Multimodal Not comparable

Grok 4 Fast: —, Qwen2.5-VL 72B Instruct: 33.5 (#97)

BenchmarkGrok 4 FastQwen2.5-VL 72B Instruct
LMArena Vision—1107
Video-MME—73.5%
GeoBench—62%
SpatialViz-Bench—33.3%

Multilingual Not comparable

Grok 4 Fast: 51.3 (#111), Qwen2.5-VL 72B Instruct: —

BenchmarkGrok 4 FastQwen2.5-VL 72B Instruct
LMArena Non-English1396—
LMArena Chinese1457—
LMArena French1431—
LMArena German1383—
LMArena Japanese1352—
LMArena Korean1357—
LMArena Russian1389—
LMArena Spanish1415—

Instruction Following Not comparable

Grok 4 Fast: 73.2 (#121), Qwen2.5-VL 72B Instruct: —

BenchmarkGrok 4 FastQwen2.5-VL 72B Instruct
LMArena Instruction Following1387—

Long Context Not comparable

Grok 4 Fast: 63.2 (#3), Qwen2.5-VL 72B Instruct: —

BenchmarkGrok 4 FastQwen2.5-VL 72B Instruct
Fiction.LiveBench94.4%—
LMArena Longer Query1415—

Writing & Preference Not comparable

Grok 4 Fast: 60.0 (#102), Qwen2.5-VL 72B Instruct: —

BenchmarkGrok 4 FastQwen2.5-VL 72B Instruct
LMArena Text1407—
LMArena Creative Writing1387—
LMArena Multi-Turn1414—

Frequently asked questions

Is Grok 4 Fast better than Qwen2.5-VL 72B Instruct?

Grok 4 Fast is the stronger model overall, scoring 39.4 to 29.9 on the Noometry Index.

How many benchmarks do Grok 4 Fast and Qwen2.5-VL 72B Instruct share?

1 benchmark has published results for both models. Grok 4 Fast has 30 scored results on Noometry and Qwen2.5-VL 72B Instruct has 6.

Related comparisons

Go deeper