Model comparison

Grok 4.1 Fast vs Qwen2.5 32B Instruct

Grok 4.1 Fast is the stronger model overall, scoring 40.9 to 29.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Grok 4.1 Fast xAI

40.9

Rank #131 Confirmed

Qwen2.5 32B Instruct Alibaba (Qwen)

29.7

Rank #291 Confirmed

Summary

  • The widest gap is in reasoning, where Grok 4.1 Fast leads 42.3 to 18.5.
  • Grok 4.1 Fast is cheaper at $0.20 / $0.50 per million input/output tokens, against $0.70 / $2.80 for Qwen2.5 32B Instruct.
  • Qwen2.5 32B Instruct accepts more context: 131K tokens versus 128K.
  • Qwen2.5 32B Instruct has downloadable open weights; the other is API-only.

Side by side

Grok 4.1 Fast and Qwen2.5 32B Instruct specifications
Grok 4.1 FastQwen2.5 32B Instruct
ProviderxAIAlibaba (Qwen)
Noometry Index40.929.7
Released2025-06-272024-09
WeightsProprietaryOpen
Context window128K131K
Max output30K8K
Input $ / M tokens$0.20$0.70
Output $ / M tokens$0.50$2.80
Results tracked327

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen2.5 32B Instruct leads

Grok 4.1 Fast: 33.8 (#236), Qwen2.5 32B Instruct: 38.1 (#165)

Coding benchmarks
BenchmarkGrok 4.1 FastQwen2.5 32B Instruct
LMArena WebDev1241—
BigCodeBench Instruct—45%
LMArena Coding1411—
BigCodeBench Complete—52.3%
ALE-Bench394.93—

Agentic & Tool Use Not comparable

Grok 4.1 Fast: 36.1 (#35), Qwen2.5 32B Instruct: —

Agentic & Tool Use benchmarks
BenchmarkGrok 4.1 FastQwen2.5 32B Instruct
Berkeley Function Calling Leaderboard69.6%—
τ²-bench Banking13.1%—
LMArena Search1171—
Vending-Bench 21,107—

Reasoning Grok 4.1 Fast leads

Grok 4.1 Fast: 42.3 (#45), Qwen2.5 32B Instruct: 18.5 (#262)

Reasoning benchmarks
BenchmarkGrok 4.1 FastQwen2.5 32B Instruct
SimpleBench56%—
NYT Connections (extended)87.4%—
Chess Puzzles—0%
LMArena Hard Prompts1407—
DTBench87.7%—
Epoch Capabilities Index—128.52
ForecastBench61—

Math Grok 4.1 Fast leads

Grok 4.1 Fast: 30.9 (#201), Qwen2.5 32B Instruct: 15.3 (#289)

Math benchmarks
BenchmarkGrok 4.1 FastQwen2.5 32B Instruct
MathArena Final-Answer Competitions60.9%—
OTIS Mock AIME 2024-2025—7.4%
ProofBench4%—
LMArena Math1408—
MATH Level 5—56.1%

Knowledge Grok 4.1 Fast leads

Grok 4.1 Fast: 32.6 (#203), Qwen2.5 32B Instruct: 24.9 (#259)

Knowledge benchmarks
BenchmarkGrok 4.1 FastQwen2.5 32B Instruct
GPQA Diamond—46.1%
Vectara Hallucination Rate17.8%—
LMArena Expert1398—

Multimodal Not comparable

Grok 4.1 Fast: 36.3 (#71), Qwen2.5 32B Instruct: —

Multimodal benchmarks
BenchmarkGrok 4.1 FastQwen2.5 32B Instruct
LMArena Vision1201—

Multilingual Not comparable

Grok 4.1 Fast: 51.1 (#110), Qwen2.5 32B Instruct: —

Multilingual benchmarks
BenchmarkGrok 4.1 FastQwen2.5 32B Instruct
LMArena Non-English1391—
LMArena Chinese1441—
LMArena French1416—
LMArena German1404—
LMArena Japanese1347—
LMArena Korean1361—
LMArena Russian1387—
LMArena Spanish1411—

Instruction Following Not comparable

Grok 4.1 Fast: 72.8 (#127), Qwen2.5 32B Instruct: —

Instruction Following benchmarks
BenchmarkGrok 4.1 FastQwen2.5 32B Instruct
LMArena Instruction Following1376—

Long Context Not comparable

Grok 4.1 Fast: 42.4 (#121), Qwen2.5 32B Instruct: —

Long Context benchmarks
BenchmarkGrok 4.1 FastQwen2.5 32B Instruct
LMArena Longer Query1390—

Writing & Preference Not comparable

Grok 4.1 Fast: 57.4 (#126), Qwen2.5 32B Instruct: —

Writing & Preference benchmarks
BenchmarkGrok 4.1 FastQwen2.5 32B Instruct
LMArena Text1408—
LMArena Creative Writing1394—
EQ-Bench Creative Writing1327—
LMArena Multi-Turn1389—

Frequently asked questions

Is Grok 4.1 Fast better than Qwen2.5 32B Instruct?

Grok 4.1 Fast is the stronger model overall, scoring 40.9 to 29.7 on the Noometry Index.

Which is cheaper, Grok 4.1 Fast or Qwen2.5 32B Instruct?

Grok 4.1 Fast is cheaper. It lists at $0.20 per million input tokens and $0.50 per million output tokens; Qwen2.5 32B Instruct lists at $0.70 and $2.80.

Is Grok 4.1 Fast or Qwen2.5 32B Instruct better for coding?

Qwen2.5 32B Instruct scores higher on coding benchmarks: 38.1 versus 33.8 in the Noometry coding category.

Which has the bigger context window?

Qwen2.5 32B Instruct does, with 131K tokens against 128K.

How many benchmarks do Grok 4.1 Fast and Qwen2.5 32B Instruct share?

0 benchmarks have published results for both models. Grok 4.1 Fast has 32 scored results on Noometry and Qwen2.5 32B Instruct has 7.

Related comparisons

Go deeper