Noometry

Model comparison

Grok 4.1 Fast vs Qwen3.7 Plus

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 41.4 on the Noometry Index. Grok 4.1 Fast costs 2.5× less per token, which makes it the better buy when Qwen3.7 Plus's lead doesn't matter for your workload.

Last verified . 20 shared benchmarks.

Grok 4.1 Fast xAI

41.4

Rank #136 Confirmed

Qwen3.7 Plus Alibaba (Qwen)

45.3

Rank #72 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Grok 4.1 Fast scores higher in 2 categories and Qwen3.7 Plus in 8 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.7 Plus leads 54.9 to 33.1.
  • The biggest single-benchmark swing is NYT Connections (extended): 87.4% for Grok 4.1 Fast and 74.8% for Qwen3.7 Plus.
  • Grok 4.1 Fast is cheaper at $0.20 / $0.50 per million input/output tokens, against $0.40 / $1.60 for Qwen3.7 Plus.
  • Qwen3.7 Plus accepts more context: 1M tokens versus 128K.

Side by side

Grok 4.1 FastQwen3.7 Plus
ProviderxAIAlibaba (Qwen)
Noometry Index41.445.3
Released2025-06-272026-06-02
WeightsProprietaryProprietary
Context window128K1M
Max output30K131K
Input $ / M tokens$0.20$0.40
Output $ / M tokens$0.50$1.60
Results tracked3232

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.7 Plus leads

Grok 4.1 Fast: 34.1 (#245), Qwen3.7 Plus: 36.6 (#206)

BenchmarkGrok 4.1 FastQwen3.7 Plus
LMArena Coding14111473
FrontierCode—10.2%
LMArena WebDev1242—
SciCode—45.5%
ALE-Bench394.93—

Agentic & Tool Use Grok 4.1 Fast leads

Grok 4.1 Fast: 36.3 (#39), Qwen3.7 Plus: 21.4 (#138)

BenchmarkGrok 4.1 FastQwen3.7 Plus
Berkeley Function Calling Leaderboard69.6%—
OSWorld 2.0—2.8%
τ²-bench Banking13.1%—
LMArena Search1171—
Vending-Bench 21,107—

Reasoning Grok 4.1 Fast leads

Grok 4.1 Fast: 43.4 (#49), Qwen3.7 Plus: 39.3 (#59)

BenchmarkGrok 4.1 FastQwen3.7 Plus
NYT Connections (extended)87.4%74.8%
LMArena Hard Prompts14071460
DTBench87.7%84%
SimpleBench56%—
CritPt—9.1%
Chess Puzzles—24%
Mystery Game Puzzles—17%
LMCA—37.6%
Epoch Capabilities Index—147.37
ForecastBench61—

Math Qwen3.7 Plus leads

Grok 4.1 Fast: 31.9 (#221), Qwen3.7 Plus: 50.5 (#56)

BenchmarkGrok 4.1 FastQwen3.7 Plus
LMArena Math14081466
FrontierMath (Tiers 1-3)—34.4%
MathArena Final-Answer Competitions60.9%—
OTIS Mock AIME 2024-2025—93.3%
ProofBench4%—

Knowledge Qwen3.7 Plus leads

Grok 4.1 Fast: 33.1 (#207), Qwen3.7 Plus: 54.9 (#51)

BenchmarkGrok 4.1 FastQwen3.7 Plus
LMArena Expert13991467
GPQA Diamond—87.9%
Vectara Hallucination Rate17.8%—

Multimodal Qwen3.7 Plus leads

Grok 4.1 Fast: 37.0 (#76), Qwen3.7 Plus: 41.8 (#33)

BenchmarkGrok 4.1 FastQwen3.7 Plus
LMArena Vision12011279
LMArena Document—1444

Multilingual Qwen3.7 Plus leads

Grok 4.1 Fast: 51.0 (#114), Qwen3.7 Plus: 54.8 (#38)

BenchmarkGrok 4.1 FastQwen3.7 Plus
LMArena Non-English13911445
LMArena Chinese14411510
LMArena French14151473
LMArena German14041471
LMArena Japanese13491413
LMArena Korean13611415
LMArena Russian13871457
LMArena Spanish14131457

Instruction Following Qwen3.7 Plus leads

Grok 4.1 Fast: 72.7 (#133), Qwen3.7 Plus: 75.8 (#52)

BenchmarkGrok 4.1 FastQwen3.7 Plus
LMArena Instruction Following13761440

Long Context Qwen3.7 Plus leads

Grok 4.1 Fast: 42.4 (#126), Qwen3.7 Plus: 44.5 (#65)

BenchmarkGrok 4.1 FastQwen3.7 Plus
LMArena Longer Query13901455

Writing & Preference Qwen3.7 Plus leads

Grok 4.1 Fast: 57.2 (#131), Qwen3.7 Plus: 64.3 (#56)

BenchmarkGrok 4.1 FastQwen3.7 Plus
LMArena Text14081455
LMArena Creative Writing13941439
LMArena Multi-Turn13891460
EQ-Bench Creative Writing1327—

Frequently asked questions

Is Grok 4.1 Fast better than Qwen3.7 Plus?

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 41.4 on the Noometry Index. Grok 4.1 Fast costs 2.5× less per token, which makes it the better buy when Qwen3.7 Plus's lead doesn't matter for your workload.

Which is cheaper, Grok 4.1 Fast or Qwen3.7 Plus?

Grok 4.1 Fast is cheaper. It lists at $0.20 per million input tokens and $0.50 per million output tokens; Qwen3.7 Plus lists at $0.40 and $1.60.

Is Grok 4.1 Fast or Qwen3.7 Plus better for coding?

Qwen3.7 Plus scores higher on coding benchmarks: 36.6 versus 34.1 in the Noometry coding category.

Which has the bigger context window?

Qwen3.7 Plus does, with 1M tokens against 128K.

How many benchmarks do Grok 4.1 Fast and Qwen3.7 Plus share?

20 benchmarks have published results for both models. Grok 4.1 Fast has 32 scored results on Noometry and Qwen3.7 Plus has 32.

Related comparisons

Go deeper