Model comparison

Grok 2 Mini 2024 08 13 vs Qwen3.7 Flash

Qwen3.7 Flash is the stronger model overall, scoring 39.9 to 37.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Grok 2 Mini 2024 08 13 xAI

37.7

Rank #198 Confirmed

Qwen3.7 Flash Alibaba (Qwen)

39.9

Rank #156 Confirmed

Summary

  • The widest gap is in knowledge, where Qwen3.7 Flash leads 48.9 to 33.9.

Side by side

Grok 2 Mini 2024 08 13 and Qwen3.7 Flash specifications
Grok 2 Mini 2024 08 13Qwen3.7 Flash
ProviderxAIAlibaba (Qwen)
Noometry Index37.739.9
Released2024-08-132026-07-15
WeightsProprietaryProprietary
Context window—1M
Max output—131K
Input $ / M tokens—$0.03
Output $ / M tokens—$0.13
Results tracked177

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Grok 2 Mini 2024 08 13: 37.0 (#199), Qwen3.7 Flash: —

Coding benchmarks
BenchmarkGrok 2 Mini 2024 08 13Qwen3.7 Flash
LMArena Coding1269—

Reasoning Qwen3.7 Flash leads

Grok 2 Mini 2024 08 13: 24.8 (#159), Qwen3.7 Flash: 28.2 (#108)

Reasoning benchmarks
BenchmarkGrok 2 Mini 2024 08 13Qwen3.7 Flash
NYT Connections (extended)—43.8%
Chess Puzzles—23%
LMArena Hard Prompts1255—
Mystery Game Puzzles—15%
Epoch Capabilities Index—144.64

Math Qwen3.7 Flash leads

Grok 2 Mini 2024 08 13: 35.4 (#185), Qwen3.7 Flash: 38.3 (#140)

Math benchmarks
BenchmarkGrok 2 Mini 2024 08 13Qwen3.7 Flash
FrontierMath (Tiers 1-3)—19.3%
OTIS Mock AIME 2024-2025—86.7%
LMArena Math1265—

Knowledge Qwen3.7 Flash leads

Grok 2 Mini 2024 08 13: 33.9 (#200), Qwen3.7 Flash: 48.9 (#75)

Knowledge benchmarks
BenchmarkGrok 2 Mini 2024 08 13Qwen3.7 Flash
GPQA Diamond—82.3%
LMArena Expert1238—

Multilingual Not comparable

Grok 2 Mini 2024 08 13: 41.4 (#208), Qwen3.7 Flash: —

Multilingual benchmarks
BenchmarkGrok 2 Mini 2024 08 13Qwen3.7 Flash
LMArena Non-English1257—
LMArena Chinese1262—
LMArena French1286—
LMArena German1273—
LMArena Japanese1213—
LMArena Korean1195—
LMArena Russian1261—
LMArena Spanish1279—

Instruction Following Not comparable

Grok 2 Mini 2024 08 13: 65.5 (#220), Qwen3.7 Flash: —

Instruction Following benchmarks
BenchmarkGrok 2 Mini 2024 08 13Qwen3.7 Flash
LMArena Instruction Following1245—

Long Context Not comparable

Grok 2 Mini 2024 08 13: 38.4 (#196), Qwen3.7 Flash: —

Long Context benchmarks
BenchmarkGrok 2 Mini 2024 08 13Qwen3.7 Flash
LMArena Longer Query1266—

Writing & Preference Not comparable

Grok 2 Mini 2024 08 13: 47.3 (#211), Qwen3.7 Flash: —

Writing & Preference benchmarks
BenchmarkGrok 2 Mini 2024 08 13Qwen3.7 Flash
LMArena Text1281—
LMArena Creative Writing1242—
LMArena Multi-Turn1265—

Frequently asked questions

Is Grok 2 Mini 2024 08 13 better than Qwen3.7 Flash?

Qwen3.7 Flash is the stronger model overall, scoring 39.9 to 37.7 on the Noometry Index.

How many benchmarks do Grok 2 Mini 2024 08 13 and Qwen3.7 Flash share?

0 benchmarks have published results for both models. Grok 2 Mini 2024 08 13 has 17 scored results on Noometry and Qwen3.7 Flash has 7.

Related comparisons

Go deeper