Noometry

Model comparison

Llama 4 Scout vs Qwen3.7 Flash

Qwen3.7 Flash is the stronger model overall, scoring 39.9 to 27.7 on the Noometry Index.

Last verified . 3 shared benchmarks.

Llama 4 Scout Meta

27.7

Rank #330 Confirmed

Qwen3.7 Flash Alibaba (Qwen)

39.9

Rank #156 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Llama 4 Scout scores higher in 0 categories and Qwen3.7 Flash in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Qwen3.7 Flash leads 28.2 to 9.1.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 7.8% for Llama 4 Scout and 86.7% for Qwen3.7 Flash.
  • Qwen3.7 Flash is cheaper at $0.03 / $0.13 per million input/output tokens, against $0.10 / $0.30 for Llama 4 Scout.
  • Qwen3.7 Flash accepts more context: 1M tokens versus 128K.
  • Llama 4 Scout has downloadable open weights; the other is API-only.

Side by side

Llama 4 ScoutQwen3.7 Flash
ProviderMetaAlibaba (Qwen)
Noometry Index27.739.9
Released2025-04-052026-07-15
WeightsOpenProprietary
Context window128K1M
Max output4K131K
Input $ / M tokens$0.10$0.03
Output $ / M tokens$0.30$0.13
Results tracked437

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 4 Scout: 20.2 (#339), Qwen3.7 Flash: —

BenchmarkLlama 4 ScoutQwen3.7 Flash
SWE-bench Verified (bash only)9.1%—
SciCode17%—
LMArena Coding1286—
BigCodeBench Complete43.1%—

Agentic & Tool Use Not comparable

Llama 4 Scout: 24.6 (#119), Qwen3.7 Flash: —

BenchmarkLlama 4 ScoutQwen3.7 Flash
Berkeley Function Calling Leaderboard28.1%—

Reasoning Qwen3.7 Flash leads

Llama 4 Scout: 9.1 (#345), Qwen3.7 Flash: 28.2 (#108)

BenchmarkLlama 4 ScoutQwen3.7 Flash
Epoch Capabilities Index129.64144.64
ARC-AGI-20%—
Kagi LLM Benchmark36.9%—
NYT Connections (extended)—43.8%
ARC-AGI-10.5%—
CritPt0%—
Chess Puzzles—23%
LMArena Hard Prompts1266—
Mystery Game Puzzles—15%
DTBench57.9%—
LMCA12%—
ForecastBench57.5—

Math Qwen3.7 Flash leads

Llama 4 Scout: 19.6 (#286), Qwen3.7 Flash: 38.3 (#140)

BenchmarkLlama 4 ScoutQwen3.7 Flash
OTIS Mock AIME 2024-20257.8%86.7%
FrontierMath (Tiers 1-3)—19.3%
Omni-MATH37.3%—
LMArena Math1287—
MATH Level 562.3%—
FrontierMath (Feb 2025 set)0%—

Knowledge Qwen3.7 Flash leads

Llama 4 Scout: 31.9 (#217), Qwen3.7 Flash: 48.9 (#75)

BenchmarkLlama 4 ScoutQwen3.7 Flash
GPQA Diamond51.8%82.3%
MMLU-Pro74.2%—
Vectara Hallucination Rate7.7%—
GPQA (HELM)50.7%—
LMArena Expert1235—

Multimodal Not comparable

Llama 4 Scout: 32.2 (#102), Qwen3.7 Flash: —

BenchmarkLlama 4 ScoutQwen3.7 Flash
LMArena Vision1118—
SpatialViz-Bench34.2%—

Multilingual Not comparable

Llama 4 Scout: 41.0 (#212), Qwen3.7 Flash: —

BenchmarkLlama 4 ScoutQwen3.7 Flash
LMArena Non-English1252—
LMArena Chinese1255—
LMArena French1282—
LMArena German1272—
LMArena Japanese1206—
LMArena Korean1207—
LMArena Russian1263—
LMArena Spanish1278—

Instruction Following Not comparable

Llama 4 Scout: 65.8 (#217), Qwen3.7 Flash: —

BenchmarkLlama 4 ScoutQwen3.7 Flash
IFEval81.8%—
LMArena Instruction Following1248—

Long Context Not comparable

Llama 4 Scout: 27.5 (#294), Qwen3.7 Flash: —

BenchmarkLlama 4 ScoutQwen3.7 Flash
Fiction.LiveBench36%—
LMArena Longer Query1265—

Writing & Preference Not comparable

Llama 4 Scout: 37.0 (#261), Qwen3.7 Flash: —

BenchmarkLlama 4 ScoutQwen3.7 Flash
LMArena Text1279—
LMArena Creative Writing1249—
EQ-Bench Creative Writing783—
WildBench78%—
LMArena Multi-Turn1280—

Frequently asked questions

Is Llama 4 Scout better than Qwen3.7 Flash?

Qwen3.7 Flash is the stronger model overall, scoring 39.9 to 27.7 on the Noometry Index.

Which is cheaper, Llama 4 Scout or Qwen3.7 Flash?

Qwen3.7 Flash is cheaper. It lists at $0.03 per million input tokens and $0.13 per million output tokens; Llama 4 Scout lists at $0.10 and $0.30.

Which has the bigger context window?

Qwen3.7 Flash does, with 1M tokens against 128K.

How many benchmarks do Llama 4 Scout and Qwen3.7 Flash share?

3 benchmarks have published results for both models. Llama 4 Scout has 43 scored results on Noometry and Qwen3.7 Flash has 7.

Related comparisons

Go deeper