Noometry

Model comparison

Llama 4 Maverick vs Qwen3.7 Flash

Qwen3.7 Flash is the stronger model overall, scoring 39.5 to 30.6 on the Noometry Index.

Last verified . 4 shared benchmarks.

Llama 4 Maverick Meta

30.6

Rank #276 Confirmed

Qwen3.7 Flash Alibaba (Qwen)

39.5

Rank #152 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Llama 4 Maverick scores higher in 0 categories and Qwen3.7 Flash in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Qwen3.7 Flash leads 27.3 to 10.1.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 20.6% for Llama 4 Maverick and 86.7% for Qwen3.7 Flash.
  • Qwen3.7 Flash is cheaper at $0.03 / $0.13 per million input/output tokens, against $0.19 / $0.65 for Llama 4 Maverick.
  • Qwen3.7 Flash accepts more context: 1M tokens versus 128K.
  • Llama 4 Maverick has downloadable open weights; the other is API-only.

Side by side

Llama 4 MaverickQwen3.7 Flash
ProviderMetaAlibaba (Qwen)
Noometry Index30.639.5
Released2025-04-052026-07-15
WeightsOpenProprietary
Context window128K1M
Max output4K131K
Input $ / M tokens$0.19$0.03
Output $ / M tokens$0.65$0.13
Results tracked547

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 4 Maverick: 26.3 (#318), Qwen3.7 Flash: —

BenchmarkLlama 4 MaverickQwen3.7 Flash
SWE-bench Verified (bash only)21%—
Aider Polyglot15.6%—
SciCode33.1%—
WeirdML24.5%—
BigCodeBench Instruct49.7%—
LMArena Coding1302—
BigCodeBench Complete61.4%—
ALE-Bench172.97—

Agentic & Tool Use Not comparable

Llama 4 Maverick: 27.9 (#86), Qwen3.7 Flash: —

BenchmarkLlama 4 MaverickQwen3.7 Flash
Berkeley Function Calling Leaderboard37.3%—

Reasoning Qwen3.7 Flash leads

Llama 4 Maverick: 10.1 (#337), Qwen3.7 Flash: 27.3 (#108)

BenchmarkLlama 4 MaverickQwen3.7 Flash
NYT Connections (extended)8%43.8%
Epoch Capabilities Index132.2144.62
ARC-AGI-20%—
SimpleBench27.7%—
Kagi LLM Benchmark55.9%—
ARC-AGI-14.4%—
CritPt0%—
Chess Puzzles—23%
EnigmaEval0.6%—
LMArena Hard Prompts1281—
Mystery Game Puzzles—15%
DTBench61.9%—
LMCA15.9%—
ForecastBench57.5—

Math Qwen3.7 Flash leads

Llama 4 Maverick: 24.6 (#256), Qwen3.7 Flash: 37.3 (#100)

BenchmarkLlama 4 MaverickQwen3.7 Flash
OTIS Mock AIME 2024-202520.6%86.7%
FrontierMath (Tiers 1-3)—19.3%
Omni-MATH42.2%—
LMArena Math1299—
MATH Level 573%—
FrontierMath (Feb 2025 set)0.7%—

Knowledge Qwen3.7 Flash leads

Llama 4 Maverick: 33.3 (#196), Qwen3.7 Flash: 48.9 (#69)

BenchmarkLlama 4 MaverickQwen3.7 Flash
GPQA Diamond67%82.3%
Humanity's Last Exam5.7%—
MMLU-Pro81%—
Confabulations22.6%—
Vectara Hallucination Rate8.2%—
GPQA (HELM)65%—
LMArena Expert1259—

Multimodal Not comparable

Llama 4 Maverick: 30.9 (#100), Qwen3.7 Flash: —

BenchmarkLlama 4 MaverickQwen3.7 Flash
LMArena Vision1141—
GeoBench52%—
SpatialViz-Bench31.8%—

Multilingual Not comparable

Llama 4 Maverick: 42.4 (#190), Qwen3.7 Flash: —

BenchmarkLlama 4 MaverickQwen3.7 Flash
LMArena Non-English1269—
LMArena Chinese1277—
LMArena French1258—
LMArena German1291—
LMArena Japanese1207—
LMArena Korean1203—
LMArena Russian1286—
LMArena Spanish1293—

Instruction Following Not comparable

Llama 4 Maverick: 71.9 (#140), Qwen3.7 Flash: —

BenchmarkLlama 4 MaverickQwen3.7 Flash
IFEval90.8%—
LMArena Instruction Following1267—

Long Context Not comparable

Llama 4 Maverick: 31.4 (#274), Qwen3.7 Flash: —

BenchmarkLlama 4 MaverickQwen3.7 Flash
Fiction.LiveBench46.2%—
LMArena Longer Query1280—

Writing & Preference Not comparable

Llama 4 Maverick: 39.0 (#247), Qwen3.7 Flash: —

BenchmarkLlama 4 MaverickQwen3.7 Flash
LMArena Text1287—
LMArena Creative Writing1266—
Short-Story Creative Writing62%—
EQ-Bench Creative Writing860—
WildBench80%—
LMArena Multi-Turn1289—

Frequently asked questions

Is Llama 4 Maverick better than Qwen3.7 Flash?

Qwen3.7 Flash is the stronger model overall, scoring 39.5 to 30.6 on the Noometry Index.

Which is cheaper, Llama 4 Maverick or Qwen3.7 Flash?

Qwen3.7 Flash is cheaper. It lists at $0.03 per million input tokens and $0.13 per million output tokens; Llama 4 Maverick lists at $0.19 and $0.65.

Which has the bigger context window?

Qwen3.7 Flash does, with 1M tokens against 128K.

How many benchmarks do Llama 4 Maverick and Qwen3.7 Flash share?

4 benchmarks have published results for both models. Llama 4 Maverick has 54 scored results on Noometry and Qwen3.7 Flash has 7.

Related comparisons

Go deeper