Noometry

Model comparison

Llama 4 Scout vs Qwen3.5 Max Preview

Qwen3.5 Max Preview is the stronger model overall, scoring 44.7 to 27.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

Llama 4 Scout Meta

27.4

Rank #323 Confirmed

Qwen3.5 Max Preview Alibaba (Qwen)

44.7

Rank #72 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Llama 4 Scout scores higher in 0 categories and Qwen3.5 Max Preview in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3.5 Max Preview leads 66.1 to 37.1.
  • Llama 4 Scout has downloadable open weights; the other is API-only.

Side by side

Llama 4 ScoutQwen3.5 Max Preview
ProviderMetaAlibaba (Qwen)
Noometry Index27.444.7
Released2025-04-05—
WeightsOpenProprietary
Context window128K—
Max output4K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.30—
Results tracked4317

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5 Max Preview leads

Llama 4 Scout: 19.9 (#334), Qwen3.5 Max Preview: 43.4 (#79)

BenchmarkLlama 4 ScoutQwen3.5 Max Preview
LMArena Coding12861488
SWE-bench Verified (bash only)9.1%—
SciCode17%—
BigCodeBench Complete43.1%—

Agentic & Tool Use Not comparable

Llama 4 Scout: 24.4 (#109), Qwen3.5 Max Preview: —

BenchmarkLlama 4 ScoutQwen3.5 Max Preview
Berkeley Function Calling Leaderboard28.1%—

Reasoning Qwen3.5 Max Preview leads

Llama 4 Scout: 9.2 (#339), Qwen3.5 Max Preview: 29.6 (#81)

BenchmarkLlama 4 ScoutQwen3.5 Max Preview
LMArena Hard Prompts12661483
ARC-AGI-20%—
Kagi LLM Benchmark36.9%—
ARC-AGI-10.5%—
CritPt0%—
DTBench57.9%—
LMCA12%—
Epoch Capabilities Index129.64—
ForecastBench57.5—

Math Qwen3.5 Max Preview leads

Llama 4 Scout: 18.4 (#280), Qwen3.5 Max Preview: 37.3 (#99)

BenchmarkLlama 4 ScoutQwen3.5 Max Preview
LMArena Math12861473
OTIS Mock AIME 2024-20257.8%—
Omni-MATH37.3%—
MATH Level 562.3%—
FrontierMath (Feb 2025 set)0%—

Knowledge Qwen3.5 Max Preview leads

Llama 4 Scout: 31.8 (#208), Qwen3.5 Max Preview: 41.1 (#104)

BenchmarkLlama 4 ScoutQwen3.5 Max Preview
LMArena Expert12361489
GPQA Diamond51.8%—
MMLU-Pro74.2%—
Vectara Hallucination Rate7.7%—
GPQA (HELM)50.7%—

Multimodal Not comparable

Llama 4 Scout: 31.6 (#98), Qwen3.5 Max Preview: —

BenchmarkLlama 4 ScoutQwen3.5 Max Preview
LMArena Vision1118—
SpatialViz-Bench34.2%—

Multilingual Qwen3.5 Max Preview leads

Llama 4 Scout: 41.3 (#207), Qwen3.5 Max Preview: 56.4 (#21)

BenchmarkLlama 4 ScoutQwen3.5 Max Preview
LMArena Non-English12531465
LMArena Chinese12561534
LMArena French12831483
LMArena German12741487
LMArena Japanese12091497
LMArena Korean12071438
LMArena Russian12631472
LMArena Spanish12771470

Instruction Following Qwen3.5 Max Preview leads

Llama 4 Scout: 66.0 (#212), Qwen3.5 Max Preview: 77.2 (#28)

BenchmarkLlama 4 ScoutQwen3.5 Max Preview
LMArena Instruction Following12481467
IFEval81.8%—

Long Context Qwen3.5 Max Preview leads

Llama 4 Scout: 27.5 (#289), Qwen3.5 Max Preview: 45.2 (#44)

BenchmarkLlama 4 ScoutQwen3.5 Max Preview
LMArena Longer Query12651477
Fiction.LiveBench36%—

Writing & Preference Qwen3.5 Max Preview leads

Llama 4 Scout: 37.1 (#256), Qwen3.5 Max Preview: 66.1 (#39)

BenchmarkLlama 4 ScoutQwen3.5 Max Preview
LMArena Text12791471
LMArena Creative Writing12491464
LMArena Multi-Turn12811478
EQ-Bench Creative Writing783—
WildBench78%—

Frequently asked questions

Is Llama 4 Scout better than Qwen3.5 Max Preview?

Qwen3.5 Max Preview is the stronger model overall, scoring 44.7 to 27.4 on the Noometry Index.

Is Llama 4 Scout or Qwen3.5 Max Preview better for coding?

Qwen3.5 Max Preview scores higher on coding benchmarks: 43.4 versus 19.9 in the Noometry coding category.

How many benchmarks do Llama 4 Scout and Qwen3.5 Max Preview share?

17 benchmarks have published results for both models. Llama 4 Scout has 43 scored results on Noometry and Qwen3.5 Max Preview has 17.

Related comparisons

Go deeper