Model comparison

Llama 4 Scout vs Qwen3.5 Plus

Qwen3.5 Plus is the stronger model overall, scoring 42.3 to 27.4 on the Noometry Index. Llama 4 Scout costs 6.0× less per token, which makes it the better buy when Qwen3.5 Plus's lead doesn't matter for your workload.

Last verified . 7 shared benchmarks.

Llama 4 Scout Meta

27.4

Rank #323 Confirmed

Qwen3.5 Plus Alibaba (Qwen)

42.3

Rank #103 Confirmed

Summary

  • They share 7 benchmarks with published results for both. Llama 4 Scout scores higher in 0 categories and Qwen3.5 Plus in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen3.5 Plus leads 47.9 to 18.4.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 7.8% for Llama 4 Scout and 86.7% for Qwen3.5 Plus.
  • Llama 4 Scout is cheaper at $0.10 / $0.30 per million input/output tokens, against $0.40 / $2.40 for Qwen3.5 Plus.
  • Qwen3.5 Plus accepts more context: 1M tokens versus 128K.
  • Llama 4 Scout has downloadable open weights; the other is API-only.

Side by side

Llama 4 Scout and Qwen3.5 Plus specifications
Llama 4 ScoutQwen3.5 Plus
ProviderMetaAlibaba (Qwen)
Noometry Index27.442.3
Released2025-04-052026-02-16
WeightsOpenProprietary
Context window128K1M
Max output4K66K
Input $ / M tokens$0.10$0.40
Output $ / M tokens$0.30$2.40
Results tracked4315

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 4 Scout: 19.9 (#334), Qwen3.5 Plus: —

Coding benchmarks
BenchmarkLlama 4 ScoutQwen3.5 Plus
SWE-bench Verified (bash only)9.1%—
SciCode17%—
LMArena Coding1286—
BigCodeBench Complete43.1%—
ALE-Bench—621.92

Agentic & Tool Use Not comparable

Llama 4 Scout: 24.4 (#109), Qwen3.5 Plus: —

Agentic & Tool Use benchmarks
BenchmarkLlama 4 ScoutQwen3.5 Plus
Berkeley Function Calling Leaderboard28.1%—
Vending-Bench 2—0.54

Reasoning Qwen3.5 Plus leads

Llama 4 Scout: 9.2 (#339), Qwen3.5 Plus: 32.0 (#67)

Reasoning benchmarks
BenchmarkLlama 4 ScoutQwen3.5 Plus
DTBench57.9%80.5%
LMCA12%36.4%
Epoch Capabilities Index129.64146.79
ARC-AGI-20%—
Kagi LLM Benchmark36.9%—
ARC-AGI-10.5%—
CritPt0%—
Chess Puzzles—22%
LMArena Hard Prompts1266—
Mystery Game Puzzles—17%
ForecastBench57.5—

Math Qwen3.5 Plus leads

Llama 4 Scout: 18.4 (#280), Qwen3.5 Plus: 47.9 (#55)

Math benchmarks
BenchmarkLlama 4 ScoutQwen3.5 Plus
OTIS Mock AIME 2024-20257.8%86.7%
FrontierMath (Feb 2025 set)0%21%
Omni-MATH37.3%—
LMArena Math1286—
MATH Level 562.3%—
FrontierMath Tier 4 (v1)—2.1%

Knowledge Qwen3.5 Plus leads

Llama 4 Scout: 31.8 (#208), Qwen3.5 Plus: 46.0 (#78)

Knowledge benchmarks
BenchmarkLlama 4 ScoutQwen3.5 Plus
GPQA Diamond51.8%84.8%
Vectara Hallucination Rate7.7%10.7%
SimpleQA Verified—25.4%
MMLU-Pro74.2%—
GPQA (HELM)50.7%—
LMArena Expert1236—

Multimodal Not comparable

Llama 4 Scout: 31.6 (#98), Qwen3.5 Plus: —

Multimodal benchmarks
BenchmarkLlama 4 ScoutQwen3.5 Plus
LMArena Vision1118—
SpatialViz-Bench34.2%—

Multilingual Not comparable

Llama 4 Scout: 41.3 (#207), Qwen3.5 Plus: —

Multilingual benchmarks
BenchmarkLlama 4 ScoutQwen3.5 Plus
LMArena Non-English1253—
LMArena Chinese1256—
LMArena French1283—
LMArena German1274—
LMArena Japanese1209—
LMArena Korean1207—
LMArena Russian1263—
LMArena Spanish1277—

Instruction Following Not comparable

Llama 4 Scout: 66.0 (#212), Qwen3.5 Plus: —

Instruction Following benchmarks
BenchmarkLlama 4 ScoutQwen3.5 Plus
IFEval81.8%—
LMArena Instruction Following1248—

Long Context Qwen3.5 Plus leads

Llama 4 Scout: 27.5 (#289), Qwen3.5 Plus: 42.9 (#109)

Long Context benchmarks
BenchmarkLlama 4 ScoutQwen3.5 Plus
Fiction.LiveBench36%—
CL-bench—19.8%
CL-bench Life—12.4%
LMArena Longer Query1265—

Writing & Preference Not comparable

Llama 4 Scout: 37.1 (#256), Qwen3.5 Plus: —

Writing & Preference benchmarks
BenchmarkLlama 4 ScoutQwen3.5 Plus
LMArena Text1279—
LMArena Creative Writing1249—
EQ-Bench Creative Writing783—
WildBench78%—
LMArena Multi-Turn1281—

Frequently asked questions

Is Llama 4 Scout better than Qwen3.5 Plus?

Qwen3.5 Plus is the stronger model overall, scoring 42.3 to 27.4 on the Noometry Index. Llama 4 Scout costs 6.0× less per token, which makes it the better buy when Qwen3.5 Plus's lead doesn't matter for your workload.

Which is cheaper, Llama 4 Scout or Qwen3.5 Plus?

Llama 4 Scout is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; Qwen3.5 Plus lists at $0.40 and $2.40.

Which has the bigger context window?

Qwen3.5 Plus does, with 1M tokens against 128K.

How many benchmarks do Llama 4 Scout and Qwen3.5 Plus share?

7 benchmarks have published results for both models. Llama 4 Scout has 43 scored results on Noometry and Qwen3.5 Plus has 15.

Related comparisons

Go deeper