Noometry

Model comparison

Llama 3.1-8B vs Qwen3.5 Max Preview

Qwen3.5 Max Preview is the stronger model overall, scoring 44.7 to 22.8 on the Noometry Index.

Last verified . 17 shared benchmarks.

Llama 3.1-8B Meta

22.8

Rank #347 Confirmed

Qwen3.5 Max Preview Alibaba (Qwen)

44.7

Rank #72 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Llama 3.1-8B scores higher in 0 categories and Qwen3.5 Max Preview in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3.5 Max Preview leads 66.1 to 29.9.
  • Llama 3.1-8B has downloadable open weights; the other is API-only.

Side by side

Llama 3.1-8BQwen3.5 Max Preview
ProviderMetaAlibaba (Qwen)
Noometry Index22.844.7
Released2024-07-23—
WeightsOpenProprietary
Context window128K—
Max output4K—
Input $ / M tokens$0.05—
Output $ / M tokens$0.08—
Results tracked4317

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5 Max Preview leads

Llama 3.1-8B: 19.9 (#335), Qwen3.5 Max Preview: 43.4 (#79)

BenchmarkLlama 3.1-8BQwen3.5 Max Preview
LMArena Coding11951488
SciCode13.2%—
WeirdML1.7%—
BigCodeBench Instruct32.8%—
BigCodeBench Complete40.5%—
HumanEval+62.8%—
MBPP+55.6%—

Agentic & Tool Use Not comparable

Llama 3.1-8B: 22.3 (#123), Qwen3.5 Max Preview: —

BenchmarkLlama 3.1-8BQwen3.5 Max Preview
Berkeley Function Calling Leaderboard25.8%—
BALROG15.1%—

Reasoning Qwen3.5 Max Preview leads

Llama 3.1-8B: 14.5 (#316), Qwen3.5 Max Preview: 29.6 (#81)

BenchmarkLlama 3.1-8BQwen3.5 Max Preview
LMArena Hard Prompts11751483
CritPt0%—
Chess Puzzles0%—
DTBench50.9%—
LMCA5.4%—
Epoch Capabilities Index116.48—
PIQA81.2%—

Math Qwen3.5 Max Preview leads

Llama 3.1-8B: 9.5 (#311), Qwen3.5 Max Preview: 37.3 (#99)

BenchmarkLlama 3.1-8BQwen3.5 Max Preview
LMArena Math11791473
OTIS Mock AIME 2024-20251.7%—
Omni-MATH13.7%—
MATH Level 522.9%—
GSM8K82.4%—

Knowledge Qwen3.5 Max Preview leads

Llama 3.1-8B: 8.0 (#302), Qwen3.5 Max Preview: 41.1 (#104)

BenchmarkLlama 3.1-8BQwen3.5 Max Preview
LMArena Expert11441489
GPQA Diamond27%—
MMLU-Pro40.6%—
GPQA (HELM)24.7%—
BoolQ82.8%—
MMLU56.1%—

Multilingual Qwen3.5 Max Preview leads

Llama 3.1-8B: 34.2 (#244), Qwen3.5 Max Preview: 56.4 (#21)

BenchmarkLlama 3.1-8BQwen3.5 Max Preview
LMArena Non-English11481465
LMArena Chinese11511534
LMArena French11761483
LMArena German11441487
LMArena Japanese10611497
LMArena Korean10531438
LMArena Russian11581472
LMArena Spanish11691470

Instruction Following Qwen3.5 Max Preview leads

Llama 3.1-8B: 59.1 (#253), Qwen3.5 Max Preview: 77.2 (#28)

BenchmarkLlama 3.1-8BQwen3.5 Max Preview
LMArena Instruction Following11591467
IFEval74.3%—

Long Context Qwen3.5 Max Preview leads

Llama 3.1-8B: 35.8 (#233), Qwen3.5 Max Preview: 45.2 (#44)

BenchmarkLlama 3.1-8BQwen3.5 Max Preview
LMArena Longer Query11821477

Writing & Preference Qwen3.5 Max Preview leads

Llama 3.1-8B: 29.9 (#285), Qwen3.5 Max Preview: 66.1 (#39)

BenchmarkLlama 3.1-8BQwen3.5 Max Preview
LMArena Text11871471
LMArena Creative Writing11541464
LMArena Multi-Turn11721478
EQ-Bench Creative Writing713—
WildBench68.7%—

Frequently asked questions

Is Llama 3.1-8B better than Qwen3.5 Max Preview?

Qwen3.5 Max Preview is the stronger model overall, scoring 44.7 to 22.8 on the Noometry Index.

Is Llama 3.1-8B or Qwen3.5 Max Preview better for coding?

Qwen3.5 Max Preview scores higher on coding benchmarks: 43.4 versus 19.9 in the Noometry coding category.

How many benchmarks do Llama 3.1-8B and Qwen3.5 Max Preview share?

17 benchmarks have published results for both models. Llama 3.1-8B has 43 scored results on Noometry and Qwen3.5 Max Preview has 17.

Related comparisons

Go deeper