Model comparison

Llama 2-13B vs Qwen2.5-Max

Qwen2.5-Max is the stronger model overall, scoring 40.7 to 29.6 on the Noometry Index.

Last verified . 18 shared benchmarks.

Llama 2-13B Meta

29.6

Rank #309 Confirmed

Qwen2.5-Max Alibaba (Qwen)

40.7

Rank #146 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Llama 2-13B scores higher in 0 categories and Qwen2.5-Max in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen2.5-Max leads 55.4 to 29.8.
  • Llama 2-13B has downloadable open weights; the other is API-only.

Side by side

Llama 2-13B and Qwen2.5-Max specifications
Llama 2-13BQwen2.5-Max
ProviderMetaAlibaba (Qwen)
Noometry Index29.640.7
Released2023-07-182025-01-25
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked3227

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen2.5-Max leads

Llama 2-13B: 30.9 (#291), Qwen2.5-Max: 41.8 (#117)

Coding benchmarks
BenchmarkLlama 2-13BQwen2.5-Max
LMArena Coding10621359
LiveBench Coding—64.4%

Reasoning Qwen2.5-Max leads

Llama 2-13B: 12.8 (#337), Qwen2.5-Max: 25.6 (#147)

Reasoning benchmarks
BenchmarkLlama 2-13BQwen2.5-Max
LMArena Hard Prompts10511360
Epoch Capabilities Index106.17132.53
Chess Puzzles0%—
LiveBench Reasoning—51.4%
DTBench42.2%—
LiveBench Data Analysis—67.9%
BIG-Bench Hard58.2%—
HellaSwag80.7%—
LAMBADA76.5%—
LiveBench—62.3%
PIQA80.8%—
WinoGrande72.8%—

Math Qwen2.5-Max leads

Llama 2-13B: 31.1 (#229), Qwen2.5-Max: 36.9 (#162)

Math benchmarks
BenchmarkLlama 2-13BQwen2.5-Max
LMArena Math10651369
LiveBench Math—58.4%
GSM8K36.9%—

Knowledge Qwen2.5-Max leads

Llama 2-13B: 28.1 (#249), Qwen2.5-Max: 35.3 (#186)

Knowledge benchmarks
BenchmarkLlama 2-13BQwen2.5-Max
LMArena Expert10301337
Confabulations—21.8%
ARC (AI2) Challenge60.3%—
BoolQ82.4%—
MMLU55.6%—
OpenBookQA57%—
TriviaQA79.6%—

Multimodal Not comparable

Llama 2-13B: —, Qwen2.5-Max: —

Multimodal benchmarks
BenchmarkLlama 2-13BQwen2.5-Max
ScienceQA55.8%—

Multilingual Qwen2.5-Max leads

Llama 2-13B: 26.5 (#279), Qwen2.5-Max: 48.1 (#146)

Multilingual benchmarks
BenchmarkLlama 2-13BQwen2.5-Max
LMArena Non-English10241352
LMArena Chinese10011382
LMArena French10441396
LMArena German10091350
LMArena Japanese8941300
LMArena Korean9531304
LMArena Russian10551353
LMArena Spanish10871377

Instruction Following Qwen2.5-Max leads

Llama 2-13B: 53.3 (#287), Qwen2.5-Max: 71.3 (#152)

Instruction Following benchmarks
BenchmarkLlama 2-13BQwen2.5-Max
LMArena Instruction Following10451335
LiveBench Instruction Following—75.3%

Long Context Qwen2.5-Max leads

Llama 2-13B: 32.3 (#269), Qwen2.5-Max: 41.4 (#142)

Long Context benchmarks
BenchmarkLlama 2-13BQwen2.5-Max
LMArena Longer Query10641358

Writing & Preference Qwen2.5-Max leads

Llama 2-13B: 29.8 (#289), Qwen2.5-Max: 55.4 (#146)

Writing & Preference benchmarks
BenchmarkLlama 2-13BQwen2.5-Max
LMArena Text10841367
LMArena Creative Writing10471339
LMArena Multi-Turn10501364
Short-Story Creative Writing—72.9%
LiveBench Language—56.3%

Frequently asked questions

Is Llama 2-13B better than Qwen2.5-Max?

Qwen2.5-Max is the stronger model overall, scoring 40.7 to 29.6 on the Noometry Index.

Is Llama 2-13B or Qwen2.5-Max better for coding?

Qwen2.5-Max scores higher on coding benchmarks: 41.8 versus 30.9 in the Noometry coding category.

How many benchmarks do Llama 2-13B and Qwen2.5-Max share?

18 benchmarks have published results for both models. Llama 2-13B has 32 scored results on Noometry and Qwen2.5-Max has 27.

Related comparisons

Go deeper