Model comparison

Llama 2-70B vs Qwen3 8B

Qwen3 8B is the stronger model overall, scoring 33.7 to 24.4 on the Noometry Index.

Last verified . 4 shared benchmarks.

Llama 2-70B Meta

24.4

Rank #349 Confirmed

Qwen3 8B Alibaba (Qwen)

33.7

Rank #238 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Llama 2-70B scores higher in 0 categories and Qwen3 8B in 5 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3 8B leads 36.1 to 7.4.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 0% for Llama 2-70B and 56.1% for Qwen3 8B.

Side by side

Llama 2-70B and Qwen3 8B specifications
Llama 2-70BQwen3 8B
ProviderMetaAlibaba (Qwen)
Noometry Index24.433.7
Released2023-07-182025-04
WeightsOpenOpen
Context window—131K
Max output—8K
Input $ / M tokens—$0.18
Output $ / M tokens—$0.70
Results tracked3511

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3 8B leads

Llama 2-70B: 31.4 (#286), Qwen3 8B: 34.0 (#248)

Coding benchmarks
BenchmarkLlama 2-70BQwen3 8B
SciCode—22.6%
LMArena Coding1079—

Agentic & Tool Use Not comparable

Llama 2-70B: —, Qwen3 8B: 30.2 (#78)

Agentic & Tool Use benchmarks
BenchmarkLlama 2-70BQwen3 8B
Berkeley Function Calling Leaderboard—42.6%

Reasoning Qwen3 8B leads

Llama 2-70B: 14.4 (#325), Qwen3 8B: 16.6 (#303)

Reasoning benchmarks
BenchmarkLlama 2-70BQwen3 8B
DTBench41.6%59.7%
Epoch Capabilities Index113.79136.17
CritPt—0%
Chess Puzzles—5%
LMArena Hard Prompts1073—
LMCA—8.8%
BIG-Bench Hard64.9%—
CommonsenseQA 2.050%—
ForecastBench51.4—
HellaSwag85.3%—
LAMBADA78.9%—
PIQA82.8%—
WinoGrande80.2%—

Math Qwen3 8B leads

Llama 2-70B: 8.1 (#326), Qwen3 8B: 34.9 (#191)

Math benchmarks
BenchmarkLlama 2-70BQwen3 8B
OTIS Mock AIME 2024-20250%56.1%
LMArena Math1091—
MATH Level 53.3%—
GSM8K69.6%—

Knowledge Qwen3 8B leads

Llama 2-70B: 7.4 (#310), Qwen3 8B: 36.1 (#173)

Knowledge benchmarks
BenchmarkLlama 2-70BQwen3 8B
GPQA Diamond26.3%56.8%
Vectara Hallucination Rate—4.8%
LMArena Expert1039—
ARC (AI2) Challenge78.3%—
BoolQ88.6%—
MMLU69.9%—
OpenBookQA60.2%—
TriviaQA87.6%—

Multilingual Not comparable

Llama 2-70B: 27.7 (#274), Qwen3 8B: —

Multilingual benchmarks
BenchmarkLlama 2-70BQwen3 8B
LMArena Non-English1045—
LMArena Chinese995—
LMArena French1090—
LMArena German1041—
LMArena Japanese927—
LMArena Korean964—
LMArena Russian1083—
LMArena Spanish1143—

Instruction Following Not comparable

Llama 2-70B: 54.9 (#278), Qwen3 8B: —

Instruction Following benchmarks
BenchmarkLlama 2-70BQwen3 8B
LMArena Instruction Following1071—

Long Context Qwen3 8B leads

Llama 2-70B: 32.3 (#270), Qwen3 8B: 37.9 (#210)

Long Context benchmarks
BenchmarkLlama 2-70BQwen3 8B
Fiction.LiveBench—62.1%
LMArena Longer Query1062—

Writing & Preference Not comparable

Llama 2-70B: 32.3 (#279), Qwen3 8B: —

Writing & Preference benchmarks
BenchmarkLlama 2-70BQwen3 8B
LMArena Text1115—
LMArena Creative Writing1075—
LMArena Multi-Turn1088—

Frequently asked questions

Is Llama 2-70B better than Qwen3 8B?

Qwen3 8B is the stronger model overall, scoring 33.7 to 24.4 on the Noometry Index.

Is Llama 2-70B or Qwen3 8B better for coding?

Qwen3 8B scores higher on coding benchmarks: 34.0 versus 31.4 in the Noometry coding category.

How many benchmarks do Llama 2-70B and Qwen3 8B share?

4 benchmarks have published results for both models. Llama 2-70B has 35 scored results on Noometry and Qwen3 8B has 11.

Related comparisons

Go deeper