Model comparison

Llama 3-70B vs Qwen3.5-9B

Qwen3.5-9B is the stronger model overall, scoring 33.3 to 28.5 on the Noometry Index.

Last verified . 4 shared benchmarks.

Llama 3-70B Meta

28.5

Rank #317 Confirmed

Qwen3.5-9B Alibaba (Qwen)

33.3

Rank #235 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Llama 3-70B scores higher in 1 category and Qwen3.5-9B in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.5-9B leads 46.0 to 20.8.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.3% for Llama 3-70B and 61.7% for Qwen3.5-9B.

Side by side

Llama 3-70B and Qwen3.5-9B specifications
Llama 3-70BQwen3.5-9B
ProviderMetaAlibaba (Qwen)
Noometry Index28.533.3
Released2024-04-182026-02-23
WeightsOpenOpen
Context window—262K
Max output—66K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.15
Results tracked3110

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Llama 3-70B: 35.3 (#215), Qwen3.5-9B: 35.3 (#213)

Coding benchmarks
BenchmarkLlama 3-70BQwen3.5-9B
SciCode—27.5%
BigCodeBench Instruct43.6%—
LMArena Coding1206—
BigCodeBench Complete54.5%—
HumanEval+72%—
MBPP+69%—

Agentic & Tool Use Llama 3-70B leads

Llama 3-70B: 20.9 (#132), Qwen3.5-9B: 14.4 (#143)

Agentic & Tool Use benchmarks
BenchmarkLlama 3-70BQwen3.5-9B
Terminal-Bench—9.2%
Cybench5%—

Reasoning Qwen3.5-9B leads

Llama 3-70B: 17.4 (#284), Qwen3.5-9B: 22.5 (#178)

Reasoning benchmarks
BenchmarkLlama 3-70BQwen3.5-9B
DTBench54.2%71.2%
Epoch Capabilities Index122.91139.45
Kagi LLM Benchmark35.1%—
CritPt—0.3%
Chess Puzzles—12%
LMArena Hard Prompts1195—
LMCA—24.5%
ForecastBench57.1—
WinoGrande83.5%—

Math Qwen3.5-9B leads

Llama 3-70B: 12.0 (#299), Qwen3.5-9B: 33.5 (#174)

Math benchmarks
BenchmarkLlama 3-70BQwen3.5-9B
OTIS Mock AIME 2024-20254.3%61.7%
MathArena Final-Answer Competitions—48.5%
LMArena Math1218—
MATH Level 522.6%—

Knowledge Qwen3.5-9B leads

Llama 3-70B: 20.8 (#272), Qwen3.5-9B: 46.0 (#77)

Knowledge benchmarks
BenchmarkLlama 3-70BQwen3.5-9B
GPQA Diamond40.6%79%
LMArena Expert1149—
MMLU79.3%—

Multilingual Not comparable

Llama 3-70B: 33.8 (#246), Qwen3.5-9B: —

Multilingual benchmarks
BenchmarkLlama 3-70BQwen3.5-9B
LMArena Non-English1142—
LMArena Chinese1114—
LMArena French1231—
LMArena German1169—
LMArena Japanese1017—
LMArena Korean1017—
LMArena Russian1159—
LMArena Spanish1241—

Instruction Following Not comparable

Llama 3-70B: 62.8 (#233), Qwen3.5-9B: —

Instruction Following benchmarks
BenchmarkLlama 3-70BQwen3.5-9B
LMArena Instruction Following1194—

Long Context Not comparable

Llama 3-70B: 35.6 (#235), Qwen3.5-9B: —

Long Context benchmarks
BenchmarkLlama 3-70BQwen3.5-9B
LMArena Longer Query1174—

Writing & Preference Not comparable

Llama 3-70B: 43.0 (#225), Qwen3.5-9B: —

Writing & Preference benchmarks
BenchmarkLlama 3-70BQwen3.5-9B
LMArena Text1221—
LMArena Creative Writing1210—
LMArena Multi-Turn1223—

Frequently asked questions

Is Llama 3-70B better than Qwen3.5-9B?

Qwen3.5-9B is the stronger model overall, scoring 33.3 to 28.5 on the Noometry Index.

Is Llama 3-70B or Qwen3.5-9B better for coding?

They score almost the same on coding (35.3 vs 35.3); test both on your own repository before choosing.

How many benchmarks do Llama 3-70B and Qwen3.5-9B share?

4 benchmarks have published results for both models. Llama 3-70B has 31 scored results on Noometry and Qwen3.5-9B has 10.

Related comparisons

Go deeper