Model comparison

Llama 2-7B vs Qwen3-1.7B

Llama 2-7B is the stronger model overall, scoring 28.6 to 26.2 on the Noometry Index.

Last verified . 1 shared benchmarks.

Llama 2-7B Meta

28.6

Rank #315 Confirmed

Qwen3-1.7B Alibaba (Qwen)

26.2

Rank #331 Reported

Summary

  • They share 1 benchmark with published results for both. Llama 2-7B scores higher in 2 categories and Qwen3-1.7B in 1 category; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where Llama 2-7B leads 28.2 to 15.4.

Side by side

Llama 2-7B and Qwen3-1.7B specifications
Llama 2-7BQwen3-1.7B
ProviderMetaAlibaba (Qwen)
Noometry Index28.626.2
Released2023-07-182025-04-29
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked294

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 2-7B: 28.7 (#302), Qwen3-1.7B: —

Coding benchmarks
BenchmarkLlama 2-7BQwen3-1.7B
LMArena Coding1002—

Agentic & Tool Use Not comparable

Llama 2-7B: —, Qwen3-1.7B: 24.5 (#108)

Agentic & Tool Use benchmarks
BenchmarkLlama 2-7BQwen3-1.7B
Berkeley Function Calling Leaderboard—28.4%

Reasoning Qwen3-1.7B leads

Llama 2-7B: 15.1 (#309), Qwen3-1.7B: 18.5 (#263)

Reasoning benchmarks
BenchmarkLlama 2-7BQwen3-1.7B
Chess Puzzles0%0%
LMArena Hard Prompts1009—
BIG-Bench Hard39.2%—
Epoch Capabilities Index98.54—
HellaSwag77.2%—
LAMBADA73.3%—
PIQA78.8%—
WinoGrande69.2%—

Math Llama 2-7B leads

Llama 2-7B: 28.2 (#231), Qwen3-1.7B: 15.4 (#288)

Math benchmarks
BenchmarkLlama 2-7BQwen3-1.7B
OTIS Mock AIME 2024-2025—8.1%
LMArena Math1042—
GSM8K16.7%—

Knowledge Llama 2-7B leads

Llama 2-7B: 27.7 (#243), Qwen3-1.7B: 19.6 (#273)

Knowledge benchmarks
BenchmarkLlama 2-7BQwen3-1.7B
GPQA Diamond—38%
LMArena Expert1036—
ARC (AI2) Challenge45.9%—
BoolQ77.9%—
MMLU45.8%—
OpenBookQA58.6%—
TriviaQA73.7%—

Multimodal Not comparable

Llama 2-7B: —, Qwen3-1.7B: —

Multimodal benchmarks
BenchmarkLlama 2-7BQwen3-1.7B
ScienceQA43.1%—

Multilingual Not comparable

Llama 2-7B: 23.9 (#288), Qwen3-1.7B: —

Multilingual benchmarks
BenchmarkLlama 2-7BQwen3-1.7B
LMArena Non-English973—
LMArena Chinese973—
LMArena French969—
LMArena German978—
LMArena Russian995—
LMArena Spanish1007—

Instruction Following Not comparable

Llama 2-7B: 51.0 (#293), Qwen3-1.7B: —

Instruction Following benchmarks
BenchmarkLlama 2-7BQwen3-1.7B
LMArena Instruction Following1006—

Long Context Not comparable

Llama 2-7B: 30.4 (#282), Qwen3-1.7B: —

Long Context benchmarks
BenchmarkLlama 2-7BQwen3-1.7B
LMArena Longer Query999—

Writing & Preference Not comparable

Llama 2-7B: 28.1 (#293), Qwen3-1.7B: —

Writing & Preference benchmarks
BenchmarkLlama 2-7BQwen3-1.7B
LMArena Text1053—
LMArena Creative Writing1033—
LMArena Multi-Turn1029—

Frequently asked questions

Is Llama 2-7B better than Qwen3-1.7B?

Llama 2-7B is the stronger model overall, scoring 28.6 to 26.2 on the Noometry Index.

How many benchmarks do Llama 2-7B and Qwen3-1.7B share?

1 benchmark has published results for both models. Llama 2-7B has 29 scored results on Noometry and Qwen3-1.7B has 4.

Related comparisons

Go deeper