Model comparison

Llama 2-7B vs Qwen3-4B

Qwen3-4B is the stronger model overall, scoring 31.9 to 29.1 on the Noometry Index.

Last verified . 1 shared benchmarks.

Llama 2-7B Meta

29.1

Rank #317 Confirmed

Qwen3-4B Alibaba (Qwen)

31.9

Rank #264 Confirmed

Summary

  • They share 1 benchmark with published results for both. Llama 2-7B scores higher in 1 category and Qwen3-4B in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3-4B leads 33.0 to 28.2.

Side by side

Llama 2-7B and Qwen3-4B specifications
Llama 2-7BQwen3-4B
ProviderMetaAlibaba (Qwen)
Noometry Index29.131.9
Released2023-07-182025-04-29
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked296

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 2-7B: 29.2 (#307), Qwen3-4B: —

Coding benchmarks
BenchmarkLlama 2-7BQwen3-4B
LMArena Coding1002—

Agentic & Tool Use Not comparable

Llama 2-7B: —, Qwen3-4B: 27.6 (#100)

Agentic & Tool Use benchmarks
BenchmarkLlama 2-7BQwen3-4B
Berkeley Function Calling Leaderboard—35.7%

Reasoning Qwen3-4B leads

Llama 2-7B: 15.7 (#312), Qwen3-4B: 19.2 (#268)

Reasoning benchmarks
BenchmarkLlama 2-7BQwen3-4B
Chess Puzzles0%4%
LMArena Hard Prompts1009—
BIG-Bench Hard39.2%—
Epoch Capabilities Index99.06—
HellaSwag77.2%—
LAMBADA73.3%—
PIQA78.8%—
WinoGrande69.2%—

Math Too close to call

Llama 2-7B: 30.7 (#233), Qwen3-4B: 29.7 (#240)

Math benchmarks
BenchmarkLlama 2-7BQwen3-4B
MathArena Final-Answer Competitions—38.5%
OTIS Mock AIME 2024-2025—52.2%
LMArena Math1042—
GSM8K16.7%—

Knowledge Qwen3-4B leads

Llama 2-7B: 28.2 (#248), Qwen3-4B: 33.0 (#208)

Knowledge benchmarks
BenchmarkLlama 2-7BQwen3-4B
GPQA Diamond—52.3%
Vectara Hallucination Rate—5.7%
LMArena Expert1036—
ARC (AI2) Challenge45.9%—
BoolQ77.9%—
MMLU45.8%—
OpenBookQA58.6%—
TriviaQA73.7%—

Multimodal Not comparable

Llama 2-7B: —, Qwen3-4B: —

Multimodal benchmarks
BenchmarkLlama 2-7BQwen3-4B
ScienceQA43.1%—

Multilingual Not comparable

Llama 2-7B: 23.8 (#293), Qwen3-4B: —

Multilingual benchmarks
BenchmarkLlama 2-7BQwen3-4B
LMArena Non-English973—
LMArena Chinese973—
LMArena French970—
LMArena German978—
LMArena Russian995—
LMArena Spanish1007—

Instruction Following Not comparable

Llama 2-7B: 50.8 (#298), Qwen3-4B: —

Instruction Following benchmarks
BenchmarkLlama 2-7BQwen3-4B
LMArena Instruction Following1006—

Long Context Not comparable

Llama 2-7B: 30.4 (#287), Qwen3-4B: —

Long Context benchmarks
BenchmarkLlama 2-7BQwen3-4B
LMArena Longer Query999—

Writing & Preference Not comparable

Llama 2-7B: 28.0 (#298), Qwen3-4B: —

Writing & Preference benchmarks
BenchmarkLlama 2-7BQwen3-4B
LMArena Text1053—
LMArena Creative Writing1033—
LMArena Multi-Turn1029—

Frequently asked questions

Is Llama 2-7B better than Qwen3-4B?

Qwen3-4B is the stronger model overall, scoring 31.9 to 29.1 on the Noometry Index.

How many benchmarks do Llama 2-7B and Qwen3-4B share?

1 benchmark has published results for both models. Llama 2-7B has 29 scored results on Noometry and Qwen3-4B has 6.

Related comparisons

Go deeper