Model comparison

Llama 2-34B vs Qwen2.5-VL 72B Instruct

Qwen2.5-VL 72B Instruct has enough public results to be ranked (#302); Llama 2-34B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Llama 2-34B Meta

—

Unranked

Summary

  • Qwen2.5-VL 72B Instruct has downloadable open weights; the other is API-only.

Side by side

Llama 2-34B and Qwen2.5-VL 72B Instruct specifications
Llama 2-34BQwen2.5-VL 72B Instruct
ProviderMetaAlibaba (Qwen)
Noometry Index—29.9
Released2023-07-182024-09
WeightsProprietaryOpen
Context window—131K
Max output—8K
Input $ / M tokens—$2.80
Output $ / M tokens—$8.40
Results tracked106

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Agentic & Tool Use Not comparable

Llama 2-34B: —, Qwen2.5-VL 72B Instruct: 18.6 (#144)

Agentic & Tool Use benchmarks
BenchmarkLlama 2-34BQwen2.5-VL 72B Instruct
OSWorld—5%

Reasoning Not comparable

Llama 2-34B: —, Qwen2.5-VL 72B Instruct: 20.7 (#233)

Reasoning benchmarks
BenchmarkLlama 2-34BQwen2.5-VL 72B Instruct
Kagi LLM Benchmark—36%
BIG-Bench Hard44.1%—
Epoch Capabilities Index105.2—
PIQA81.9%—
WinoGrande76.7%—

Math Not comparable

Llama 2-34B: —, Qwen2.5-VL 72B Instruct: —

Math benchmarks
BenchmarkLlama 2-34BQwen2.5-VL 72B Instruct
GSM8K42.2%—

Knowledge Not comparable

Llama 2-34B: —, Qwen2.5-VL 72B Instruct: —

Knowledge benchmarks
BenchmarkLlama 2-34BQwen2.5-VL 72B Instruct
ARC (AI2) Challenge54.5%—
BoolQ83.7%—
MMLU62.6%—
OpenBookQA58.2%—
TriviaQA84.6%—

Multimodal Not comparable

Llama 2-34B: —, Qwen2.5-VL 72B Instruct: 33.5 (#97)

Multimodal benchmarks
BenchmarkLlama 2-34BQwen2.5-VL 72B Instruct
LMArena Vision—1107
Video-MME—73.5%
GeoBench—62%
SpatialViz-Bench—33.3%

Frequently asked questions

Is Llama 2-34B better than Qwen2.5-VL 72B Instruct?

Qwen2.5-VL 72B Instruct has enough public results to be ranked (#302); Llama 2-34B does not yet, so treat this comparison as directional.

How many benchmarks do Llama 2-34B and Qwen2.5-VL 72B Instruct share?

0 benchmarks have published results for both models. Llama 2-34B has 10 scored results on Noometry and Qwen2.5-VL 72B Instruct has 6.

Related comparisons

Go deeper