Model comparison

Qwen Turbo vs Qwen2-72B

Qwen2-72B is the stronger model overall, scoring 30.0 to 27.1 on the Noometry Index.

Last verified . 2 shared benchmarks.

Qwen Turbo Alibaba (Qwen)

27.1

Rank #335 Reported

Qwen2-72B Alibaba (Qwen)

30.0

Rank #300 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Qwen Turbo scores higher in 1 category and Qwen2-72B in 1 category; 2 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen2-72B leads 30.2 to 15.3.
  • The biggest single-benchmark swing is MATH Level 5: 56.2% for Qwen Turbo and 39.1% for Qwen2-72B.
  • Qwen2-72B has downloadable open weights; the other is API-only.

Side by side

Qwen Turbo and Qwen2-72B specifications
Qwen TurboQwen2-72B
ProviderAlibaba (Qwen)Alibaba (Qwen)
Noometry Index27.130.0
Released2024-11-012024-06-07
WeightsProprietaryOpen
Context window1M—
Max output16K—
Input $ / M tokens$0.05—
Output $ / M tokens$0.20—
Results tracked326

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Qwen Turbo: —, Qwen2-72B: 29.1 (#310)

Coding benchmarks
BenchmarkQwen TurboQwen2-72B
WeirdML—11.3%
BigCodeBench Instruct—38.5%
LMArena Coding—1196
BigCodeBench Complete—54%

Agentic & Tool Use Not comparable

Qwen Turbo: —, Qwen2-72B: 17.0 (#146)

Agentic & Tool Use benchmarks
BenchmarkQwen TurboQwen2-72B
TheAgentCompany—1.1%
METR Time Horizons—29.9%

Reasoning Not comparable

Qwen Turbo: —, Qwen2-72B: 23.2 (#181)

Reasoning benchmarks
BenchmarkQwen TurboQwen2-72B
LMArena Hard Prompts—1191
Epoch Capabilities Index—125.28

Math Qwen2-72B leads

Qwen Turbo: 15.3 (#297), Qwen2-72B: 30.2 (#236)

Math benchmarks
BenchmarkQwen TurboQwen2-72B
MATH Level 556.2%39.1%
OTIS Mock AIME 2024-20256.1%—
LMArena Math—1235

Knowledge Qwen Turbo leads

Qwen Turbo: 22.2 (#272), Qwen2-72B: 21.2 (#275)

Knowledge benchmarks
BenchmarkQwen TurboQwen2-72B
GPQA Diamond41.8%40.8%
LMArena Expert—1171
MMLU—82.4%

Multilingual Not comparable

Qwen Turbo: —, Qwen2-72B: 35.9 (#244)

Multilingual benchmarks
BenchmarkQwen TurboQwen2-72B
LMArena Non-English—1176
LMArena Chinese—1240
LMArena French—1170
LMArena German—1151
LMArena Japanese—1111
LMArena Korean—1083
LMArena Russian—1169
LMArena Spanish—1169

Instruction Following Not comparable

Qwen Turbo: —, Qwen2-72B: 61.7 (#241)

Instruction Following benchmarks
BenchmarkQwen TurboQwen2-72B
LMArena Instruction Following—1181

Long Context Not comparable

Qwen Turbo: —, Qwen2-72B: 36.1 (#235)

Long Context benchmarks
BenchmarkQwen TurboQwen2-72B
LMArena Longer Query—1192

Writing & Preference Not comparable

Qwen Turbo: —, Qwen2-72B: 40.8 (#241)

Writing & Preference benchmarks
BenchmarkQwen TurboQwen2-72B
LMArena Text—1203
LMArena Creative Writing—1181
LMArena Multi-Turn—1196

Frequently asked questions

Is Qwen Turbo better than Qwen2-72B?

Qwen2-72B is the stronger model overall, scoring 30.0 to 27.1 on the Noometry Index.

How many benchmarks do Qwen Turbo and Qwen2-72B share?

2 benchmarks have published results for both models. Qwen Turbo has 3 scored results on Noometry and Qwen2-72B has 26.

Related comparisons

Go deeper