Model comparison
Llama 13b vs Qwen Turbo
Qwen Turbo is the stronger model overall, scoring 26.8 to 23.9 on the Noometry Index.
Last verified . 0 shared benchmarks.
Meta
Alibaba (Qwen)Summary
- The widest gap is in math, where Llama 13b leads 24.4 to 14.5.
- Llama 13b has downloadable open weights; the other is API-only.
Side by side
| Llama 13b | Qwen Turbo | |
|---|---|---|
| Provider | Meta | Alibaba (Qwen) |
| Noometry Index | 23.9 | 26.8 |
| Released | 2023-02-24 | 2024-11-01 |
| Weights | Open | Proprietary |
| Context window | — | 1M |
| Max output | — | 16K |
| Input $ / M tokens | — | $0.05 |
| Output $ / M tokens | — | $0.20 |
| Results tracked | 21 | 3 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Not comparable
Llama 13b: 20.9 (#332), Qwen Turbo: —
| Benchmark | Llama 13b | Qwen Turbo |
|---|---|---|
| LMArena Coding | 683 | — |
Reasoning Not comparable
Llama 13b: 13.4 (#327), Qwen Turbo: —
| Benchmark | Llama 13b | Qwen Turbo |
|---|---|---|
| LMArena Hard Prompts | 728 | — |
| BIG-Bench Hard | 37.9% | — |
| Epoch Capabilities Index | 100.09 | — |
| HellaSwag | 79.2% | — |
| LAMBADA | 75.2% | — |
| PIQA | 80.1% | — |
| WinoGrande | 73% | — |
Math Llama 13b leads
Llama 13b: 24.4 (#259), Qwen Turbo: 14.5 (#291)
| Benchmark | Llama 13b | Qwen Turbo |
|---|---|---|
| OTIS Mock AIME 2024-2025 | — | 6.1% |
| LMArena Math | 838 | — |
| MATH Level 5 | — | 56.2% |
| GSM8K | 20.6% | — |
Knowledge Not comparable
Llama 13b: —, Qwen Turbo: 22.2 (#267)
| Benchmark | Llama 13b | Qwen Turbo |
|---|---|---|
| GPQA Diamond | — | 41.8% |
| ARC (AI2) Challenge | 52.7% | — |
| BoolQ | 78.7% | — |
| MMLU | 47.7% | — |
| OpenBookQA | 56.4% | — |
| TriviaQA | 77.9% | — |
Multimodal Not comparable
Llama 13b: —, Qwen Turbo: —
| Benchmark | Llama 13b | Qwen Turbo |
|---|---|---|
| ScienceQA | 43.3% | — |
Multilingual Not comparable
Llama 13b: 16.8 (#292), Qwen Turbo: —
| Benchmark | Llama 13b | Qwen Turbo |
|---|---|---|
| LMArena Non-English | 819 | — |
Instruction Following Not comparable
Llama 13b: 36.9 (#300), Qwen Turbo: —
| Benchmark | Llama 13b | Qwen Turbo |
|---|---|---|
| LMArena Instruction Following | 781 | — |
Writing & Preference Not comparable
Llama 13b: 13.9 (#307), Qwen Turbo: —
| Benchmark | Llama 13b | Qwen Turbo |
|---|---|---|
| LMArena Text | 834 | — |
| LMArena Creative Writing | 794 | — |
| LMArena Multi-Turn | 753 | — |
Frequently asked questions
Is Llama 13b better than Qwen Turbo?
Qwen Turbo is the stronger model overall, scoring 26.8 to 23.9 on the Noometry Index.
How many benchmarks do Llama 13b and Qwen Turbo share?
0 benchmarks have published results for both models. Llama 13b has 21 scored results on Noometry and Qwen Turbo has 3.