Model comparison
Llama 13b vs Magistral Small
Magistral Small is the stronger model overall, scoring 30.2 to 24.4 on the Noometry Index.
Last verified . 1 shared benchmarks.
Meta
Mistral AISummary
- They share 1 benchmark with published results for both. Llama 13b scores higher in 2 categories and Magistral Small in 1 category; 2 gaps are clear of the uncertainty.
- The widest gap is in coding, where Magistral Small leads 38.4 to 21.4.
Side by side
| Llama 13b | Magistral Small | |
|---|---|---|
| Provider | Meta | Mistral AI |
| Noometry Index | 24.4 | 30.2 |
| Released | 2023-02-24 | 2025-06-10 |
| Weights | Open | Open |
| Context window | — | 128K |
| Max output | — | 40K |
| Input $ / M tokens | — | $0.50 |
| Output $ / M tokens | — | $1.50 |
| Results tracked | 21 | 10 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Magistral Small leads
Llama 13b: 21.4 (#337), Magistral Small: 38.4 (#176)
| Benchmark | Llama 13b | Magistral Small |
|---|---|---|
| SciCode | — | 35.2% |
| LMArena Coding | 683 | — |
Reasoning Llama 13b leads
Llama 13b: 14.0 (#329), Magistral Small: 6.8 (#350)
| Benchmark | Llama 13b | Magistral Small |
|---|---|---|
| Epoch Capabilities Index | 100.58 | 133.19 |
| ARC-AGI-2 | — | 0% |
| Kagi LLM Benchmark | — | 6.3% |
| ARC-AGI-1 | — | 5% |
| CritPt | — | 0.3% |
| Chess Puzzles | — | 3% |
| LMArena Hard Prompts | 728 | — |
| DTBench | — | 61.3% |
| BIG-Bench Hard | 37.9% | — |
| HellaSwag | 79.2% | — |
| LAMBADA | 75.2% | — |
| PIQA | 80.1% | — |
| WinoGrande | 73% | — |
Math Too close to call
Llama 13b: 26.7 (#256), Magistral Small: 26.2 (#261)
| Benchmark | Llama 13b | Magistral Small |
|---|---|---|
| OTIS Mock AIME 2024-2025 | — | 30% |
| LMArena Math | 838 | — |
| GSM8K | 20.6% | — |
Knowledge Not comparable
Llama 13b: —, Magistral Small: 30.9 (#223)
| Benchmark | Llama 13b | Magistral Small |
|---|---|---|
| GPQA Diamond | — | 56.1% |
| ARC (AI2) Challenge | 52.7% | — |
| BoolQ | 78.7% | — |
| MMLU | 47.7% | — |
| OpenBookQA | 56.4% | — |
| TriviaQA | 77.9% | — |
Multimodal Not comparable
Llama 13b: —, Magistral Small: —
| Benchmark | Llama 13b | Magistral Small |
|---|---|---|
| ScienceQA | 43.3% | — |
Multilingual Not comparable
Llama 13b: 16.6 (#297), Magistral Small: —
| Benchmark | Llama 13b | Magistral Small |
|---|---|---|
| LMArena Non-English | 819 | — |
Instruction Following Not comparable
Llama 13b: 36.7 (#305), Magistral Small: —
| Benchmark | Llama 13b | Magistral Small |
|---|---|---|
| LMArena Instruction Following | 781 | — |
Writing & Preference Not comparable
Llama 13b: 13.8 (#312), Magistral Small: —
| Benchmark | Llama 13b | Magistral Small |
|---|---|---|
| LMArena Text | 834 | — |
| LMArena Creative Writing | 794 | — |
| LMArena Multi-Turn | 753 | — |
Frequently asked questions
Is Llama 13b better than Magistral Small?
Magistral Small is the stronger model overall, scoring 30.2 to 24.4 on the Noometry Index.
Is Llama 13b or Magistral Small better for coding?
Magistral Small scores higher on coding benchmarks: 38.4 versus 21.4 in the Noometry coding category.
How many benchmarks do Llama 13b and Magistral Small share?
1 benchmark has published results for both models. Llama 13b has 21 scored results on Noometry and Magistral Small has 10.