Model comparison

Llama 13b vs MiMo-V2.5

MiMo-V2.5 is the stronger model overall, scoring 43.4 to 24.4 on the Noometry Index.

Last verified . 8 shared benchmarks.

Llama 13b Meta

24.4

Rank #348 Confirmed

MiMo-V2.5 Xiaomi

43.4

Rank #93 Confirmed

Summary

  • They share 8 benchmarks with published results for both. Llama 13b scores higher in 0 categories and MiMo-V2.5 in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where MiMo-V2.5 leads 61.6 to 13.8.

Side by side

Llama 13b and MiMo-V2.5 specifications
Llama 13bMiMo-V2.5
ProviderMetaXiaomi
Noometry Index24.443.4
Released2023-02-242026-04-22
WeightsOpenOpen
Context window—1.05M
Max output—131K
Input $ / M tokens—$0.14
Output $ / M tokens—$0.28
Results tracked2123

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiMo-V2.5 leads

Llama 13b: 21.4 (#337), MiMo-V2.5: 43.9 (#81)

Coding benchmarks
BenchmarkLlama 13bMiMo-V2.5
LMArena Coding6831469
LMArena WebDev—1438
SciCode—43.1%
ALE-Bench—513.95

Reasoning MiMo-V2.5 leads

Llama 13b: 14.0 (#329), MiMo-V2.5: 28.6 (#101)

Reasoning benchmarks
BenchmarkLlama 13bMiMo-V2.5
LMArena Hard Prompts7281450
CritPt—3.7%
BIG-Bench Hard37.9%—
Epoch Capabilities Index100.58—
HellaSwag79.2%—
LAMBADA75.2%—
PIQA80.1%—
WinoGrande73%—

Math MiMo-V2.5 leads

Llama 13b: 26.7 (#256), MiMo-V2.5: 36.8 (#163)

Math benchmarks
BenchmarkLlama 13bMiMo-V2.5
LMArena Math8381436
ProofBench—16%
GSM8K20.6%—

Knowledge Not comparable

Llama 13b: —, MiMo-V2.5: 40.8 (#115)

Knowledge benchmarks
BenchmarkLlama 13bMiMo-V2.5
LMArena Expert—1460
ARC (AI2) Challenge52.7%—
BoolQ78.7%—
MMLU47.7%—
OpenBookQA56.4%—
TriviaQA77.9%—

Multimodal Not comparable

Llama 13b: —, MiMo-V2.5: 39.8 (#54)

Multimodal benchmarks
BenchmarkLlama 13bMiMo-V2.5
LMArena Vision—1247
ScienceQA43.3%—

Multilingual MiMo-V2.5 leads

Llama 13b: 16.6 (#297), MiMo-V2.5: 51.9 (#99)

Multilingual benchmarks
BenchmarkLlama 13bMiMo-V2.5
LMArena Non-English8191404
LMArena Chinese—1468
LMArena French—1447
LMArena German—1421
LMArena Japanese—1306
LMArena Korean—1363
LMArena Russian—1395
LMArena Spanish—1416

Instruction Following MiMo-V2.5 leads

Llama 13b: 36.7 (#305), MiMo-V2.5: 75.5 (#60)

Instruction Following benchmarks
BenchmarkLlama 13bMiMo-V2.5
LMArena Instruction Following7811434

Long Context Not comparable

Llama 13b: —, MiMo-V2.5: 44.2 (#73)

Long Context benchmarks
BenchmarkLlama 13bMiMo-V2.5
LMArena Longer Query—1445

Writing & Preference MiMo-V2.5 leads

Llama 13b: 13.8 (#312), MiMo-V2.5: 61.6 (#86)

Writing & Preference benchmarks
BenchmarkLlama 13bMiMo-V2.5
LMArena Text8341428
LMArena Creative Writing7941393
LMArena Multi-Turn7531445

Frequently asked questions

Is Llama 13b better than MiMo-V2.5?

MiMo-V2.5 is the stronger model overall, scoring 43.4 to 24.4 on the Noometry Index.

Is Llama 13b or MiMo-V2.5 better for coding?

MiMo-V2.5 scores higher on coding benchmarks: 43.9 versus 21.4 in the Noometry coding category.

How many benchmarks do Llama 13b and MiMo-V2.5 share?

8 benchmarks have published results for both models. Llama 13b has 21 scored results on Noometry and MiMo-V2.5 has 23.

Related comparisons

Go deeper