Model comparison

Falcon-180B vs MiMo-V2.5

MiMo-V2.5 is the stronger model overall, scoring 43.4 to 32.2 on the Noometry Index.

Last verified . 6 shared benchmarks.

MiMo-V2.5 Xiaomi

43.4

Rank #93 Confirmed

Summary

  • They share 6 benchmarks with published results for both. Falcon-180B scores higher in 0 categories and MiMo-V2.5 in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where MiMo-V2.5 leads 61.6 to 29.1.

Side by side

Falcon-180B and MiMo-V2.5 specifications
Falcon-180BMiMo-V2.5
ProviderTechnology Innovation InstituteXiaomi
Noometry Index32.243.4
Released2023-09-062026-04-22
WeightsOpenOpen
Context window—1.05M
Max output—131K
Input $ / M tokens—$0.14
Output $ / M tokens—$0.28
Results tracked1623

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, MiMo-V2.5: 43.9 (#81)

Coding benchmarks
BenchmarkFalcon-180BMiMo-V2.5
LMArena WebDev—1438
SciCode—43.1%
LMArena Coding—1469
ALE-Bench—513.95

Reasoning MiMo-V2.5 leads

Falcon-180B: 19.1 (#269), MiMo-V2.5: 28.6 (#101)

Reasoning benchmarks
BenchmarkFalcon-180BMiMo-V2.5
LMArena Hard Prompts10071450
CritPt—3.7%
Epoch Capabilities Index112.13—
HellaSwag89%—
LAMBADA79.8%—
PIQA84.9%—
WinoGrande87.1%—

Math Not comparable

Falcon-180B: —, MiMo-V2.5: 36.8 (#163)

Math benchmarks
BenchmarkFalcon-180BMiMo-V2.5
ProofBench—16%
LMArena Math—1436
GSM8K54.4%—

Knowledge Not comparable

Falcon-180B: —, MiMo-V2.5: 40.8 (#115)

Knowledge benchmarks
BenchmarkFalcon-180BMiMo-V2.5
LMArena Expert—1460
ARC (AI2) Challenge67.8%—
BoolQ89%—
MMLU70.6%—
OpenBookQA64.2%—

Multimodal Not comparable

Falcon-180B: —, MiMo-V2.5: 39.8 (#54)

Multimodal benchmarks
BenchmarkFalcon-180BMiMo-V2.5
LMArena Vision—1247

Multilingual MiMo-V2.5 leads

Falcon-180B: 25.2 (#286), MiMo-V2.5: 51.9 (#99)

Multilingual benchmarks
BenchmarkFalcon-180BMiMo-V2.5
LMArena Non-English10001404
LMArena Chinese—1468
LMArena French—1447
LMArena German—1421
LMArena Japanese—1306
LMArena Korean—1363
LMArena Russian—1395
LMArena Spanish—1416

Instruction Following MiMo-V2.5 leads

Falcon-180B: 53.4 (#286), MiMo-V2.5: 75.5 (#60)

Instruction Following benchmarks
BenchmarkFalcon-180BMiMo-V2.5
LMArena Instruction Following10471434

Long Context Not comparable

Falcon-180B: —, MiMo-V2.5: 44.2 (#73)

Long Context benchmarks
BenchmarkFalcon-180BMiMo-V2.5
LMArena Longer Query—1445

Writing & Preference MiMo-V2.5 leads

Falcon-180B: 29.1 (#295), MiMo-V2.5: 61.6 (#86)

Writing & Preference benchmarks
BenchmarkFalcon-180BMiMo-V2.5
LMArena Text10541428
LMArena Creative Writing10891393
LMArena Multi-Turn10131445

Frequently asked questions

Is Falcon-180B better than MiMo-V2.5?

MiMo-V2.5 is the stronger model overall, scoring 43.4 to 32.2 on the Noometry Index.

How many benchmarks do Falcon-180B and MiMo-V2.5 share?

6 benchmarks have published results for both models. Falcon-180B has 16 scored results on Noometry and MiMo-V2.5 has 23.

Related comparisons

Go deeper