Model comparison

MiMo-V2-Omni vs Phi 3 Mini 4k Instruct June 2024

MiMo-V2-Omni is the stronger model overall, scoring 43.6 to 31.3 on the Noometry Index.

Last verified . 15 shared benchmarks.

MiMo-V2-Omni Xiaomi

43.6

Rank #88 Confirmed

Summary

  • They share 15 benchmarks with published results for both. MiMo-V2-Omni scores higher in 8 categories and Phi 3 Mini 4k Instruct June 2024 in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where MiMo-V2-Omni leads 61.4 to 29.6.
  • Phi 3 Mini 4k Instruct June 2024 has downloadable open weights; the other is API-only.

Side by side

MiMo-V2-Omni and Phi 3 Mini 4k Instruct June 2024 specifications
MiMo-V2-OmniPhi 3 Mini 4k Instruct June 2024
ProviderXiaomiMicrosoft
Noometry Index43.631.3
Released2026-03-18—
WeightsProprietaryOpen
Context window262K—
Max output131K—
Input $ / M tokens$0.14—
Output $ / M tokens$0.28—
Results tracked1815

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiMo-V2-Omni leads

MiMo-V2-Omni: 43.3 (#89), Phi 3 Mini 4k Instruct June 2024: 31.8 (#279)

Coding benchmarks
BenchmarkMiMo-V2-OmniPhi 3 Mini 4k Instruct June 2024
LMArena Coding14661093

Reasoning MiMo-V2-Omni leads

MiMo-V2-Omni: 29.7 (#88), Phi 3 Mini 4k Instruct June 2024: 20.8 (#231)

Reasoning benchmarks
BenchmarkMiMo-V2-OmniPhi 3 Mini 4k Instruct June 2024
LMArena Hard Prompts14451087

Math MiMo-V2-Omni leads

MiMo-V2-Omni: 39.1 (#115), Phi 3 Mini 4k Instruct June 2024: 33.0 (#208)

Math benchmarks
BenchmarkMiMo-V2-OmniPhi 3 Mini 4k Instruct June 2024
LMArena Math14301152

Knowledge MiMo-V2-Omni leads

MiMo-V2-Omni: 40.5 (#118), Phi 3 Mini 4k Instruct June 2024: 28.6 (#244)

Knowledge benchmarks
BenchmarkMiMo-V2-OmniPhi 3 Mini 4k Instruct June 2024
LMArena Expert14491051

Multimodal Not comparable

MiMo-V2-Omni: 38.6 (#63), Phi 3 Mini 4k Instruct June 2024: —

Multimodal benchmarks
BenchmarkMiMo-V2-OmniPhi 3 Mini 4k Instruct June 2024
LMArena Vision1228—

Multilingual MiMo-V2-Omni leads

MiMo-V2-Omni: 51.8 (#102), Phi 3 Mini 4k Instruct June 2024: 25.9 (#282)

Multilingual benchmarks
BenchmarkMiMo-V2-OmniPhi 3 Mini 4k Instruct June 2024
LMArena Non-English14041013
LMArena Chinese14651033
LMArena German13991031
LMArena Japanese1317954
LMArena Korean1355880
LMArena Russian14121019
LMArena French1447—
LMArena Spanish1434—

Instruction Following MiMo-V2-Omni leads

MiMo-V2-Omni: 75.2 (#66), Phi 3 Mini 4k Instruct June 2024: 54.1 (#282)

Instruction Following benchmarks
BenchmarkMiMo-V2-OmniPhi 3 Mini 4k Instruct June 2024
LMArena Instruction Following14281058

Long Context MiMo-V2-Omni leads

MiMo-V2-Omni: 44.1 (#76), Phi 3 Mini 4k Instruct June 2024: 31.7 (#277)

Long Context benchmarks
BenchmarkMiMo-V2-OmniPhi 3 Mini 4k Instruct June 2024
LMArena Longer Query14421042

Writing & Preference MiMo-V2-Omni leads

MiMo-V2-Omni: 61.4 (#87), Phi 3 Mini 4k Instruct June 2024: 29.6 (#294)

Writing & Preference benchmarks
BenchmarkMiMo-V2-OmniPhi 3 Mini 4k Instruct June 2024
LMArena Text14231080
LMArena Creative Writing13921045
LMArena Multi-Turn14451049

Frequently asked questions

Is MiMo-V2-Omni better than Phi 3 Mini 4k Instruct June 2024?

MiMo-V2-Omni is the stronger model overall, scoring 43.6 to 31.3 on the Noometry Index.

Is MiMo-V2-Omni or Phi 3 Mini 4k Instruct June 2024 better for coding?

MiMo-V2-Omni scores higher on coding benchmarks: 43.3 versus 31.8 in the Noometry coding category.

How many benchmarks do MiMo-V2-Omni and Phi 3 Mini 4k Instruct June 2024 share?

15 benchmarks have published results for both models. MiMo-V2-Omni has 18 scored results on Noometry and Phi 3 Mini 4k Instruct June 2024 has 15.

Related comparisons

Go deeper