Model comparison

MiMo-V2-Flash vs Phi 3 Mini 4k Instruct June 2024

MiMo-V2-Flash is the stronger model overall, scoring 41.3 to 31.3 on the Noometry Index.

Last verified . 15 shared benchmarks.

MiMo-V2-Flash Xiaomi

41.3

Rank #138 Confirmed

Summary

  • They share 15 benchmarks with published results for both. MiMo-V2-Flash scores higher in 8 categories and Phi 3 Mini 4k Instruct June 2024 in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where MiMo-V2-Flash leads 59.7 to 29.6.

Side by side

MiMo-V2-Flash and Phi 3 Mini 4k Instruct June 2024 specifications
MiMo-V2-FlashPhi 3 Mini 4k Instruct June 2024
ProviderXiaomiMicrosoft
Noometry Index41.331.3
Released2025-12-16—
WeightsOpenOpen
Context window262K—
Max output66K—
Input $ / M tokens$0.14—
Output $ / M tokens$0.28—
Results tracked2115

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiMo-V2-Flash leads

MiMo-V2-Flash: 36.1 (#211), Phi 3 Mini 4k Instruct June 2024: 31.8 (#279)

Coding benchmarks
BenchmarkMiMo-V2-FlashPhi 3 Mini 4k Instruct June 2024
LMArena Coding14431093
LMArena WebDev1330—
SciCode25.9%—
ALE-Bench737.95—

Reasoning MiMo-V2-Flash leads

MiMo-V2-Flash: 24.9 (#157), Phi 3 Mini 4k Instruct June 2024: 20.8 (#231)

Reasoning benchmarks
BenchmarkMiMo-V2-FlashPhi 3 Mini 4k Instruct June 2024
LMArena Hard Prompts14201087
CritPt0%—

Math MiMo-V2-Flash leads

MiMo-V2-Flash: 38.3 (#139), Phi 3 Mini 4k Instruct June 2024: 33.0 (#208)

Math benchmarks
BenchmarkMiMo-V2-FlashPhi 3 Mini 4k Instruct June 2024
LMArena Math13961152

Knowledge MiMo-V2-Flash leads

MiMo-V2-Flash: 39.7 (#131), Phi 3 Mini 4k Instruct June 2024: 28.6 (#244)

Knowledge benchmarks
BenchmarkMiMo-V2-FlashPhi 3 Mini 4k Instruct June 2024
LMArena Expert14251051

Multilingual MiMo-V2-Flash leads

MiMo-V2-Flash: 51.0 (#113), Phi 3 Mini 4k Instruct June 2024: 25.9 (#282)

Multilingual benchmarks
BenchmarkMiMo-V2-FlashPhi 3 Mini 4k Instruct June 2024
LMArena Non-English13921013
LMArena Chinese14621033
LMArena German13951031
LMArena Japanese1325954
LMArena Korean1358880
LMArena Russian13871019
LMArena French1429—
LMArena Spanish1420—

Instruction Following MiMo-V2-Flash leads

MiMo-V2-Flash: 73.5 (#120), Phi 3 Mini 4k Instruct June 2024: 54.1 (#282)

Instruction Following benchmarks
BenchmarkMiMo-V2-FlashPhi 3 Mini 4k Instruct June 2024
LMArena Instruction Following13921058

Long Context MiMo-V2-Flash leads

MiMo-V2-Flash: 43.0 (#110), Phi 3 Mini 4k Instruct June 2024: 31.7 (#277)

Long Context benchmarks
BenchmarkMiMo-V2-FlashPhi 3 Mini 4k Instruct June 2024
LMArena Longer Query14091042

Writing & Preference MiMo-V2-Flash leads

MiMo-V2-Flash: 59.7 (#106), Phi 3 Mini 4k Instruct June 2024: 29.6 (#294)

Writing & Preference benchmarks
BenchmarkMiMo-V2-FlashPhi 3 Mini 4k Instruct June 2024
LMArena Text14111080
LMArena Creative Writing13751045
LMArena Multi-Turn14041049

Frequently asked questions

Is MiMo-V2-Flash better than Phi 3 Mini 4k Instruct June 2024?

MiMo-V2-Flash is the stronger model overall, scoring 41.3 to 31.3 on the Noometry Index.

Is MiMo-V2-Flash or Phi 3 Mini 4k Instruct June 2024 better for coding?

MiMo-V2-Flash scores higher on coding benchmarks: 36.1 versus 31.8 in the Noometry coding category.

How many benchmarks do MiMo-V2-Flash and Phi 3 Mini 4k Instruct June 2024 share?

15 benchmarks have published results for both models. MiMo-V2-Flash has 21 scored results on Noometry and Phi 3 Mini 4k Instruct June 2024 has 15.

Related comparisons

Go deeper