Model comparison

MiMo-V2-Flash vs phi-3-medium 14B

MiMo-V2-Flash is the stronger model overall, scoring 41.3 to 29.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

MiMo-V2-Flash Xiaomi

41.3

Rank #138 Confirmed

phi-3-medium 14B Microsoft

29.7

Rank #306 Reported

Summary

  • The widest gap is in knowledge, where MiMo-V2-Flash leads 39.7 to 9.1.

Side by side

MiMo-V2-Flash and phi-3-medium 14B specifications
MiMo-V2-Flashphi-3-medium 14B
ProviderXiaomiMicrosoft
Noometry Index41.329.7
Released2025-12-162024-04-23
WeightsOpenOpen
Context window262K—
Max output66K—
Input $ / M tokens$0.14—
Output $ / M tokens$0.28—
Results tracked2113

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

MiMo-V2-Flash: 36.1 (#211), phi-3-medium 14B: 36.8 (#201)

Coding benchmarks
BenchmarkMiMo-V2-Flashphi-3-medium 14B
LMArena WebDev1330—
SciCode25.9%—
BigCodeBench Instruct—37.6%
LMArena Coding1443—
BigCodeBench Complete—48.7%
ALE-Bench737.95—

Reasoning Not comparable

MiMo-V2-Flash: 24.9 (#157), phi-3-medium 14B: —

Reasoning benchmarks
BenchmarkMiMo-V2-Flashphi-3-medium 14B
CritPt0%—
LMArena Hard Prompts1420—
Adversarial NLI—55.8%
BIG-Bench Hard—81.4%
Epoch Capabilities Index—121.23
HellaSwag—82.4%
WinoGrande—81.5%

Math MiMo-V2-Flash leads

MiMo-V2-Flash: 38.3 (#139), phi-3-medium 14B: 27.3 (#250)

Math benchmarks
BenchmarkMiMo-V2-Flashphi-3-medium 14B
LMArena Math1396—
MATH Level 5—17.6%

Knowledge MiMo-V2-Flash leads

MiMo-V2-Flash: 39.7 (#131), phi-3-medium 14B: 9.1 (#306)

Knowledge benchmarks
BenchmarkMiMo-V2-Flashphi-3-medium 14B
GPQA Diamond—27.6%
LMArena Expert1425—
ARC (AI2) Challenge—91.6%
MMLU—78%
OpenBookQA—87.4%
TriviaQA—73.9%

Multilingual Not comparable

MiMo-V2-Flash: 51.0 (#113), phi-3-medium 14B: —

Multilingual benchmarks
BenchmarkMiMo-V2-Flashphi-3-medium 14B
LMArena Non-English1392—
LMArena Chinese1462—
LMArena French1429—
LMArena German1395—
LMArena Japanese1325—
LMArena Korean1358—
LMArena Russian1387—
LMArena Spanish1420—

Instruction Following Not comparable

MiMo-V2-Flash: 73.5 (#120), phi-3-medium 14B: —

Instruction Following benchmarks
BenchmarkMiMo-V2-Flashphi-3-medium 14B
LMArena Instruction Following1392—

Long Context Not comparable

MiMo-V2-Flash: 43.0 (#110), phi-3-medium 14B: —

Long Context benchmarks
BenchmarkMiMo-V2-Flashphi-3-medium 14B
LMArena Longer Query1409—

Writing & Preference Not comparable

MiMo-V2-Flash: 59.7 (#106), phi-3-medium 14B: —

Writing & Preference benchmarks
BenchmarkMiMo-V2-Flashphi-3-medium 14B
LMArena Text1411—
LMArena Creative Writing1375—
LMArena Multi-Turn1404—

Frequently asked questions

Is MiMo-V2-Flash better than phi-3-medium 14B?

MiMo-V2-Flash is the stronger model overall, scoring 41.3 to 29.7 on the Noometry Index.

Is MiMo-V2-Flash or phi-3-medium 14B better for coding?

They score almost the same on coding (36.1 vs 36.8); test both on your own repository before choosing.

How many benchmarks do MiMo-V2-Flash and phi-3-medium 14B share?

0 benchmarks have published results for both models. MiMo-V2-Flash has 21 scored results on Noometry and phi-3-medium 14B has 13.

Related comparisons

Go deeper