Model comparison

Phi-4 Mini vs Qwen2.5 Plus 1127

Qwen2.5 Plus 1127 is the stronger model overall, scoring 38.8 to 30.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Phi-4 Mini Microsoft

30.9

Rank #283 Reported

Qwen2.5 Plus 1127 Alibaba (Qwen)

38.8

Rank #181 Confirmed

Summary

  • The widest gap is in coding, where Qwen2.5 Plus 1127 leads 38.5 to 28.1.
  • Phi-4 Mini has downloadable open weights; the other is API-only.

Side by side

Phi-4 Mini and Qwen2.5 Plus 1127 specifications
Phi-4 MiniQwen2.5 Plus 1127
ProviderMicrosoftAlibaba (Qwen)
Noometry Index30.938.8
Released2024-12-11—
WeightsOpenProprietary
Context window128K—
Max output4K—
Input $ / M tokens$0.075—
Output $ / M tokens$0.30—
Results tracked314

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen2.5 Plus 1127 leads

Phi-4 Mini: 28.1 (#317), Qwen2.5 Plus 1127: 38.5 (#175)

Coding benchmarks
BenchmarkPhi-4 MiniQwen2.5 Plus 1127
SciCode10.8%—
LMArena Coding—1314

Reasoning Qwen2.5 Plus 1127 leads

Phi-4 Mini: 22.4 (#195), Qwen2.5 Plus 1127: 25.9 (#141)

Reasoning benchmarks
BenchmarkPhi-4 MiniQwen2.5 Plus 1127
CritPt0%—
LMArena Hard Prompts—1299

Math Not comparable

Phi-4 Mini: —, Qwen2.5 Plus 1127: 36.1 (#174)

Math benchmarks
BenchmarkPhi-4 MiniQwen2.5 Plus 1127
LMArena Math—1298

Knowledge Qwen2.5 Plus 1127 leads

Phi-4 Mini: 25.3 (#262), Qwen2.5 Plus 1127: 35.5 (#183)

Knowledge benchmarks
BenchmarkPhi-4 MiniQwen2.5 Plus 1127
Vectara Hallucination Rate23.5%—
LMArena Expert—1289

Multilingual Not comparable

Phi-4 Mini: —, Qwen2.5 Plus 1127: 41.9 (#201)

Multilingual benchmarks
BenchmarkPhi-4 MiniQwen2.5 Plus 1127
LMArena Non-English—1265
LMArena Chinese—1314
LMArena German—1231
LMArena Japanese—1207
LMArena Russian—1271

Instruction Following Not comparable

Phi-4 Mini: —, Qwen2.5 Plus 1127: 67.2 (#199)

Instruction Following benchmarks
BenchmarkPhi-4 MiniQwen2.5 Plus 1127
LMArena Instruction Following—1275

Long Context Not comparable

Phi-4 Mini: —, Qwen2.5 Plus 1127: 39.2 (#184)

Long Context benchmarks
BenchmarkPhi-4 MiniQwen2.5 Plus 1127
LMArena Longer Query—1292

Writing & Preference Not comparable

Phi-4 Mini: —, Qwen2.5 Plus 1127: 49.4 (#192)

Writing & Preference benchmarks
BenchmarkPhi-4 MiniQwen2.5 Plus 1127
LMArena Text—1299
LMArena Creative Writing—1262
LMArena Multi-Turn—1299

Frequently asked questions

Is Phi-4 Mini better than Qwen2.5 Plus 1127?

Qwen2.5 Plus 1127 is the stronger model overall, scoring 38.8 to 30.9 on the Noometry Index.

Is Phi-4 Mini or Qwen2.5 Plus 1127 better for coding?

Qwen2.5 Plus 1127 scores higher on coding benchmarks: 38.5 versus 28.1 in the Noometry coding category.

How many benchmarks do Phi-4 Mini and Qwen2.5 Plus 1127 share?

0 benchmarks have published results for both models. Phi-4 Mini has 3 scored results on Noometry and Qwen2.5 Plus 1127 has 14.

Related comparisons

Go deeper