Noometry

Model comparison

Phi-4 vs Qwen3.5 Max Preview

Qwen3.5 Max Preview is the stronger model overall, scoring 45.3 to 31.2 on the Noometry Index.

Last verified . 17 shared benchmarks.

Phi-4 Microsoft

31.2

Rank #279 Confirmed

Qwen3.5 Max Preview Alibaba (Qwen)

45.3

Rank #71 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Phi-4 scores higher in 0 categories and Qwen3.5 Max Preview in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3.5 Max Preview leads 66.0 to 40.5.
  • Phi-4 has downloadable open weights; the other is API-only.

Side by side

Phi-4Qwen3.5 Max Preview
ProviderMicrosoftAlibaba (Qwen)
Noometry Index31.245.3
Released2024-12-11—
WeightsOpenProprietary
Context window128K—
Max output4K—
Input $ / M tokens$0.07—
Output $ / M tokens$0.14—
Results tracked3717

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5 Max Preview leads

Phi-4: 34.4 (#239), Qwen3.5 Max Preview: 44.0 (#77)

BenchmarkPhi-4Qwen3.5 Max Preview
LMArena Coding12311487
BigCodeBench Instruct45.5%—
LiveBench Coding30.7%—
BigCodeBench Complete55.4%—

Agentic & Tool Use Not comparable

Phi-4: 22.8 (#128), Qwen3.5 Max Preview: —

BenchmarkPhi-4Qwen3.5 Max Preview
Berkeley Function Calling Leaderboard28.8%—
BALROG11.6%—

Reasoning Qwen3.5 Max Preview leads

Phi-4: 17.7 (#291), Qwen3.5 Max Preview: 30.8 (#84)

BenchmarkPhi-4Qwen3.5 Max Preview
LMArena Hard Prompts12201483
Chess Puzzles1%—
LiveBench Reasoning47.8%—
LiveBench Data Analysis45.2%—
Epoch Capabilities Index130.42—
LiveBench41.6%—

Math Qwen3.5 Max Preview leads

Phi-4: 20.8 (#285), Qwen3.5 Max Preview: 40.1 (#94)

BenchmarkPhi-4Qwen3.5 Max Preview
LMArena Math12461474
OTIS Mock AIME 2024-202513.8%—
LiveBench Math42%—
MATH Level 564.9%—

Knowledge Qwen3.5 Max Preview leads

Phi-4: 32.6 (#209), Qwen3.5 Max Preview: 41.8 (#107)

BenchmarkPhi-4Qwen3.5 Max Preview
LMArena Expert12031489
GPQA Diamond56.1%—
Confabulations29.4%—
Vectara Hallucination Rate3.7%—
MMLU84.8%—

Multilingual Qwen3.5 Max Preview leads

Phi-4: 37.2 (#237), Qwen3.5 Max Preview: 56.2 (#22)

BenchmarkPhi-4Qwen3.5 Max Preview
LMArena Non-English11971465
LMArena Chinese12121534
LMArena French12241484
LMArena German12221487
LMArena Japanese11581495
LMArena Korean11511438
LMArena Russian12091471
LMArena Spanish12341470

Instruction Following Qwen3.5 Max Preview leads

Phi-4: 60.4 (#251), Qwen3.5 Max Preview: 77.0 (#31)

BenchmarkPhi-4Qwen3.5 Max Preview
LMArena Instruction Following12011467
LiveBench Instruction Following58.4%—

Long Context Qwen3.5 Max Preview leads

Phi-4: 36.9 (#226), Qwen3.5 Max Preview: 45.2 (#45)

BenchmarkPhi-4Qwen3.5 Max Preview
LMArena Longer Query12171476

Writing & Preference Qwen3.5 Max Preview leads

Phi-4: 40.5 (#244), Qwen3.5 Max Preview: 66.0 (#41)

BenchmarkPhi-4Qwen3.5 Max Preview
LMArena Text12171470
LMArena Creative Writing11821464
LMArena Multi-Turn12061478
Short-Story Creative Writing62.6%—
LiveBench Language25.6%—

Frequently asked questions

Is Phi-4 better than Qwen3.5 Max Preview?

Qwen3.5 Max Preview is the stronger model overall, scoring 45.3 to 31.2 on the Noometry Index.

Is Phi-4 or Qwen3.5 Max Preview better for coding?

Qwen3.5 Max Preview scores higher on coding benchmarks: 44.0 versus 34.4 in the Noometry coding category.

How many benchmarks do Phi-4 and Qwen3.5 Max Preview share?

17 benchmarks have published results for both models. Phi-4 has 37 scored results on Noometry and Qwen3.5 Max Preview has 17.

Related comparisons

Go deeper