Model comparison

Phi 3 Mini 4k Instruct June 2024 vs Qwen3.5 Max Preview

Qwen3.5 Max Preview is the stronger model overall, scoring 44.7 to 30.7 on the Noometry Index.

Last verified . 15 shared benchmarks.

Summary

  • They share 15 benchmarks with published results for both. Phi 3 Mini 4k Instruct June 2024 scores higher in 0 categories and Qwen3.5 Max Preview in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3.5 Max Preview leads 66.1 to 29.7.
  • Phi 3 Mini 4k Instruct June 2024 has downloadable open weights; the other is API-only.

Side by side

Phi 3 Mini 4k Instruct June 2024 and Qwen3.5 Max Preview specifications
Phi 3 Mini 4k Instruct June 2024Qwen3.5 Max Preview
ProviderMicrosoftAlibaba (Qwen)
Noometry Index30.744.7
Released——
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1517

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5 Max Preview leads

Phi 3 Mini 4k Instruct June 2024: 31.2 (#275), Qwen3.5 Max Preview: 43.4 (#79)

Coding benchmarks
BenchmarkPhi 3 Mini 4k Instruct June 2024Qwen3.5 Max Preview
LMArena Coding10931488

Reasoning Qwen3.5 Max Preview leads

Phi 3 Mini 4k Instruct June 2024: 19.9 (#229), Qwen3.5 Max Preview: 29.6 (#81)

Reasoning benchmarks
BenchmarkPhi 3 Mini 4k Instruct June 2024Qwen3.5 Max Preview
LMArena Hard Prompts10881483

Math Qwen3.5 Max Preview leads

Phi 3 Mini 4k Instruct June 2024: 30.4 (#209), Qwen3.5 Max Preview: 37.3 (#99)

Math benchmarks
BenchmarkPhi 3 Mini 4k Instruct June 2024Qwen3.5 Max Preview
LMArena Math11521473

Knowledge Qwen3.5 Max Preview leads

Phi 3 Mini 4k Instruct June 2024: 28.1 (#240), Qwen3.5 Max Preview: 41.1 (#104)

Knowledge benchmarks
BenchmarkPhi 3 Mini 4k Instruct June 2024Qwen3.5 Max Preview
LMArena Expert10511489

Multilingual Qwen3.5 Max Preview leads

Phi 3 Mini 4k Instruct June 2024: 26.0 (#277), Qwen3.5 Max Preview: 56.4 (#21)

Multilingual benchmarks
BenchmarkPhi 3 Mini 4k Instruct June 2024Qwen3.5 Max Preview
LMArena Non-English10131465
LMArena Chinese10331534
LMArena German10311487
LMArena Japanese9541497
LMArena Korean8801438
LMArena Russian10191472
LMArena French—1483
LMArena Spanish—1470

Instruction Following Qwen3.5 Max Preview leads

Phi 3 Mini 4k Instruct June 2024: 54.3 (#277), Qwen3.5 Max Preview: 77.2 (#28)

Instruction Following benchmarks
BenchmarkPhi 3 Mini 4k Instruct June 2024Qwen3.5 Max Preview
LMArena Instruction Following10581467

Long Context Qwen3.5 Max Preview leads

Phi 3 Mini 4k Instruct June 2024: 31.6 (#272), Qwen3.5 Max Preview: 45.2 (#44)

Long Context benchmarks
BenchmarkPhi 3 Mini 4k Instruct June 2024Qwen3.5 Max Preview
LMArena Longer Query10421477

Writing & Preference Qwen3.5 Max Preview leads

Phi 3 Mini 4k Instruct June 2024: 29.7 (#289), Qwen3.5 Max Preview: 66.1 (#39)

Writing & Preference benchmarks
BenchmarkPhi 3 Mini 4k Instruct June 2024Qwen3.5 Max Preview
LMArena Text10801471
LMArena Creative Writing10451464
LMArena Multi-Turn10491478

Frequently asked questions

Is Phi 3 Mini 4k Instruct June 2024 better than Qwen3.5 Max Preview?

Qwen3.5 Max Preview is the stronger model overall, scoring 44.7 to 30.7 on the Noometry Index.

Is Phi 3 Mini 4k Instruct June 2024 or Qwen3.5 Max Preview better for coding?

Qwen3.5 Max Preview scores higher on coding benchmarks: 43.4 versus 31.2 in the Noometry coding category.

How many benchmarks do Phi 3 Mini 4k Instruct June 2024 and Qwen3.5 Max Preview share?

15 benchmarks have published results for both models. Phi 3 Mini 4k Instruct June 2024 has 15 scored results on Noometry and Qwen3.5 Max Preview has 17.

Related comparisons

Go deeper