Model comparison

phi-3-medium 14B vs Qwen3.5 122B-A10B

Qwen3.5 122B-A10B is the stronger model overall, scoring 41.6 to 29.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

phi-3-medium 14B Microsoft

29.1

Rank #306 Reported

Qwen3.5 122B-A10B Alibaba (Qwen)

41.6

Rank #120 Confirmed

Summary

  • The widest gap is in knowledge, where Qwen3.5 122B-A10B leads 38.2 to 9.1.

Side by side

phi-3-medium 14B and Qwen3.5 122B-A10B specifications
phi-3-medium 14BQwen3.5 122B-A10B
ProviderMicrosoftAlibaba (Qwen)
Noometry Index29.141.6
Released2024-04-232026-02-23
WeightsOpenOpen
Context window—262K
Max output—66K
Input $ / M tokens—$0.40
Output $ / M tokens—$3.20
Results tracked1327

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5 122B-A10B leads

phi-3-medium 14B: 36.3 (#198), Qwen3.5 122B-A10B: 38.8 (#155)

Coding benchmarks
Benchmarkphi-3-medium 14BQwen3.5 122B-A10B
LMArena WebDev—1360
SciCode—35.6%
BigCodeBench Instruct37.6%—
LMArena Coding—1436
BigCodeBench Complete48.7%—

Reasoning Not comparable

phi-3-medium 14B: —, Qwen3.5 122B-A10B: 26.4 (#121)

Reasoning benchmarks
Benchmarkphi-3-medium 14BQwen3.5 122B-A10B
NYT Connections (extended)—51.7%
CritPt—0.9%
Thematic Generalization—51.2%
LMArena Hard Prompts—1421
Mystery Game Puzzles—17%
DTBench—84.3%
LMCA—32.2%
Adversarial NLI55.8%—
BIG-Bench Hard81.4%—
Epoch Capabilities Index121.18—
HellaSwag82.4%—
WinoGrande81.5%—

Math Qwen3.5 122B-A10B leads

phi-3-medium 14B: 25.2 (#249), Qwen3.5 122B-A10B: 36.4 (#114)

Math benchmarks
Benchmarkphi-3-medium 14BQwen3.5 122B-A10B
LMArena Math—1432
MATH Level 517.6%—

Knowledge Qwen3.5 122B-A10B leads

phi-3-medium 14B: 9.1 (#301), Qwen3.5 122B-A10B: 38.2 (#138)

Knowledge benchmarks
Benchmarkphi-3-medium 14BQwen3.5 122B-A10B
GPQA Diamond27.6%—
Vectara Hallucination Rate—11.2%
LMArena Expert—1431
ARC (AI2) Challenge91.6%—
MMLU78%—
OpenBookQA87.4%—
TriviaQA73.9%—

Multimodal Not comparable

phi-3-medium 14B: —, Qwen3.5 122B-A10B: 39.0 (#52)

Multimodal benchmarks
Benchmarkphi-3-medium 14BQwen3.5 122B-A10B
LMArena Vision—1245

Multilingual Not comparable

phi-3-medium 14B: —, Qwen3.5 122B-A10B: 51.8 (#101)

Multilingual benchmarks
Benchmarkphi-3-medium 14BQwen3.5 122B-A10B
LMArena Non-English—1400
LMArena Chinese—1462
LMArena French—1442
LMArena German—1425
LMArena Japanese—1364
LMArena Korean—1353
LMArena Russian—1400
LMArena Spanish—1423

Instruction Following Not comparable

phi-3-medium 14B: —, Qwen3.5 122B-A10B: 74.0 (#109)

Instruction Following benchmarks
Benchmarkphi-3-medium 14BQwen3.5 122B-A10B
LMArena Instruction Following—1399

Long Context Not comparable

phi-3-medium 14B: —, Qwen3.5 122B-A10B: 43.0 (#105)

Long Context benchmarks
Benchmarkphi-3-medium 14BQwen3.5 122B-A10B
LMArena Longer Query—1410

Writing & Preference Not comparable

phi-3-medium 14B: —, Qwen3.5 122B-A10B: 60.2 (#98)

Writing & Preference benchmarks
Benchmarkphi-3-medium 14BQwen3.5 122B-A10B
LMArena Text—1417
LMArena Creative Writing—1369
LMArena Multi-Turn—1416

Frequently asked questions

Is phi-3-medium 14B better than Qwen3.5 122B-A10B?

Qwen3.5 122B-A10B is the stronger model overall, scoring 41.6 to 29.1 on the Noometry Index.

Is phi-3-medium 14B or Qwen3.5 122B-A10B better for coding?

Qwen3.5 122B-A10B scores higher on coding benchmarks: 38.8 versus 36.3 in the Noometry coding category.

How many benchmarks do phi-3-medium 14B and Qwen3.5 122B-A10B share?

0 benchmarks have published results for both models. phi-3-medium 14B has 13 scored results on Noometry and Qwen3.5 122B-A10B has 27.

Related comparisons

Go deeper