Model comparison

phi-3-medium 14B vs Qwen3-30B-A3B

Qwen3-30B-A3B is the stronger model overall, scoring 38.9 to 29.7 on the Noometry Index.

Last verified . 2 shared benchmarks.

phi-3-medium 14B Microsoft

29.7

Rank #306 Reported

Qwen3-30B-A3B Alibaba (Qwen)

38.9

Rank #179 Confirmed

Summary

  • They share 2 benchmarks with published results for both. phi-3-medium 14B scores higher in 0 categories and Qwen3-30B-A3B in 3 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3-30B-A3B leads 41.8 to 9.1.
  • The biggest single-benchmark swing is GPQA Diamond: 27.6% for phi-3-medium 14B and 70.1% for Qwen3-30B-A3B.

Side by side

phi-3-medium 14B and Qwen3-30B-A3B specifications
phi-3-medium 14BQwen3-30B-A3B
ProviderMicrosoftAlibaba (Qwen)
Noometry Index29.738.9
Released2024-04-232025-04-28
WeightsOpenOpen
Context window—41K
Max output—16K
Input $ / M tokens—$0.12
Output $ / M tokens—$0.50
Results tracked1332

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

phi-3-medium 14B: 36.8 (#201), Qwen3-30B-A3B: 37.5 (#194)

Coding benchmarks
Benchmarkphi-3-medium 14BQwen3-30B-A3B
SciCode—33.3%
WeirdML—29.8%
BigCodeBench Instruct37.6%—
LMArena Coding—1416
BigCodeBench Complete48.7%—

Agentic & Tool Use Not comparable

phi-3-medium 14B: —, Qwen3-30B-A3B: 29.8 (#82)

Agentic & Tool Use benchmarks
Benchmarkphi-3-medium 14BQwen3-30B-A3B
Berkeley Function Calling Leaderboard—41.4%

Reasoning Not comparable

phi-3-medium 14B: —, Qwen3-30B-A3B: 22.2 (#204)

Reasoning benchmarks
Benchmarkphi-3-medium 14BQwen3-30B-A3B
Epoch Capabilities Index121.23139.63
Kagi LLM Benchmark—54.9%
CritPt—0.3%
Chess Puzzles—8%
LMArena Hard Prompts—1398
DTBench—69.3%
LMCA—22.4%
Adversarial NLI55.8%—
BIG-Bench Hard81.4%—
HellaSwag82.4%—
WinoGrande81.5%—

Math Qwen3-30B-A3B leads

phi-3-medium 14B: 27.3 (#250), Qwen3-30B-A3B: 37.4 (#157)

Math benchmarks
Benchmarkphi-3-medium 14BQwen3-30B-A3B
MathArena Final-Answer Competitions—47.8%
OTIS Mock AIME 2024-2025—70.3%
LMArena Math—1394
MATH Level 517.6%—

Knowledge Qwen3-30B-A3B leads

phi-3-medium 14B: 9.1 (#306), Qwen3-30B-A3B: 41.8 (#105)

Knowledge benchmarks
Benchmarkphi-3-medium 14BQwen3-30B-A3B
GPQA Diamond27.6%70.1%
Confabulations—12.3%
LMArena Expert—1396
ARC (AI2) Challenge91.6%—
MMLU78%—
OpenBookQA87.4%—
TriviaQA73.9%—

Multilingual Not comparable

phi-3-medium 14B: —, Qwen3-30B-A3B: 49.5 (#132)

Multilingual benchmarks
Benchmarkphi-3-medium 14BQwen3-30B-A3B
LMArena Non-English—1372
LMArena Chinese—1433
LMArena French—1418
LMArena German—1380
LMArena Japanese—1337
LMArena Korean—1331
LMArena Russian—1370
LMArena Spanish—1404

Instruction Following Not comparable

phi-3-medium 14B: —, Qwen3-30B-A3B: 72.0 (#142)

Instruction Following benchmarks
Benchmarkphi-3-medium 14BQwen3-30B-A3B
LMArena Instruction Following—1363

Long Context Not comparable

phi-3-medium 14B: —, Qwen3-30B-A3B: 31.0 (#283)

Long Context benchmarks
Benchmarkphi-3-medium 14BQwen3-30B-A3B
Fiction.LiveBench—40.6%
LMArena Longer Query—1379

Writing & Preference Not comparable

phi-3-medium 14B: —, Qwen3-30B-A3B: 55.6 (#143)

Writing & Preference benchmarks
Benchmarkphi-3-medium 14BQwen3-30B-A3B
LMArena Text—1384
LMArena Creative Writing—1317
Short-Story Creative Writing—75.3%
LMArena Multi-Turn—1378

Frequently asked questions

Is phi-3-medium 14B better than Qwen3-30B-A3B?

Qwen3-30B-A3B is the stronger model overall, scoring 38.9 to 29.7 on the Noometry Index.

Is phi-3-medium 14B or Qwen3-30B-A3B better for coding?

They score almost the same on coding (36.8 vs 37.5); test both on your own repository before choosing.

How many benchmarks do phi-3-medium 14B and Qwen3-30B-A3B share?

2 benchmarks have published results for both models. phi-3-medium 14B has 13 scored results on Noometry and Qwen3-30B-A3B has 32.

Related comparisons

Go deeper