Noometry

Model comparison

Phi 3 Medium 4k Instruct vs Qwen3-1.7B

Phi 3 Medium 4k Instruct is the stronger model overall, scoring 32.4 to 26.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Phi 3 Medium 4k Instruct Microsoft

32.4

Rank #246 Confirmed

Qwen3-1.7B Alibaba (Qwen)

26.2

Rank #331 Reported

Summary

  • The widest gap is in math, where Phi 3 Medium 4k Instruct leads 30.9 to 15.4.

Side by side

Phi 3 Medium 4k InstructQwen3-1.7B
ProviderMicrosoftAlibaba (Qwen)
Noometry Index32.426.2
Released—2025-04-29
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked174

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Phi 3 Medium 4k Instruct: 32.3 (#263), Qwen3-1.7B: —

BenchmarkPhi 3 Medium 4k InstructQwen3-1.7B
LMArena Coding1130—

Agentic & Tool Use Not comparable

Phi 3 Medium 4k Instruct: —, Qwen3-1.7B: 24.5 (#108)

BenchmarkPhi 3 Medium 4k InstructQwen3-1.7B
Berkeley Function Calling Leaderboard—28.4%

Reasoning Phi 3 Medium 4k Instruct leads

Phi 3 Medium 4k Instruct: 20.8 (#214), Qwen3-1.7B: 18.5 (#263)

BenchmarkPhi 3 Medium 4k InstructQwen3-1.7B
Chess Puzzles—0%
LMArena Hard Prompts1127—

Math Phi 3 Medium 4k Instruct leads

Phi 3 Medium 4k Instruct: 30.9 (#202), Qwen3-1.7B: 15.4 (#288)

BenchmarkPhi 3 Medium 4k InstructQwen3-1.7B
OTIS Mock AIME 2024-2025—8.1%
LMArena Math1173—

Knowledge Phi 3 Medium 4k Instruct leads

Phi 3 Medium 4k Instruct: 29.6 (#226), Qwen3-1.7B: 19.6 (#273)

BenchmarkPhi 3 Medium 4k InstructQwen3-1.7B
GPQA Diamond—38%
LMArena Expert1108—

Multilingual Not comparable

Phi 3 Medium 4k Instruct: 30.8 (#258), Qwen3-1.7B: —

BenchmarkPhi 3 Medium 4k InstructQwen3-1.7B
LMArena Non-English1094—
LMArena Chinese1108—
LMArena French1109—
LMArena German1101—
LMArena Japanese1042—
LMArena Korean954—
LMArena Russian1145—
LMArena Spanish1095—

Instruction Following Not comparable

Phi 3 Medium 4k Instruct: 57.8 (#263), Qwen3-1.7B: —

BenchmarkPhi 3 Medium 4k InstructQwen3-1.7B
LMArena Instruction Following1114—

Long Context Not comparable

Phi 3 Medium 4k Instruct: 33.9 (#250), Qwen3-1.7B: —

BenchmarkPhi 3 Medium 4k InstructQwen3-1.7B
LMArena Longer Query1120—

Writing & Preference Not comparable

Phi 3 Medium 4k Instruct: 34.3 (#267), Qwen3-1.7B: —

BenchmarkPhi 3 Medium 4k InstructQwen3-1.7B
LMArena Text1138—
LMArena Creative Writing1106—
LMArena Multi-Turn1088—

Frequently asked questions

Is Phi 3 Medium 4k Instruct better than Qwen3-1.7B?

Phi 3 Medium 4k Instruct is the stronger model overall, scoring 32.4 to 26.2 on the Noometry Index.

How many benchmarks do Phi 3 Medium 4k Instruct and Qwen3-1.7B share?

0 benchmarks have published results for both models. Phi 3 Medium 4k Instruct has 17 scored results on Noometry and Qwen3-1.7B has 4.

Related comparisons

Go deeper