Model comparison

Phi 3 Mini 128k Instruct vs Qwen3 8B

Qwen3 8B is the stronger model overall, scoring 33.7 to 29.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Phi 3 Mini 128k Instruct Microsoft

29.7

Rank #305 Confirmed

Qwen3 8B Alibaba (Qwen)

33.7

Rank #238 Confirmed

Summary

  • The widest gap is in knowledge, where Qwen3 8B leads 36.1 to 26.8.

Side by side

Phi 3 Mini 128k Instruct and Qwen3 8B specifications
Phi 3 Mini 128k InstructQwen3 8B
ProviderMicrosoftAlibaba (Qwen)
Noometry Index29.733.7
Released2024-04-232025-04
WeightsOpenOpen
Context window—131K
Max output—8K
Input $ / M tokens—$0.18
Output $ / M tokens—$0.70
Results tracked1911

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3 8B leads

Phi 3 Mini 128k Instruct: 28.8 (#312), Qwen3 8B: 34.0 (#248)

Coding benchmarks
BenchmarkPhi 3 Mini 128k InstructQwen3 8B
SciCode—22.6%
BigCodeBench Instruct29.6%—
LMArena Coding1039—
BigCodeBench Complete40.6%—

Agentic & Tool Use Not comparable

Phi 3 Mini 128k Instruct: —, Qwen3 8B: 30.2 (#78)

Agentic & Tool Use benchmarks
BenchmarkPhi 3 Mini 128k InstructQwen3 8B
Berkeley Function Calling Leaderboard—42.6%

Reasoning Phi 3 Mini 128k Instruct leads

Phi 3 Mini 128k Instruct: 19.6 (#256), Qwen3 8B: 16.6 (#303)

Reasoning benchmarks
BenchmarkPhi 3 Mini 128k InstructQwen3 8B
CritPt—0%
Chess Puzzles—5%
LMArena Hard Prompts1028—
DTBench—59.7%
LMCA—8.8%
Epoch Capabilities Index—136.17

Math Qwen3 8B leads

Phi 3 Mini 128k Instruct: 31.6 (#222), Qwen3 8B: 34.9 (#191)

Math benchmarks
BenchmarkPhi 3 Mini 128k InstructQwen3 8B
OTIS Mock AIME 2024-2025—56.1%
LMArena Math1089—

Knowledge Qwen3 8B leads

Phi 3 Mini 128k Instruct: 26.8 (#254), Qwen3 8B: 36.1 (#173)

Knowledge benchmarks
BenchmarkPhi 3 Mini 128k InstructQwen3 8B
GPQA Diamond—56.8%
Vectara Hallucination Rate—4.8%
LMArena Expert984—

Multilingual Not comparable

Phi 3 Mini 128k Instruct: 25.2 (#285), Qwen3 8B: —

Multilingual benchmarks
BenchmarkPhi 3 Mini 128k InstructQwen3 8B
LMArena Non-English1000—
LMArena Chinese1016—
LMArena French1039—
LMArena German1006—
LMArena Japanese899—
LMArena Korean856—
LMArena Russian1004—
LMArena Spanish1059—

Instruction Following Not comparable

Phi 3 Mini 128k Instruct: 51.8 (#294), Qwen3 8B: —

Instruction Following benchmarks
BenchmarkPhi 3 Mini 128k InstructQwen3 8B
LMArena Instruction Following1023—

Long Context Qwen3 8B leads

Phi 3 Mini 128k Instruct: 30.4 (#289), Qwen3 8B: 37.9 (#210)

Long Context benchmarks
BenchmarkPhi 3 Mini 128k InstructQwen3 8B
Fiction.LiveBench—62.1%
LMArena Longer Query996—

Writing & Preference Not comparable

Phi 3 Mini 128k Instruct: 27.1 (#301), Qwen3 8B: —

Writing & Preference benchmarks
BenchmarkPhi 3 Mini 128k InstructQwen3 8B
LMArena Text1050—
LMArena Creative Writing1024—
LMArena Multi-Turn989—

Frequently asked questions

Is Phi 3 Mini 128k Instruct better than Qwen3 8B?

Qwen3 8B is the stronger model overall, scoring 33.7 to 29.7 on the Noometry Index.

Is Phi 3 Mini 128k Instruct or Qwen3 8B better for coding?

Qwen3 8B scores higher on coding benchmarks: 34.0 versus 28.8 in the Noometry coding category.

How many benchmarks do Phi 3 Mini 128k Instruct and Qwen3 8B share?

0 benchmarks have published results for both models. Phi 3 Mini 128k Instruct has 19 scored results on Noometry and Qwen3 8B has 11.

Related comparisons

Go deeper