Model comparison

Phi-1.5 vs Qwen3 8B

Qwen3 8B has enough public results to be ranked (#238); Phi-1.5 does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Phi-1.5 Microsoft

—

Unranked

Qwen3 8B Alibaba (Qwen)

33.7

Rank #238 Confirmed

Summary

  • They share 1 benchmark with published results for both.

Side by side

Phi-1.5 and Qwen3 8B specifications
Phi-1.5Qwen3 8B
ProviderMicrosoftAlibaba (Qwen)
Noometry Index—33.7
Released2023-09-112025-04
WeightsOpenOpen
Context window—131K
Max output—8K
Input $ / M tokens—$0.18
Output $ / M tokens—$0.70
Results tracked711

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Phi-1.5: —, Qwen3 8B: 34.0 (#248)

Coding benchmarks
BenchmarkPhi-1.5Qwen3 8B
SciCode—22.6%

Agentic & Tool Use Not comparable

Phi-1.5: —, Qwen3 8B: 30.2 (#78)

Agentic & Tool Use benchmarks
BenchmarkPhi-1.5Qwen3 8B
Berkeley Function Calling Leaderboard—42.6%

Reasoning Not comparable

Phi-1.5: —, Qwen3 8B: 16.6 (#303)

Reasoning benchmarks
BenchmarkPhi-1.5Qwen3 8B
Epoch Capabilities Index91.53136.17
CritPt—0%
Chess Puzzles—5%
DTBench—59.7%
LMCA—8.8%
HellaSwag47.6%—
WinoGrande73.4%—

Math Not comparable

Phi-1.5: —, Qwen3 8B: 34.9 (#191)

Math benchmarks
BenchmarkPhi-1.5Qwen3 8B
OTIS Mock AIME 2024-2025—56.1%

Knowledge Not comparable

Phi-1.5: —, Qwen3 8B: 36.1 (#173)

Knowledge benchmarks
BenchmarkPhi-1.5Qwen3 8B
GPQA Diamond—56.8%
Vectara Hallucination Rate—4.8%
ARC (AI2) Challenge44.4%—
BoolQ75.8%—
MMLU37.6%—
OpenBookQA37.2%—

Long Context Not comparable

Phi-1.5: —, Qwen3 8B: 37.9 (#210)

Long Context benchmarks
BenchmarkPhi-1.5Qwen3 8B
Fiction.LiveBench—62.1%

Frequently asked questions

Is Phi-1.5 better than Qwen3 8B?

Qwen3 8B has enough public results to be ranked (#238); Phi-1.5 does not yet, so treat this comparison as directional.

How many benchmarks do Phi-1.5 and Qwen3 8B share?

1 benchmark has published results for both models. Phi-1.5 has 7 scored results on Noometry and Qwen3 8B has 11.

Related comparisons

Go deeper