Model comparison

Phi-3.5-MoE vs Qwen-7B

Neither Phi-3.5-MoE nor Qwen-7B has enough public benchmark results to be ranked yet; the rows below show what has been published.

Last verified . 3 shared benchmarks.

Summary

  • They share 3 benchmarks with published results for both.

Side by side

Phi-3.5-MoE and Qwen-7B specifications
Phi-3.5-MoEQwen-7B
ProviderMicrosoftAlibaba (Qwen)
Noometry Index——
Released2024-08-172023-09-28
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked38

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Reasoning Not comparable

Phi-3.5-MoE: —, Qwen-7B: —

Reasoning benchmarks
BenchmarkPhi-3.5-MoEQwen-7B
PIQA88.6%77.9%
BIG-Bench Hard—45%
Epoch Capabilities Index—106.83
LAMBADA—67.9%

Math Not comparable

Phi-3.5-MoE: —, Qwen-7B: —

Math benchmarks
BenchmarkPhi-3.5-MoEQwen-7B
GSM8K88.7%51.7%

Knowledge Not comparable

Phi-3.5-MoE: —, Qwen-7B: —

Knowledge benchmarks
BenchmarkPhi-3.5-MoEQwen-7B
BoolQ84.6%76.4%
ARC (AI2) Challenge—75.3%
MMLU—45%

Frequently asked questions

Is Phi-3.5-MoE better than Qwen-7B?

Neither Phi-3.5-MoE nor Qwen-7B has enough public benchmark results to be ranked yet; the rows below show what has been published.

How many benchmarks do Phi-3.5-MoE and Qwen-7B share?

3 benchmarks have published results for both models. Phi-3.5-MoE has 3 scored results on Noometry and Qwen-7B has 8.

Related comparisons

Go deeper