Noometry

Model comparison

Phi 3 Small 8k Instruct vs Qwen3.7 Plus

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 29.3 on the Noometry Index.

Last verified . 17 shared benchmarks.

Phi 3 Small 8k Instruct Microsoft

29.3

Rank #314 Confirmed

Qwen3.7 Plus Alibaba (Qwen)

45.3

Rank #72 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Phi 3 Small 8k Instruct scores higher in 0 categories and Qwen3.7 Plus in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3.7 Plus leads 64.3 to 31.1.
  • Phi 3 Small 8k Instruct has downloadable open weights; the other is API-only.

Side by side

Phi 3 Small 8k InstructQwen3.7 Plus
ProviderMicrosoftAlibaba (Qwen)
Noometry Index29.345.3
Released2024-04-232026-06-02
WeightsOpenProprietary
Context window—1M
Max output—131K
Input $ / M tokens—$0.40
Output $ / M tokens—$1.60
Results tracked3232

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.7 Plus leads

Phi 3 Small 8k Instruct: 27.9 (#318), Qwen3.7 Plus: 36.6 (#206)

BenchmarkPhi 3 Small 8k InstructQwen3.7 Plus
LMArena Coding11011473
FrontierCode—10.2%
SciCode—45.5%
LiveBench Coding20.3%—

Agentic & Tool Use Not comparable

Phi 3 Small 8k Instruct: —, Qwen3.7 Plus: 21.4 (#138)

BenchmarkPhi 3 Small 8k InstructQwen3.7 Plus
OSWorld 2.0—2.8%

Reasoning Qwen3.7 Plus leads

Phi 3 Small 8k Instruct: 14.8 (#323), Qwen3.7 Plus: 39.3 (#59)

BenchmarkPhi 3 Small 8k InstructQwen3.7 Plus
LMArena Hard Prompts11001460
NYT Connections (extended)—74.8%
CritPt—9.1%
Chess Puzzles—24%
LiveBench Reasoning15.9%—
Mystery Game Puzzles—17%
DTBench—84%
LiveBench Data Analysis30.3%—
LMCA—37.6%
Adversarial NLI58.1%—
BIG-Bench Hard79.1%—
Epoch Capabilities Index—147.37
HellaSwag77%—
LiveBench24%—
WinoGrande81.5%—

Math Qwen3.7 Plus leads

Phi 3 Small 8k Instruct: 27.6 (#248), Qwen3.7 Plus: 50.5 (#56)

BenchmarkPhi 3 Small 8k InstructQwen3.7 Plus
LMArena Math11511466
FrontierMath (Tiers 1-3)—34.4%
OTIS Mock AIME 2024-2025—93.3%
LiveBench Math17.6%—

Knowledge Qwen3.7 Plus leads

Phi 3 Small 8k Instruct: 29.1 (#240), Qwen3.7 Plus: 54.9 (#51)

BenchmarkPhi 3 Small 8k InstructQwen3.7 Plus
LMArena Expert10671467
GPQA Diamond—87.9%
ARC (AI2) Challenge90.7%—
MMLU75.7%—
OpenBookQA88%—
TriviaQA58.1%—

Multimodal Not comparable

Phi 3 Small 8k Instruct: —, Qwen3.7 Plus: 41.8 (#33)

BenchmarkPhi 3 Small 8k InstructQwen3.7 Plus
LMArena Vision—1279
LMArena Document—1444

Multilingual Qwen3.7 Plus leads

Phi 3 Small 8k Instruct: 28.5 (#272), Qwen3.7 Plus: 54.8 (#38)

BenchmarkPhi 3 Small 8k InstructQwen3.7 Plus
LMArena Non-English10581445
LMArena Chinese10611510
LMArena French11351473
LMArena German10801471
LMArena Japanese9661413
LMArena Korean8941415
LMArena Russian11111457
LMArena Spanish11111457

Instruction Following Qwen3.7 Plus leads

Phi 3 Small 8k Instruct: 51.9 (#292), Qwen3.7 Plus: 75.8 (#52)

BenchmarkPhi 3 Small 8k InstructQwen3.7 Plus
LMArena Instruction Following10871440
LiveBench Instruction Following47.2%—

Long Context Qwen3.7 Plus leads

Phi 3 Small 8k Instruct: 33.0 (#267), Qwen3.7 Plus: 44.5 (#65)

BenchmarkPhi 3 Small 8k InstructQwen3.7 Plus
LMArena Longer Query10881455

Writing & Preference Qwen3.7 Plus leads

Phi 3 Small 8k Instruct: 31.1 (#284), Qwen3.7 Plus: 64.3 (#56)

BenchmarkPhi 3 Small 8k InstructQwen3.7 Plus
LMArena Text11101455
LMArena Creative Writing10831439
LMArena Multi-Turn10681460
LiveBench Language12.9%—

Frequently asked questions

Is Phi 3 Small 8k Instruct better than Qwen3.7 Plus?

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 29.3 on the Noometry Index.

Is Phi 3 Small 8k Instruct or Qwen3.7 Plus better for coding?

Qwen3.7 Plus scores higher on coding benchmarks: 36.6 versus 27.9 in the Noometry coding category.

How many benchmarks do Phi 3 Small 8k Instruct and Qwen3.7 Plus share?

17 benchmarks have published results for both models. Phi 3 Small 8k Instruct has 32 scored results on Noometry and Qwen3.7 Plus has 32.

Related comparisons

Go deeper