Noometry

Model comparison

Phi 3 Mini 4k Instruct vs Qwen3.7 Flash

Qwen3.7 Flash is the stronger model overall, scoring 39.9 to 27.9 on the Noometry Index.

Last verified . 1 shared benchmarks.

Phi 3 Mini 4k Instruct Microsoft

27.9

Rank #328 Confirmed

Qwen3.7 Flash Alibaba (Qwen)

39.9

Rank #156 Confirmed

Summary

  • They share 1 benchmark with published results for both. Phi 3 Mini 4k Instruct scores higher in 0 categories and Qwen3.7 Flash in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.7 Flash leads 48.9 to 28.5.
  • The biggest single-benchmark swing is Chess Puzzles: 0% for Phi 3 Mini 4k Instruct and 23% for Qwen3.7 Flash.
  • Phi 3 Mini 4k Instruct has downloadable open weights; the other is API-only.

Side by side

Phi 3 Mini 4k InstructQwen3.7 Flash
ProviderMicrosoftAlibaba (Qwen)
Noometry Index27.939.9
Released2024-04-232026-07-15
WeightsOpenProprietary
Context window—1M
Max output—131K
Input $ / M tokens—$0.03
Output $ / M tokens—$0.13
Results tracked357

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Phi 3 Mini 4k Instruct: 26.6 (#323), Qwen3.7 Flash: —

BenchmarkPhi 3 Mini 4k InstructQwen3.7 Flash
LiveBench Coding15.5%—
LMArena Coding1093—
HumanEval+59.1%—
MBPP+54.2%—

Reasoning Qwen3.7 Flash leads

Phi 3 Mini 4k Instruct: 14.1 (#328), Qwen3.7 Flash: 28.2 (#108)

BenchmarkPhi 3 Mini 4k InstructQwen3.7 Flash
Chess Puzzles0%23%
NYT Connections (extended)—43.8%
LiveBench Reasoning26.8%—
LMArena Hard Prompts1072—
Mystery Game Puzzles—15%
LiveBench Data Analysis34.7%—
Adversarial NLI52.8%—
BIG-Bench Hard71.7%—
Epoch Capabilities Index—144.64
HellaSwag76.7%—
LiveBench22.4%—
WinoGrande70.8%—

Math Qwen3.7 Flash leads

Phi 3 Mini 4k Instruct: 26.6 (#257), Qwen3.7 Flash: 38.3 (#140)

BenchmarkPhi 3 Mini 4k InstructQwen3.7 Flash
FrontierMath (Tiers 1-3)—19.3%
OTIS Mock AIME 2024-2025—86.7%
LiveBench Math15.7%—
LMArena Math1111—

Knowledge Qwen3.7 Flash leads

Phi 3 Mini 4k Instruct: 28.5 (#246), Qwen3.7 Flash: 48.9 (#75)

BenchmarkPhi 3 Mini 4k InstructQwen3.7 Flash
GPQA Diamond—82.3%
LMArena Expert1045—
ARC (AI2) Challenge84.9%—
MMLU68.8%—
OpenBookQA88%—
TriviaQA64%—

Multilingual Not comparable

Phi 3 Mini 4k Instruct: 26.3 (#280), Qwen3.7 Flash: —

BenchmarkPhi 3 Mini 4k InstructQwen3.7 Flash
LMArena Non-English1021—
LMArena Chinese1021—
LMArena French1076—
LMArena German1044—
LMArena Japanese935—
LMArena Korean905—
LMArena Russian1022—
LMArena Spanish1085—

Instruction Following Not comparable

Phi 3 Mini 4k Instruct: 47.7 (#303), Qwen3.7 Flash: —

BenchmarkPhi 3 Mini 4k InstructQwen3.7 Flash
LiveBench Instruction Following39.1%—
LMArena Instruction Following1053—

Long Context Not comparable

Phi 3 Mini 4k Instruct: 31.7 (#276), Qwen3.7 Flash: —

BenchmarkPhi 3 Mini 4k InstructQwen3.7 Flash
LMArena Longer Query1044—

Writing & Preference Not comparable

Phi 3 Mini 4k Instruct: 27.6 (#300), Qwen3.7 Flash: —

BenchmarkPhi 3 Mini 4k InstructQwen3.7 Flash
LMArena Text1073—
LMArena Creative Writing1037—
LMArena Multi-Turn1018—
LiveBench Language9.2%—

Frequently asked questions

Is Phi 3 Mini 4k Instruct better than Qwen3.7 Flash?

Qwen3.7 Flash is the stronger model overall, scoring 39.9 to 27.9 on the Noometry Index.

How many benchmarks do Phi 3 Mini 4k Instruct and Qwen3.7 Flash share?

1 benchmark has published results for both models. Phi 3 Mini 4k Instruct has 35 scored results on Noometry and Qwen3.7 Flash has 7.

Related comparisons

Go deeper