Noometry

Model comparison

Phi 3 Small 8k Instruct vs Qwen3 Max

Qwen3 Max is the stronger model overall, scoring 43.7 to 29.3 on the Noometry Index.

Last verified . 17 shared benchmarks.

Phi 3 Small 8k Instruct Microsoft

29.3

Rank #314 Confirmed

Qwen3 Max Alibaba (Qwen)

43.7

Rank #87 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Phi 3 Small 8k Instruct scores higher in 0 categories and Qwen3 Max in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3 Max leads 62.4 to 31.1.
  • Phi 3 Small 8k Instruct has downloadable open weights; the other is API-only.

Side by side

Phi 3 Small 8k InstructQwen3 Max
ProviderMicrosoftAlibaba (Qwen)
Noometry Index29.343.7
Released2024-04-232025-09-23
WeightsOpenProprietary
Context window—262K
Max output—66K
Input $ / M tokens—$1.20
Output $ / M tokens—$6
Results tracked3233

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3 Max leads

Phi 3 Small 8k Instruct: 27.9 (#318), Qwen3 Max: 43.0 (#93)

BenchmarkPhi 3 Small 8k InstructQwen3 Max
LMArena Coding11011456
LiveBench Coding20.3%—
ALE-Bench—370.45

Agentic & Tool Use Not comparable

Phi 3 Small 8k Instruct: —, Qwen3 Max: —

BenchmarkPhi 3 Small 8k InstructQwen3 Max
Vending-Bench 2—71.56

Reasoning Qwen3 Max leads

Phi 3 Small 8k Instruct: 14.8 (#323), Qwen3 Max: 22.6 (#190)

BenchmarkPhi 3 Small 8k InstructQwen3 Max
LMArena Hard Prompts11001448
Kagi LLM Benchmark—72.5%
NYT Connections (extended)—30.1%
Chess Puzzles—4%
LiveBench Reasoning15.9%—
Mystery Game Puzzles—5%
DTBench—82.1%
LiveBench Data Analysis30.3%—
LMCA—28.3%
Adversarial NLI58.1%—
BIG-Bench Hard79.1%—
Epoch Capabilities Index—142.38
HellaSwag77%—
LiveBench24%—
WinoGrande81.5%—

Math Qwen3 Max leads

Phi 3 Small 8k Instruct: 27.6 (#248), Qwen3 Max: 38.7 (#131)

BenchmarkPhi 3 Small 8k InstructQwen3 Max
LMArena Math11511446
FrontierMath (Tiers 1-3)—18.9%
OTIS Mock AIME 2024-2025—73.3%
LiveBench Math17.6%—
MATH Level 5—97.1%

Knowledge Qwen3 Max leads

Phi 3 Small 8k Instruct: 29.1 (#240), Qwen3 Max: 48.1 (#78)

BenchmarkPhi 3 Small 8k InstructQwen3 Max
LMArena Expert10671455
GPQA Diamond—72.6%
SimpleQA Verified—48.7%
ARC (AI2) Challenge90.7%—
MMLU75.7%—
OpenBookQA88%—
TriviaQA58.1%—

Multilingual Qwen3 Max leads

Phi 3 Small 8k Instruct: 28.5 (#272), Qwen3 Max: 53.7 (#62)

BenchmarkPhi 3 Small 8k InstructQwen3 Max
LMArena Non-English10581429
LMArena Chinese10611478
LMArena French11351449
LMArena German10801463
LMArena Japanese9661397
LMArena Korean8941399
LMArena Russian11111428
LMArena Spanish11111462

Instruction Following Qwen3 Max leads

Phi 3 Small 8k Instruct: 51.9 (#292), Qwen3 Max: 74.8 (#87)

BenchmarkPhi 3 Small 8k InstructQwen3 Max
LMArena Instruction Following10871419
LiveBench Instruction Following47.2%—

Long Context Qwen3 Max leads

Phi 3 Small 8k Instruct: 33.0 (#267), Qwen3 Max: 41.6 (#134)

BenchmarkPhi 3 Small 8k InstructQwen3 Max
LMArena Longer Query10881438
Fiction.LiveBench—66.7%
CL-bench—14.5%

Writing & Preference Qwen3 Max leads

Phi 3 Small 8k Instruct: 31.1 (#284), Qwen3 Max: 62.4 (#76)

BenchmarkPhi 3 Small 8k InstructQwen3 Max
LMArena Text11101439
LMArena Creative Writing10831402
LMArena Multi-Turn10681446
LiveBench Language12.9%—

Frequently asked questions

Is Phi 3 Small 8k Instruct better than Qwen3 Max?

Qwen3 Max is the stronger model overall, scoring 43.7 to 29.3 on the Noometry Index.

Is Phi 3 Small 8k Instruct or Qwen3 Max better for coding?

Qwen3 Max scores higher on coding benchmarks: 43.0 versus 27.9 in the Noometry coding category.

How many benchmarks do Phi 3 Small 8k Instruct and Qwen3 Max share?

17 benchmarks have published results for both models. Phi 3 Small 8k Instruct has 32 scored results on Noometry and Qwen3 Max has 33.

Related comparisons

Go deeper