Noometry

Model comparison

Phi 3 Small 8k Instruct vs Qwen3.5 35B-A3B

Qwen3.5 35B-A3B is the stronger model overall, scoring 41.7 to 28.8 on the Noometry Index.

Last verified . 17 shared benchmarks.

Phi 3 Small 8k Instruct Microsoft

28.8

Rank #310 Confirmed

Qwen3.5 35B-A3B Alibaba (Qwen)

41.7

Rank #118 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Phi 3 Small 8k Instruct scores higher in 0 categories and Qwen3.5 35B-A3B in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3.5 35B-A3B leads 58.1 to 31.3.

Side by side

Phi 3 Small 8k InstructQwen3.5 35B-A3B
ProviderMicrosoftAlibaba (Qwen)
Noometry Index28.841.7
Released2024-04-232026-02-01
WeightsOpenOpen
Context window—262K
Max output—66K
Input $ / M tokens—$0.25
Output $ / M tokens—$2
Results tracked3228

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5 35B-A3B leads

Phi 3 Small 8k Instruct: 27.4 (#313), Qwen3.5 35B-A3B: 33.5 (#244)

BenchmarkPhi 3 Small 8k InstructQwen3.5 35B-A3B
LMArena Coding11021410
LMArena WebDev—1254
SciCode—29.3%
LiveBench Coding20.3%—

Reasoning Qwen3.5 35B-A3B leads

Phi 3 Small 8k Instruct: 14.2 (#319), Qwen3.5 35B-A3B: 23.9 (#158)

BenchmarkPhi 3 Small 8k InstructQwen3.5 35B-A3B
LMArena Hard Prompts11001400
CritPt—0.6%
Chess Puzzles—10%
LiveBench Reasoning15.9%—
DTBench—80%
LiveBench Data Analysis30.3%—
LMCA—29.5%
Adversarial NLI58.1%—
BIG-Bench Hard79.1%—
Epoch Capabilities Index—142.52
HellaSwag77%—
LiveBench24%—
WinoGrande81.5%—

Math Qwen3.5 35B-A3B leads

Phi 3 Small 8k Instruct: 25.4 (#247), Qwen3.5 35B-A3B: 38.4 (#86)

BenchmarkPhi 3 Small 8k InstructQwen3.5 35B-A3B
LMArena Math11511404
MathArena Final-Answer Competitions—56%
OTIS Mock AIME 2024-2025—70%
LiveBench Math17.6%—

Knowledge Qwen3.5 35B-A3B leads

Phi 3 Small 8k Instruct: 28.5 (#237), Qwen3.5 35B-A3B: 47.7 (#73)

BenchmarkPhi 3 Small 8k InstructQwen3.5 35B-A3B
LMArena Expert10671408
GPQA Diamond—83.5%
Vectara Hallucination Rate—10.5%
ARC (AI2) Challenge90.7%—
MMLU75.7%—
OpenBookQA88%—
TriviaQA58.1%—

Multilingual Qwen3.5 35B-A3B leads

Phi 3 Small 8k Instruct: 28.6 (#267), Qwen3.5 35B-A3B: 50.2 (#122)

BenchmarkPhi 3 Small 8k InstructQwen3.5 35B-A3B
LMArena Non-English10581379
LMArena Chinese10611458
LMArena French11341412
LMArena German10801367
LMArena Japanese9661326
LMArena Korean8941354
LMArena Russian11111377
LMArena Spanish11111390

Instruction Following Qwen3.5 35B-A3B leads

Phi 3 Small 8k Instruct: 52.2 (#287), Qwen3.5 35B-A3B: 73.0 (#123)

BenchmarkPhi 3 Small 8k InstructQwen3.5 35B-A3B
LMArena Instruction Following10871379
LiveBench Instruction Following47.2%—

Long Context Qwen3.5 35B-A3B leads

Phi 3 Small 8k Instruct: 33.0 (#262), Qwen3.5 35B-A3B: 42.4 (#122)

BenchmarkPhi 3 Small 8k InstructQwen3.5 35B-A3B
LMArena Longer Query10881390

Writing & Preference Qwen3.5 35B-A3B leads

Phi 3 Small 8k Instruct: 31.3 (#279), Qwen3.5 35B-A3B: 58.1 (#118)

BenchmarkPhi 3 Small 8k InstructQwen3.5 35B-A3B
LMArena Text11101395
LMArena Creative Writing10831347
LMArena Multi-Turn10681391
LiveBench Language12.9%—

Frequently asked questions

Is Phi 3 Small 8k Instruct better than Qwen3.5 35B-A3B?

Qwen3.5 35B-A3B is the stronger model overall, scoring 41.7 to 28.8 on the Noometry Index.

Is Phi 3 Small 8k Instruct or Qwen3.5 35B-A3B better for coding?

Qwen3.5 35B-A3B scores higher on coding benchmarks: 33.5 versus 27.4 in the Noometry coding category.

How many benchmarks do Phi 3 Small 8k Instruct and Qwen3.5 35B-A3B share?

17 benchmarks have published results for both models. Phi 3 Small 8k Instruct has 32 scored results on Noometry and Qwen3.5 35B-A3B has 28.

Related comparisons

Go deeper