Model comparison

Phi-3.5-mini vs Wizardlm 70b

Wizardlm 70b has enough public results to be ranked (#245); Phi-3.5-mini does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Phi-3.5-mini Microsoft

36.4

Unranked Sparse

Wizardlm 70b Microsoft

32.4

Rank #245 Confirmed

Summary

  • The widest gap is in coding, where Phi-3.5-mini leads 34.0 to 30.9.

Side by side

Phi-3.5-mini and Wizardlm 70b specifications
Phi-3.5-miniWizardlm 70b
ProviderMicrosoftMicrosoft
Noometry Index36.432.4
Released2024-08-16—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked512

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Phi-3.5-mini leads

Phi-3.5-mini: 34.0 (#231), Wizardlm 70b: 30.9 (#280)

Coding benchmarks
BenchmarkPhi-3.5-miniWizardlm 70b
BigCodeBench Instruct32.8%—
LMArena Coding—1081
BigCodeBench Complete38.5%—

Reasoning Not comparable

Phi-3.5-mini: —, Wizardlm 70b: 19.8 (#231)

Reasoning benchmarks
BenchmarkPhi-3.5-miniWizardlm 70b
LMArena Hard Prompts—1079
PIQA81%—

Math Not comparable

Phi-3.5-mini: —, Wizardlm 70b: 29.7 (#216)

Math benchmarks
BenchmarkPhi-3.5-miniWizardlm 70b
LMArena Math—1116
GSM8K86.2%—

Knowledge Not comparable

Phi-3.5-mini: —, Wizardlm 70b: —

Knowledge benchmarks
BenchmarkPhi-3.5-miniWizardlm 70b
BoolQ78%—

Multilingual Not comparable

Phi-3.5-mini: —, Wizardlm 70b: 29.8 (#260)

Multilingual benchmarks
BenchmarkPhi-3.5-miniWizardlm 70b
LMArena Non-English—1078
LMArena Chinese—1052
LMArena German—1083
LMArena Russian—1155

Instruction Following Not comparable

Phi-3.5-mini: —, Wizardlm 70b: 56.5 (#268)

Instruction Following benchmarks
BenchmarkPhi-3.5-miniWizardlm 70b
LMArena Instruction Following—1093

Long Context Not comparable

Phi-3.5-mini: —, Wizardlm 70b: 33.3 (#258)

Long Context benchmarks
BenchmarkPhi-3.5-miniWizardlm 70b
LMArena Longer Query—1097

Writing & Preference Not comparable

Phi-3.5-mini: —, Wizardlm 70b: 34.9 (#264)

Writing & Preference benchmarks
BenchmarkPhi-3.5-miniWizardlm 70b
LMArena Text—1120
LMArena Creative Writing—1149
LMArena Multi-Turn—1108

Frequently asked questions

Is Phi-3.5-mini better than Wizardlm 70b?

Wizardlm 70b has enough public results to be ranked (#245); Phi-3.5-mini does not yet, so treat this comparison as directional.

Is Phi-3.5-mini or Wizardlm 70b better for coding?

Phi-3.5-mini scores higher on coding benchmarks: 34.0 versus 30.9 in the Noometry coding category.

How many benchmarks do Phi-3.5-mini and Wizardlm 70b share?

0 benchmarks have published results for both models. Phi-3.5-mini has 5 scored results on Noometry and Wizardlm 70b has 12.

Related comparisons

Go deeper