Model comparison

Phi-1.5 vs Wizardlm 70b

Wizardlm 70b has enough public results to be ranked (#249); Phi-1.5 does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Phi-1.5 Microsoft

—

Unranked

Wizardlm 70b Microsoft

33.0

Rank #249 Confirmed

Side by side

Phi-1.5 and Wizardlm 70b specifications
Phi-1.5Wizardlm 70b
ProviderMicrosoftMicrosoft
Noometry Index—33.0
Released2023-09-11—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked712

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Phi-1.5: —, Wizardlm 70b: 31.4 (#285)

Coding benchmarks
BenchmarkPhi-1.5Wizardlm 70b
LMArena Coding—1081

Reasoning Not comparable

Phi-1.5: —, Wizardlm 70b: 20.7 (#234)

Reasoning benchmarks
BenchmarkPhi-1.5Wizardlm 70b
LMArena Hard Prompts—1079
Epoch Capabilities Index91.53—
HellaSwag47.6%—
WinoGrande73.4%—

Math Not comparable

Phi-1.5: —, Wizardlm 70b: 32.2 (#218)

Math benchmarks
BenchmarkPhi-1.5Wizardlm 70b
LMArena Math—1116

Knowledge Not comparable

Phi-1.5: —, Wizardlm 70b: —

Knowledge benchmarks
BenchmarkPhi-1.5Wizardlm 70b
ARC (AI2) Challenge44.4%—
BoolQ75.8%—
MMLU37.6%—
OpenBookQA37.2%—

Multilingual Not comparable

Phi-1.5: —, Wizardlm 70b: 29.6 (#265)

Multilingual benchmarks
BenchmarkPhi-1.5Wizardlm 70b
LMArena Non-English—1078
LMArena Chinese—1052
LMArena German—1083
LMArena Russian—1155

Instruction Following Not comparable

Phi-1.5: —, Wizardlm 70b: 56.3 (#273)

Instruction Following benchmarks
BenchmarkPhi-1.5Wizardlm 70b
LMArena Instruction Following—1093

Long Context Not comparable

Phi-1.5: —, Wizardlm 70b: 33.3 (#263)

Long Context benchmarks
BenchmarkPhi-1.5Wizardlm 70b
LMArena Longer Query—1097

Writing & Preference Not comparable

Phi-1.5: —, Wizardlm 70b: 34.8 (#269)

Writing & Preference benchmarks
BenchmarkPhi-1.5Wizardlm 70b
LMArena Text—1120
LMArena Creative Writing—1149
LMArena Multi-Turn—1108

Frequently asked questions

Is Phi-1.5 better than Wizardlm 70b?

Wizardlm 70b has enough public results to be ranked (#249); Phi-1.5 does not yet, so treat this comparison as directional.

How many benchmarks do Phi-1.5 and Wizardlm 70b share?

0 benchmarks have published results for both models. Phi-1.5 has 7 scored results on Noometry and Wizardlm 70b has 12.

Related comparisons

Go deeper