Model comparison

Granite 4.2 3b vs Phi-1.5

Granite 4.2 3b has enough public results to be ranked (#169); Phi-1.5 does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Granite 4.2 3b IBM

39.4

Rank #169 Confirmed

Phi-1.5 Microsoft

—

Unranked

Side by side

Granite 4.2 3b and Phi-1.5 specifications
Granite 4.2 3bPhi-1.5
ProviderIBMMicrosoft
Noometry Index39.4—
Released—2023-09-11
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked117

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Granite 4.2 3b: 40.0 (#151), Phi-1.5: —

Coding benchmarks
BenchmarkGranite 4.2 3bPhi-1.5
LMArena Coding1361—

Reasoning Not comparable

Granite 4.2 3b: 26.0 (#138), Phi-1.5: —

Reasoning benchmarks
BenchmarkGranite 4.2 3bPhi-1.5
LMArena Hard Prompts1306—
Epoch Capabilities Index—91.53
HellaSwag—47.6%
WinoGrande—73.4%

Knowledge Not comparable

Granite 4.2 3b: 36.3 (#171), Phi-1.5: —

Knowledge benchmarks
BenchmarkGranite 4.2 3bPhi-1.5
LMArena Expert1315—
ARC (AI2) Challenge—44.4%
BoolQ—75.8%
MMLU—37.6%
OpenBookQA—37.2%

Multilingual Not comparable

Granite 4.2 3b: 42.1 (#198), Phi-1.5: —

Multilingual benchmarks
BenchmarkGranite 4.2 3bPhi-1.5
LMArena Non-English1268—
LMArena Chinese1269—
LMArena Russian1249—

Instruction Following Not comparable

Granite 4.2 3b: 67.1 (#200), Phi-1.5: —

Instruction Following benchmarks
BenchmarkGranite 4.2 3bPhi-1.5
LMArena Instruction Following1273—

Long Context Not comparable

Granite 4.2 3b: 39.2 (#185), Phi-1.5: —

Long Context benchmarks
BenchmarkGranite 4.2 3bPhi-1.5
LMArena Longer Query1291—

Writing & Preference Not comparable

Granite 4.2 3b: 47.2 (#212), Phi-1.5: —

Writing & Preference benchmarks
BenchmarkGranite 4.2 3bPhi-1.5
LMArena Text1293—
LMArena Creative Writing1205—
LMArena Multi-Turn1290—

Frequently asked questions

Is Granite 4.2 3b better than Phi-1.5?

Granite 4.2 3b has enough public results to be ranked (#169); Phi-1.5 does not yet, so treat this comparison as directional.

How many benchmarks do Granite 4.2 3b and Phi-1.5 share?

0 benchmarks have published results for both models. Granite 4.2 3b has 11 scored results on Noometry and Phi-1.5 has 7.

Related comparisons

Go deeper