Model comparison

Granite 4.2 3b vs Phi 3 Mini 128k Instruct

Granite 4.2 3b is the stronger model overall, scoring 39.4 to 29.7 on the Noometry Index.

Last verified . 11 shared benchmarks.

Granite 4.2 3b IBM

39.4

Rank #169 Confirmed

Phi 3 Mini 128k Instruct Microsoft

29.7

Rank #305 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Granite 4.2 3b scores higher in 7 categories and Phi 3 Mini 128k Instruct in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Granite 4.2 3b leads 47.2 to 27.1.

Side by side

Granite 4.2 3b and Phi 3 Mini 128k Instruct specifications
Granite 4.2 3bPhi 3 Mini 128k Instruct
ProviderIBMMicrosoft
Noometry Index39.429.7
Released—2024-04-23
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1119

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.2 3b leads

Granite 4.2 3b: 40.0 (#151), Phi 3 Mini 128k Instruct: 28.8 (#312)

Coding benchmarks
BenchmarkGranite 4.2 3bPhi 3 Mini 128k Instruct
LMArena Coding13611039
BigCodeBench Instruct—29.6%
BigCodeBench Complete—40.6%

Reasoning Granite 4.2 3b leads

Granite 4.2 3b: 26.0 (#138), Phi 3 Mini 128k Instruct: 19.6 (#256)

Reasoning benchmarks
BenchmarkGranite 4.2 3bPhi 3 Mini 128k Instruct
LMArena Hard Prompts13061028

Math Not comparable

Granite 4.2 3b: —, Phi 3 Mini 128k Instruct: 31.6 (#222)

Math benchmarks
BenchmarkGranite 4.2 3bPhi 3 Mini 128k Instruct
LMArena Math—1089

Knowledge Granite 4.2 3b leads

Granite 4.2 3b: 36.3 (#171), Phi 3 Mini 128k Instruct: 26.8 (#254)

Knowledge benchmarks
BenchmarkGranite 4.2 3bPhi 3 Mini 128k Instruct
LMArena Expert1315984

Multilingual Granite 4.2 3b leads

Granite 4.2 3b: 42.1 (#198), Phi 3 Mini 128k Instruct: 25.2 (#285)

Multilingual benchmarks
BenchmarkGranite 4.2 3bPhi 3 Mini 128k Instruct
LMArena Non-English12681000
LMArena Chinese12691016
LMArena Russian12491004
LMArena French—1039
LMArena German—1006
LMArena Japanese—899
LMArena Korean—856
LMArena Spanish—1059

Instruction Following Granite 4.2 3b leads

Granite 4.2 3b: 67.1 (#200), Phi 3 Mini 128k Instruct: 51.8 (#294)

Instruction Following benchmarks
BenchmarkGranite 4.2 3bPhi 3 Mini 128k Instruct
LMArena Instruction Following12731023

Long Context Granite 4.2 3b leads

Granite 4.2 3b: 39.2 (#185), Phi 3 Mini 128k Instruct: 30.4 (#289)

Long Context benchmarks
BenchmarkGranite 4.2 3bPhi 3 Mini 128k Instruct
LMArena Longer Query1291996

Writing & Preference Granite 4.2 3b leads

Granite 4.2 3b: 47.2 (#212), Phi 3 Mini 128k Instruct: 27.1 (#301)

Writing & Preference benchmarks
BenchmarkGranite 4.2 3bPhi 3 Mini 128k Instruct
LMArena Text12931050
LMArena Creative Writing12051024
LMArena Multi-Turn1290989

Frequently asked questions

Is Granite 4.2 3b better than Phi 3 Mini 128k Instruct?

Granite 4.2 3b is the stronger model overall, scoring 39.4 to 29.7 on the Noometry Index.

Is Granite 4.2 3b or Phi 3 Mini 128k Instruct better for coding?

Granite 4.2 3b scores higher on coding benchmarks: 40.0 versus 28.8 in the Noometry coding category.

How many benchmarks do Granite 4.2 3b and Phi 3 Mini 128k Instruct share?

11 benchmarks have published results for both models. Granite 4.2 3b has 11 scored results on Noometry and Phi 3 Mini 128k Instruct has 19.

Related comparisons

Go deeper