Model comparison

Granite 4.2 3b vs Phi 3 Medium 4k Instruct

Granite 4.2 3b is the stronger model overall, scoring 39.4 to 33.0 on the Noometry Index.

Last verified . 11 shared benchmarks.

Granite 4.2 3b IBM

39.4

Rank #169 Confirmed

Phi 3 Medium 4k Instruct Microsoft

33.0

Rank #250 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Granite 4.2 3b scores higher in 7 categories and Phi 3 Medium 4k Instruct in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Granite 4.2 3b leads 47.2 to 34.1.

Side by side

Granite 4.2 3b and Phi 3 Medium 4k Instruct specifications
Granite 4.2 3bPhi 3 Medium 4k Instruct
ProviderIBMMicrosoft
Noometry Index39.433.0
Released——
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1117

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.2 3b leads

Granite 4.2 3b: 40.0 (#151), Phi 3 Medium 4k Instruct: 32.9 (#268)

Coding benchmarks
BenchmarkGranite 4.2 3bPhi 3 Medium 4k Instruct
LMArena Coding13611130

Reasoning Granite 4.2 3b leads

Granite 4.2 3b: 26.0 (#138), Phi 3 Medium 4k Instruct: 21.7 (#214)

Reasoning benchmarks
BenchmarkGranite 4.2 3bPhi 3 Medium 4k Instruct
LMArena Hard Prompts13061127

Math Not comparable

Granite 4.2 3b: —, Phi 3 Medium 4k Instruct: 33.4 (#202)

Math benchmarks
BenchmarkGranite 4.2 3bPhi 3 Medium 4k Instruct
LMArena Math—1173

Knowledge Granite 4.2 3b leads

Granite 4.2 3b: 36.3 (#171), Phi 3 Medium 4k Instruct: 30.2 (#229)

Knowledge benchmarks
BenchmarkGranite 4.2 3bPhi 3 Medium 4k Instruct
LMArena Expert13151108

Multilingual Granite 4.2 3b leads

Granite 4.2 3b: 42.1 (#198), Phi 3 Medium 4k Instruct: 30.6 (#263)

Multilingual benchmarks
BenchmarkGranite 4.2 3bPhi 3 Medium 4k Instruct
LMArena Non-English12681094
LMArena Chinese12691108
LMArena Russian12491145
LMArena French—1110
LMArena German—1101
LMArena Japanese—1042
LMArena Korean—954
LMArena Spanish—1095

Instruction Following Granite 4.2 3b leads

Granite 4.2 3b: 67.1 (#200), Phi 3 Medium 4k Instruct: 57.6 (#268)

Instruction Following benchmarks
BenchmarkGranite 4.2 3bPhi 3 Medium 4k Instruct
LMArena Instruction Following12731113

Long Context Granite 4.2 3b leads

Granite 4.2 3b: 39.2 (#185), Phi 3 Medium 4k Instruct: 34.0 (#255)

Long Context benchmarks
BenchmarkGranite 4.2 3bPhi 3 Medium 4k Instruct
LMArena Longer Query12911120

Writing & Preference Granite 4.2 3b leads

Granite 4.2 3b: 47.2 (#212), Phi 3 Medium 4k Instruct: 34.1 (#272)

Writing & Preference benchmarks
BenchmarkGranite 4.2 3bPhi 3 Medium 4k Instruct
LMArena Text12931138
LMArena Creative Writing12051107
LMArena Multi-Turn12901088

Frequently asked questions

Is Granite 4.2 3b better than Phi 3 Medium 4k Instruct?

Granite 4.2 3b is the stronger model overall, scoring 39.4 to 33.0 on the Noometry Index.

Is Granite 4.2 3b or Phi 3 Medium 4k Instruct better for coding?

Granite 4.2 3b scores higher on coding benchmarks: 40.0 versus 32.9 in the Noometry coding category.

How many benchmarks do Granite 4.2 3b and Phi 3 Medium 4k Instruct share?

11 benchmarks have published results for both models. Granite 4.2 3b has 11 scored results on Noometry and Phi 3 Medium 4k Instruct has 17.

Related comparisons

Go deeper