Model comparison

Granite 4.0 Micro vs Phi 3 Mini 4k Instruct

Granite 4.0 Micro is the stronger model overall, scoring 29.0 to 27.9 on the Noometry Index.

Last verified . 1 shared benchmarks.

Granite 4.0 Micro IBM

29.0

Rank #318 Confirmed

Phi 3 Mini 4k Instruct Microsoft

27.9

Rank #328 Confirmed

Summary

  • They share 1 benchmark with published results for both. Granite 4.0 Micro scores higher in 3 categories and Phi 3 Mini 4k Instruct in 2 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in instruction following, where Granite 4.0 Micro leads 69.9 to 47.7.

Side by side

Granite 4.0 Micro and Phi 3 Mini 4k Instruct specifications
Granite 4.0 MicroPhi 3 Mini 4k Instruct
ProviderIBMMicrosoft
Noometry Index29.027.9
Released2025-10-022024-04-23
WeightsOpenOpen
Context window131K—
Max output118K—
Input $ / M tokens$0.017—
Output $ / M tokens$0.11—
Results tracked835

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Granite 4.0 Micro: —, Phi 3 Mini 4k Instruct: 26.6 (#323)

Coding benchmarks
BenchmarkGranite 4.0 MicroPhi 3 Mini 4k Instruct
LiveBench Coding—15.5%
LMArena Coding—1093
HumanEval+—59.1%
MBPP+—54.2%

Reasoning Granite 4.0 Micro leads

Granite 4.0 Micro: 19.2 (#265), Phi 3 Mini 4k Instruct: 14.1 (#328)

Reasoning benchmarks
BenchmarkGranite 4.0 MicroPhi 3 Mini 4k Instruct
Chess Puzzles0%0%
LiveBench Reasoning—26.8%
LMArena Hard Prompts—1072
LiveBench Data Analysis—34.7%
Adversarial NLI—52.8%
BIG-Bench Hard—71.7%
HellaSwag—76.7%
LiveBench—22.4%
WinoGrande—70.8%

Math Phi 3 Mini 4k Instruct leads

Granite 4.0 Micro: 12.0 (#307), Phi 3 Mini 4k Instruct: 26.6 (#257)

Math benchmarks
BenchmarkGranite 4.0 MicroPhi 3 Mini 4k Instruct
OTIS Mock AIME 2024-20252.8%—
Omni-MATH20.9%—
LiveBench Math—15.7%
LMArena Math—1111

Knowledge Phi 3 Mini 4k Instruct leads

Granite 4.0 Micro: 9.9 (#304), Phi 3 Mini 4k Instruct: 28.5 (#246)

Knowledge benchmarks
BenchmarkGranite 4.0 MicroPhi 3 Mini 4k Instruct
GPQA Diamond28.3%—
MMLU-Pro39.5%—
GPQA (HELM)30.7%—
LMArena Expert—1045
ARC (AI2) Challenge—84.9%
MMLU—68.8%
OpenBookQA—88%
TriviaQA—64%

Multilingual Not comparable

Granite 4.0 Micro: —, Phi 3 Mini 4k Instruct: 26.3 (#280)

Multilingual benchmarks
BenchmarkGranite 4.0 MicroPhi 3 Mini 4k Instruct
LMArena Non-English—1021
LMArena Chinese—1021
LMArena French—1076
LMArena German—1044
LMArena Japanese—935
LMArena Korean—905
LMArena Russian—1022
LMArena Spanish—1085

Instruction Following Granite 4.0 Micro leads

Granite 4.0 Micro: 69.9 (#169), Phi 3 Mini 4k Instruct: 47.7 (#303)

Instruction Following benchmarks
BenchmarkGranite 4.0 MicroPhi 3 Mini 4k Instruct
LiveBench Instruction Following—39.1%
IFEval84.9%—
LMArena Instruction Following—1053

Long Context Not comparable

Granite 4.0 Micro: —, Phi 3 Mini 4k Instruct: 31.7 (#276)

Long Context benchmarks
BenchmarkGranite 4.0 MicroPhi 3 Mini 4k Instruct
LMArena Longer Query—1044

Writing & Preference Granite 4.0 Micro leads

Granite 4.0 Micro: 46.7 (#216), Phi 3 Mini 4k Instruct: 27.6 (#300)

Writing & Preference benchmarks
BenchmarkGranite 4.0 MicroPhi 3 Mini 4k Instruct
LMArena Text—1073
LMArena Creative Writing—1037
WildBench67%—
LMArena Multi-Turn—1018
LiveBench Language—9.2%

Frequently asked questions

Is Granite 4.0 Micro better than Phi 3 Mini 4k Instruct?

Granite 4.0 Micro is the stronger model overall, scoring 29.0 to 27.9 on the Noometry Index.

How many benchmarks do Granite 4.0 Micro and Phi 3 Mini 4k Instruct share?

1 benchmark has published results for both models. Granite 4.0 Micro has 8 scored results on Noometry and Phi 3 Mini 4k Instruct has 35.

Related comparisons

Go deeper