Model comparison

Granite 4.0 Micro vs Phi 3 Mini 4k Instruct June 2024

Phi 3 Mini 4k Instruct June 2024 is the stronger model overall, scoring 31.3 to 29.0 on the Noometry Index.

Last verified . 0 shared benchmarks.

Granite 4.0 Micro IBM

29.0

Rank #318 Confirmed

Summary

  • The widest gap is in math, where Phi 3 Mini 4k Instruct June 2024 leads 33.0 to 12.0.

Side by side

Granite 4.0 Micro and Phi 3 Mini 4k Instruct June 2024 specifications
Granite 4.0 MicroPhi 3 Mini 4k Instruct June 2024
ProviderIBMMicrosoft
Noometry Index29.031.3
Released2025-10-02—
WeightsOpenOpen
Context window131K—
Max output118K—
Input $ / M tokens$0.017—
Output $ / M tokens$0.11—
Results tracked815

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Granite 4.0 Micro: —, Phi 3 Mini 4k Instruct June 2024: 31.8 (#279)

Coding benchmarks
BenchmarkGranite 4.0 MicroPhi 3 Mini 4k Instruct June 2024
LMArena Coding—1093

Reasoning Phi 3 Mini 4k Instruct June 2024 leads

Granite 4.0 Micro: 19.2 (#265), Phi 3 Mini 4k Instruct June 2024: 20.8 (#231)

Reasoning benchmarks
BenchmarkGranite 4.0 MicroPhi 3 Mini 4k Instruct June 2024
Chess Puzzles0%—
LMArena Hard Prompts—1087

Math Phi 3 Mini 4k Instruct June 2024 leads

Granite 4.0 Micro: 12.0 (#307), Phi 3 Mini 4k Instruct June 2024: 33.0 (#208)

Math benchmarks
BenchmarkGranite 4.0 MicroPhi 3 Mini 4k Instruct June 2024
OTIS Mock AIME 2024-20252.8%—
Omni-MATH20.9%—
LMArena Math—1152

Knowledge Phi 3 Mini 4k Instruct June 2024 leads

Granite 4.0 Micro: 9.9 (#304), Phi 3 Mini 4k Instruct June 2024: 28.6 (#244)

Knowledge benchmarks
BenchmarkGranite 4.0 MicroPhi 3 Mini 4k Instruct June 2024
GPQA Diamond28.3%—
MMLU-Pro39.5%—
GPQA (HELM)30.7%—
LMArena Expert—1051

Multilingual Not comparable

Granite 4.0 Micro: —, Phi 3 Mini 4k Instruct June 2024: 25.9 (#282)

Multilingual benchmarks
BenchmarkGranite 4.0 MicroPhi 3 Mini 4k Instruct June 2024
LMArena Non-English—1013
LMArena Chinese—1033
LMArena German—1031
LMArena Japanese—954
LMArena Korean—880
LMArena Russian—1019

Instruction Following Granite 4.0 Micro leads

Granite 4.0 Micro: 69.9 (#169), Phi 3 Mini 4k Instruct June 2024: 54.1 (#282)

Instruction Following benchmarks
BenchmarkGranite 4.0 MicroPhi 3 Mini 4k Instruct June 2024
IFEval84.9%—
LMArena Instruction Following—1058

Long Context Not comparable

Granite 4.0 Micro: —, Phi 3 Mini 4k Instruct June 2024: 31.7 (#277)

Long Context benchmarks
BenchmarkGranite 4.0 MicroPhi 3 Mini 4k Instruct June 2024
LMArena Longer Query—1042

Writing & Preference Granite 4.0 Micro leads

Granite 4.0 Micro: 46.7 (#216), Phi 3 Mini 4k Instruct June 2024: 29.6 (#294)

Writing & Preference benchmarks
BenchmarkGranite 4.0 MicroPhi 3 Mini 4k Instruct June 2024
LMArena Text—1080
LMArena Creative Writing—1045
WildBench67%—
LMArena Multi-Turn—1049

Frequently asked questions

Is Granite 4.0 Micro better than Phi 3 Mini 4k Instruct June 2024?

Phi 3 Mini 4k Instruct June 2024 is the stronger model overall, scoring 31.3 to 29.0 on the Noometry Index.

How many benchmarks do Granite 4.0 Micro and Phi 3 Mini 4k Instruct June 2024 share?

0 benchmarks have published results for both models. Granite 4.0 Micro has 8 scored results on Noometry and Phi 3 Mini 4k Instruct June 2024 has 15.

Related comparisons

Go deeper