Model comparison

Grok 4.7 vs Phi 3 Mini 128k Instruct

Grok 4.7 is the stronger model overall, scoring 53.1 to 29.7 on the Noometry Index.

Last verified . 14 shared benchmarks.

Grok 4.7 xAI

53.1

Rank #37 Confirmed

Phi 3 Mini 128k Instruct Microsoft

29.7

Rank #305 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Grok 4.7 scores higher in 8 categories and Phi 3 Mini 128k Instruct in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Grok 4.7 leads 70.0 to 27.1.
  • Phi 3 Mini 128k Instruct has downloadable open weights; the other is API-only.

Side by side

Grok 4.7 and Phi 3 Mini 128k Instruct specifications
Grok 4.7Phi 3 Mini 128k Instruct
ProviderxAIMicrosoft
Noometry Index53.129.7
Released2026-09-212024-04-23
WeightsProprietaryOpen
Context window500K—
Max output500K—
Input $ / M tokens$2—
Output $ / M tokens$6—
Results tracked3919

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.7 leads

Grok 4.7: 58.0 (#18), Phi 3 Mini 128k Instruct: 28.8 (#312)

Coding benchmarks
BenchmarkGrok 4.7Phi 3 Mini 128k Instruct
LMArena Coding14271039
FrontierCode47.6%—
CursorBench46.3%—
LMArena WebDev1639—
FrontierSWE29.5%—
SciCode57.8%—
BigCodeBench Instruct—29.6%
BigCodeBench Complete—40.6%

Agentic & Tool Use Not comparable

Grok 4.7: 36.7 (#37), Phi 3 Mini 128k Instruct: —

Agentic & Tool Use benchmarks
BenchmarkGrok 4.7Phi 3 Mini 128k Instruct
APEX-Agents54.6%—
GDP.pdf22.8%—
Vending-Bench 210,537—

Reasoning Grok 4.7 leads

Grok 4.7: 49.1 (#40), Phi 3 Mini 128k Instruct: 19.6 (#256)

Reasoning benchmarks
BenchmarkGrok 4.7Phi 3 Mini 128k Instruct
LMArena Hard Prompts14131028
NYT Connections (extended)76.8%—
CritPt18%—
Chess Puzzles38%—
Mystery Game Puzzles29%—
DTBench96%—
LMCA49.4%—
Epoch Capabilities Index153.53—

Math Grok 4.7 leads

Grok 4.7: 57.8 (#39), Phi 3 Mini 128k Instruct: 31.6 (#222)

Math benchmarks
BenchmarkGrok 4.7Phi 3 Mini 128k Instruct
LMArena Math14071089
FrontierMath (Tiers 1-3)53%—
FrontierMath Tier 417.1%—
OTIS Mock AIME 2024-202598.1%—
ProofBench34%—

Knowledge Grok 4.7 leads

Grok 4.7: 62.8 (#22), Phi 3 Mini 128k Instruct: 26.8 (#254)

Knowledge benchmarks
BenchmarkGrok 4.7Phi 3 Mini 128k Instruct
LMArena Expert1422984
GPQA Diamond92.7%—
SimpleQA Verified56%—

Multimodal Not comparable

Grok 4.7: 35.5 (#87), Phi 3 Mini 128k Instruct: —

Multimodal benchmarks
BenchmarkGrok 4.7Phi 3 Mini 128k Instruct
LMArena Vision1228—
Blueprint-Bench 232.5%—
Furniture Assembly20.8%—

Multilingual Grok 4.7 leads

Grok 4.7: 50.8 (#116), Phi 3 Mini 128k Instruct: 25.2 (#285)

Multilingual benchmarks
BenchmarkGrok 4.7Phi 3 Mini 128k Instruct
LMArena Non-English13891000
LMArena Chinese14551016
LMArena French14551039
LMArena Russian13971004
LMArena Spanish14001059
LMArena German—1006
LMArena Japanese—899
LMArena Korean—856

Instruction Following Grok 4.7 leads

Grok 4.7: 74.1 (#105), Phi 3 Mini 128k Instruct: 51.8 (#294)

Instruction Following benchmarks
BenchmarkGrok 4.7Phi 3 Mini 128k Instruct
LMArena Instruction Following14041023

Long Context Grok 4.7 leads

Grok 4.7: 43.1 (#104), Phi 3 Mini 128k Instruct: 30.4 (#289)

Long Context benchmarks
BenchmarkGrok 4.7Phi 3 Mini 128k Instruct
LMArena Longer Query1413996

Writing & Preference Grok 4.7 leads

Grok 4.7: 70.0 (#24), Phi 3 Mini 128k Instruct: 27.1 (#301)

Writing & Preference benchmarks
BenchmarkGrok 4.7Phi 3 Mini 128k Instruct
LMArena Text13991050
LMArena Creative Writing13911024
LMArena Multi-Turn1393989
EQ-Bench Creative Writing2007—

Frequently asked questions

Is Grok 4.7 better than Phi 3 Mini 128k Instruct?

Grok 4.7 is the stronger model overall, scoring 53.1 to 29.7 on the Noometry Index.

Is Grok 4.7 or Phi 3 Mini 128k Instruct better for coding?

Grok 4.7 scores higher on coding benchmarks: 58.0 versus 28.8 in the Noometry coding category.

How many benchmarks do Grok 4.7 and Phi 3 Mini 128k Instruct share?

14 benchmarks have published results for both models. Grok 4.7 has 39 scored results on Noometry and Phi 3 Mini 128k Instruct has 19.

Related comparisons

Go deeper