Model comparison

GPT-4.5 vs Phi-4 Mini

GPT-4.5 is the stronger model overall, scoring 37.2 to 30.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

GPT-4.5 OpenAI

37.2

Rank #208 Confirmed

Phi-4 Mini Microsoft

30.9

Rank #283 Reported

Summary

  • The widest gap is in coding, where GPT-4.5 leads 42.2 to 28.1.
  • Phi-4 Mini has downloadable open weights; the other is API-only.

Side by side

GPT-4.5 and Phi-4 Mini specifications
GPT-4.5Phi-4 Mini
ProviderOpenAIMicrosoft
Noometry Index37.230.9
Released2025-02-272024-12-11
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.075
Output $ / M tokens—$0.30
Results tracked423

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-4.5 leads

GPT-4.5: 42.2 (#109), Phi-4 Mini: 28.1 (#317)

Coding benchmarks
BenchmarkGPT-4.5Phi-4 Mini
Aider Polyglot44.9%—
SciCode—10.8%
WeirdML39.4%—
LiveBench Coding75.2%—
LMArena Coding1396—

Agentic & Tool Use Not comparable

GPT-4.5: 27.9 (#97), Phi-4 Mini: —

Agentic & Tool Use benchmarks
BenchmarkGPT-4.5Phi-4 Mini
Cybench17.5%—

Reasoning Phi-4 Mini leads

GPT-4.5: 13.9 (#330), Phi-4 Mini: 22.4 (#195)

Reasoning benchmarks
BenchmarkGPT-4.5Phi-4 Mini
ARC-AGI-20.8%—
SimpleBench34.5%—
ARC-AGI-110.3%—
CritPt—0%
EnigmaEval3.2%—
LiveBench Reasoning71.1%—
LMArena Hard Prompts1403—
LiveBench Data Analysis64.3%—
Epoch Capabilities Index136.74—
ForecastBench61.7—
LiveBench69%—

Math Not comparable

GPT-4.5: 32.6 (#211), Phi-4 Mini: —

Math benchmarks
BenchmarkGPT-4.5Phi-4 Mini
OTIS Mock AIME 2024-202537.8%—
LiveBench Math69.3%—
LMArena Math1412—
MATH Level 578.6%—

Knowledge GPT-4.5 leads

GPT-4.5: 32.5 (#211), Phi-4 Mini: 25.3 (#262)

Knowledge benchmarks
BenchmarkGPT-4.5Phi-4 Mini
GPQA Diamond68.7%—
Humanity's Last Exam5.4%—
Confabulations13.6%—
Vectara Hallucination Rate—23.5%
LMArena Expert1394—

Multimodal Not comparable

GPT-4.5: 37.6 (#71), Phi-4 Mini: —

Multimodal benchmarks
BenchmarkGPT-4.5Phi-4 Mini
LMArena Vision1195—
VPCT45%—

Multilingual Not comparable

GPT-4.5: 52.5 (#83), Phi-4 Mini: —

Multilingual benchmarks
BenchmarkGPT-4.5Phi-4 Mini
LMArena Non-English1413—
LMArena Chinese1421—
LMArena French1418—
LMArena German1457—
LMArena Japanese1416—
LMArena Korean1392—
LMArena Russian1419—

Instruction Following Not comparable

GPT-4.5: 72.6 (#134), Phi-4 Mini: —

Instruction Following benchmarks
BenchmarkGPT-4.5Phi-4 Mini
LiveBench Instruction Following72.3%—
LMArena Instruction Following1404—

Long Context Not comparable

GPT-4.5: 40.4 (#155), Phi-4 Mini: —

Long Context benchmarks
BenchmarkGPT-4.5Phi-4 Mini
Fiction.LiveBench63.9%—
LMArena Longer Query1406—

Writing & Preference Not comparable

GPT-4.5: 56.9 (#134), Phi-4 Mini: —

Writing & Preference benchmarks
BenchmarkGPT-4.5Phi-4 Mini
LMArena Text1417—
LMArena Creative Writing1394—
Short-Story Creative Writing75.6%—
EQ-Bench Creative Writing1258—
LMArena Multi-Turn1444—
LiveBench Language61.5%—

Frequently asked questions

Is GPT-4.5 better than Phi-4 Mini?

GPT-4.5 is the stronger model overall, scoring 37.2 to 30.9 on the Noometry Index.

Is GPT-4.5 or Phi-4 Mini better for coding?

GPT-4.5 scores higher on coding benchmarks: 42.2 versus 28.1 in the Noometry coding category.

How many benchmarks do GPT-4.5 and Phi-4 Mini share?

0 benchmarks have published results for both models. GPT-4.5 has 42 scored results on Noometry and Phi-4 Mini has 3.

Related comparisons

Go deeper