Model comparison

GPT-5.1-Codex vs Phi-4 Mini

GPT-5.1-Codex is the stronger model overall, scoring 38.6 to 30.9 on the Noometry Index. Phi-4 Mini costs 26× less per token, which makes it the better buy when GPT-5.1-Codex's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

GPT-5.1-Codex OpenAI

38.6

Rank #186 Reported

Phi-4 Mini Microsoft

30.9

Rank #283 Reported

Summary

  • The widest gap is in coding, where GPT-5.1-Codex leads 41.9 to 28.1.
  • Phi-4 Mini is cheaper at $0.075 / $0.30 per million input/output tokens, against $1.25 / $10 for GPT-5.1-Codex.
  • GPT-5.1-Codex accepts more context: 400K tokens versus 128K.
  • Phi-4 Mini has downloadable open weights; the other is API-only.

Side by side

GPT-5.1-Codex and Phi-4 Mini specifications
GPT-5.1-CodexPhi-4 Mini
ProviderOpenAIMicrosoft
Noometry Index38.630.9
Released2025-11-122024-12-11
WeightsProprietaryOpen
Context window400K128K
Max output128K4K
Input $ / M tokens$1.25$0.075
Output $ / M tokens$10$0.30
Results tracked63

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.1-Codex leads

GPT-5.1-Codex: 41.9 (#116), Phi-4 Mini: 28.1 (#317)

Coding benchmarks
BenchmarkGPT-5.1-CodexPhi-4 Mini
SWE-bench Verified (bash only)66%—
LMArena WebDev1337—
SciCode—10.8%
ALE-Bench1,245—

Agentic & Tool Use Not comparable

GPT-5.1-Codex: 38.0 (#33), Phi-4 Mini: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.1-CodexPhi-4 Mini
Terminal-Bench60.4%—
METR Time Horizons70.8%—

Reasoning Not comparable

GPT-5.1-Codex: —, Phi-4 Mini: 22.4 (#195)

Reasoning benchmarks
BenchmarkGPT-5.1-CodexPhi-4 Mini
CritPt—0%

Math Not comparable

GPT-5.1-Codex: 30.3 (#235), Phi-4 Mini: —

Math benchmarks
BenchmarkGPT-5.1-CodexPhi-4 Mini
ProofBench9%—

Knowledge Not comparable

GPT-5.1-Codex: —, Phi-4 Mini: 25.3 (#262)

Knowledge benchmarks
BenchmarkGPT-5.1-CodexPhi-4 Mini
Vectara Hallucination Rate—23.5%

Frequently asked questions

Is GPT-5.1-Codex better than Phi-4 Mini?

GPT-5.1-Codex is the stronger model overall, scoring 38.6 to 30.9 on the Noometry Index. Phi-4 Mini costs 26× less per token, which makes it the better buy when GPT-5.1-Codex's lead doesn't matter for your workload.

Which is cheaper, GPT-5.1-Codex or Phi-4 Mini?

Phi-4 Mini is cheaper. It lists at $0.075 per million input tokens and $0.30 per million output tokens; GPT-5.1-Codex lists at $1.25 and $10.

Is GPT-5.1-Codex or Phi-4 Mini better for coding?

GPT-5.1-Codex scores higher on coding benchmarks: 41.9 versus 28.1 in the Noometry coding category.

Which has the bigger context window?

GPT-5.1-Codex does, with 400K tokens against 128K.

How many benchmarks do GPT-5.1-Codex and Phi-4 Mini share?

0 benchmarks have published results for both models. GPT-5.1-Codex has 6 scored results on Noometry and Phi-4 Mini has 3.

Related comparisons

Go deeper