Model comparison

GPT-5.5 Pro vs phi-3-medium 14B

GPT-5.5 Pro is the stronger model overall, scoring 64.3 to 29.7 on the Noometry Index.

Last verified . 2 shared benchmarks.

GPT-5.5 Pro OpenAI

64.3

Rank #8 Confirmed

phi-3-medium 14B Microsoft

29.7

Rank #306 Reported

Summary

  • They share 2 benchmarks with published results for both. GPT-5.5 Pro scores higher in 2 categories and phi-3-medium 14B in 0 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.5 Pro leads 84.0 to 27.3.
  • The biggest single-benchmark swing is GPQA Diamond: 93.9% for GPT-5.5 Pro and 27.6% for phi-3-medium 14B.
  • phi-3-medium 14B has downloadable open weights; the other is API-only.

Side by side

GPT-5.5 Pro and phi-3-medium 14B specifications
GPT-5.5 Prophi-3-medium 14B
ProviderOpenAIMicrosoft
Noometry Index64.329.7
Released2026-04-232024-04-23
WeightsProprietaryOpen
Context window1.05M—
Max output128K—
Input $ / M tokens$30—
Output $ / M tokens$180—
Results tracked1413

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

GPT-5.5 Pro: —, phi-3-medium 14B: 36.8 (#201)

Coding benchmarks
BenchmarkGPT-5.5 Prophi-3-medium 14B
BigCodeBench Instruct—37.6%
BigCodeBench Complete—48.7%

Reasoning Not comparable

GPT-5.5 Pro: 73.3 (#10), phi-3-medium 14B: —

Reasoning benchmarks
BenchmarkGPT-5.5 Prophi-3-medium 14B
Epoch Capabilities Index162.07121.23
ARC-AGI-284.6%—
SimpleBench76.9%—
ARC-AGI-196.5%—
CritPt30.6%—
Chess Puzzles64%—
DTBench96%—
LMCA53.9%—
Adversarial NLI—55.8%
BIG-Bench Hard—81.4%
HellaSwag—82.4%
WinoGrande—81.5%

Math GPT-5.5 Pro leads

GPT-5.5 Pro: 84.0 (#10), phi-3-medium 14B: 27.3 (#250)

Math benchmarks
BenchmarkGPT-5.5 Prophi-3-medium 14B
FrontierMath (Tiers 1-3)87.7%—
FrontierMath Tier 478%—
OTIS Mock AIME 2024-2025100%—
MATH Level 5—17.6%
FrontierMath (Feb 2025 set)52.4%—
FrontierMath Tier 4 (v1)39.6%—

Knowledge GPT-5.5 Pro leads

GPT-5.5 Pro: 64.1 (#19), phi-3-medium 14B: 9.1 (#306)

Knowledge benchmarks
BenchmarkGPT-5.5 Prophi-3-medium 14B
GPQA Diamond93.9%27.6%
ARC (AI2) Challenge—91.6%
MMLU—78%
OpenBookQA—87.4%
TriviaQA—73.9%

Frequently asked questions

Is GPT-5.5 Pro better than phi-3-medium 14B?

GPT-5.5 Pro is the stronger model overall, scoring 64.3 to 29.7 on the Noometry Index.

How many benchmarks do GPT-5.5 Pro and phi-3-medium 14B share?

2 benchmarks have published results for both models. GPT-5.5 Pro has 14 scored results on Noometry and phi-3-medium 14B has 13.

Related comparisons

Go deeper