Model comparison

GPT-5.5 vs phi-3-medium 14B

GPT-5.5 is the stronger model overall, scoring 63.4 to 29.7 on the Noometry Index.

Last verified . 2 shared benchmarks.

GPT-5.5 OpenAI

63.4

Rank #9 Confirmed

phi-3-medium 14B Microsoft

29.7

Rank #306 Reported

Summary

  • They share 2 benchmarks with published results for both. GPT-5.5 scores higher in 3 categories and phi-3-medium 14B in 0 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GPT-5.5 leads 64.4 to 9.1.
  • The biggest single-benchmark swing is GPQA Diamond: 94% for GPT-5.5 and 27.6% for phi-3-medium 14B.
  • phi-3-medium 14B has downloadable open weights; the other is API-only.

Side by side

GPT-5.5 and phi-3-medium 14B specifications
GPT-5.5phi-3-medium 14B
ProviderOpenAIMicrosoft
Noometry Index63.429.7
Released2026-04-232024-04-23
WeightsProprietaryOpen
Context window1.05M—
Max output128K—
Input $ / M tokens$5—
Output $ / M tokens$30—
Results tracked7113

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.5 leads

GPT-5.5: 58.2 (#17), phi-3-medium 14B: 36.8 (#201)

Coding benchmarks
BenchmarkGPT-5.5phi-3-medium 14B
SWE-bench Verified80.6%—
DeepSWE67%—
FrontierCode43%—
LMArena WebDev1513—
SciCode56.1%—
GSO40.2%—
WeirdML84.9%—
BigCodeBench Instruct—37.6%
LMArena Coding1494—
MirrorCode10%—
BigCodeBench Complete—48.7%
ALE-Bench1,943—

Agentic & Tool Use Not comparable

GPT-5.5: 50.7 (#6), phi-3-medium 14B: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.5phi-3-medium 14B
Terminal-Bench84.7%—
APEX-Agents55.1%—
OSWorld 2.013%—
Remote Labor Index6.3%—
τ²-bench Banking44.6%—
DeepResearch Bench54%—
PostTrainBench27.2%—
ExploitBench47.4%—
GBAEval53.2%—
GDP.pdf26%—
LMArena Search1242—
Vending-Bench 27,524—

Reasoning Not comparable

GPT-5.5: 72.8 (#11), phi-3-medium 14B: —

Reasoning benchmarks
BenchmarkGPT-5.5phi-3-medium 14B
Epoch Capabilities Index159.1121.23
ARC-AGI-285%—
SimpleBench69%—
Kagi LLM Benchmark88.8%—
NYT Connections (extended)96.2%—
ARC-AGI-195%—
CritPt27.1%—
Chess Puzzles54%—
EBR-Bench34.3%—
LMArena Hard Prompts1489—
Mystery Game Puzzles56%—
DTBench96%—
LMCA54.3%—
Surface Evolver Bench88.1%—
Adversarial NLI—55.8%
Bench to the Future 30.14—
BIG-Bench Hard—81.4%
ForecastBench60.6—
HellaSwag—82.4%
WinoGrande—81.5%

Math GPT-5.5 leads

GPT-5.5: 81.7 (#11), phi-3-medium 14B: 27.3 (#250)

Knowledge GPT-5.5 leads

GPT-5.5: 64.4 (#17), phi-3-medium 14B: 9.1 (#306)

Knowledge benchmarks
BenchmarkGPT-5.5phi-3-medium 14B
GPQA Diamond94%27.6%
SimpleQA Verified63%—
Vectara Hallucination Rate9.3%—
LMArena Expert1508—
ARC (AI2) Challenge—91.6%
MMLU—78%
OpenBookQA—87.4%
TriviaQA—73.9%

Multimodal Not comparable

GPT-5.5: 46.9 (#12), phi-3-medium 14B: —

Multimodal benchmarks
BenchmarkGPT-5.5phi-3-medium 14B
LMArena Vision1297—
Blueprint-Bench 236.2%—
Furniture Assembly44.2%—
LMArena Document1486—

Multilingual Not comparable

GPT-5.5: 56.4 (#20), phi-3-medium 14B: —

Multilingual benchmarks
BenchmarkGPT-5.5phi-3-medium 14B
LMArena Non-English1467—
LMArena Chinese1533—
LMArena French1486—
LMArena German1480—
LMArena Japanese1498—
LMArena Korean1460—
LMArena Russian1473—
LMArena Spanish1468—

Instruction Following Not comparable

GPT-5.5: 77.5 (#18), phi-3-medium 14B: —

Instruction Following benchmarks
BenchmarkGPT-5.5phi-3-medium 14B
LMArena Instruction Following1479—

Long Context Not comparable

GPT-5.5: 48.3 (#12), phi-3-medium 14B: —

Long Context benchmarks
BenchmarkGPT-5.5phi-3-medium 14B
CL-bench Life22.2%—
LMArena Longer Query1484—

Writing & Preference Not comparable

GPT-5.5: 72.7 (#13), phi-3-medium 14B: —

Writing & Preference benchmarks
BenchmarkGPT-5.5phi-3-medium 14B
LMArena Text1472—
LMArena Creative Writing1455—
EQ-Bench Creative Writing1844—
EQ-Bench 41315—
LMArena Multi-Turn1476—

Frequently asked questions

Is GPT-5.5 better than phi-3-medium 14B?

GPT-5.5 is the stronger model overall, scoring 63.4 to 29.7 on the Noometry Index.

Is GPT-5.5 or phi-3-medium 14B better for coding?

GPT-5.5 scores higher on coding benchmarks: 58.2 versus 36.8 in the Noometry coding category.

How many benchmarks do GPT-5.5 and phi-3-medium 14B share?

2 benchmarks have published results for both models. GPT-5.5 has 71 scored results on Noometry and phi-3-medium 14B has 13.

Related comparisons

Go deeper