Model comparison

GPT-5.2 vs Phi 3 Mini 128k Instruct

GPT-5.2 is the stronger model overall, scoring 54.1 to 29.7 on the Noometry Index.

Last verified . 17 shared benchmarks.

GPT-5.2 OpenAI

54.1

Rank #34 Confirmed

Phi 3 Mini 128k Instruct Microsoft

29.7

Rank #305 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GPT-5.2 scores higher in 8 categories and Phi 3 Mini 128k Instruct in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GPT-5.2 leads 66.8 to 27.1.
  • Phi 3 Mini 128k Instruct has downloadable open weights; the other is API-only.

Side by side

GPT-5.2 and Phi 3 Mini 128k Instruct specifications
GPT-5.2Phi 3 Mini 128k Instruct
ProviderOpenAIMicrosoft
Noometry Index54.129.7
Released2025-12-112024-04-23
WeightsProprietaryOpen
Context window400K—
Max output128K—
Input $ / M tokens$1.75—
Output $ / M tokens$14—
Results tracked6719

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.2 leads

GPT-5.2: 51.6 (#37), Phi 3 Mini 128k Instruct: 28.8 (#312)

Coding benchmarks
BenchmarkGPT-5.2Phi 3 Mini 128k Instruct
LMArena Coding14471039
SWE-bench Verified73.8%—
SWE-bench Verified (bash only)72.8%—
LMArena WebDev1416—
SWE-bench Multilingual66.7%—
GSO27.4%—
WeirdML72.2%—
BigCodeBench Instruct—29.6%
BigCodeBench Complete—40.6%
ALE-Bench1,294—
AlgoTune2.05—

Agentic & Tool Use Not comparable

GPT-5.2: 40.2 (#24), Phi 3 Mini 128k Instruct: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.2Phi 3 Mini 128k Instruct
Terminal-Bench64.9%—
Berkeley Function Calling Leaderboard55.9%—
GDPval49.7%—
Remote Labor Index2.5%—
τ²-bench Airline83%—
τ²-bench Banking32.2%—
τ²-bench Retail81.6%—
τ²-bench Telecom89.7%—
DeepResearch Bench41.1%—
LMArena Search1207—
METR Time Horizons75.3%—
Vending-Bench 23,591—

Reasoning GPT-5.2 leads

GPT-5.2: 50.2 (#35), Phi 3 Mini 128k Instruct: 19.6 (#256)

Reasoning benchmarks
BenchmarkGPT-5.2Phi 3 Mini 128k Instruct
LMArena Hard Prompts14451028
ARC-AGI-252.9%—
SimpleBench45.8%—
Kagi LLM Benchmark73.3%—
NYT Connections (extended)83.6%—
ARC-AGI-186.2%—
Chess Puzzles49%—
EnigmaEval10.4%—
EBR-Bench23%—
Mystery Game Puzzles23%—
DTBench90.9%—
LMCA43.9%—
Epoch Capabilities Index153.45—
ForecastBench60.1—

Math GPT-5.2 leads

GPT-5.2: 60.0 (#38), Phi 3 Mini 128k Instruct: 31.6 (#222)

Knowledge GPT-5.2 leads

GPT-5.2: 59.3 (#32), Phi 3 Mini 128k Instruct: 26.8 (#254)

Knowledge benchmarks
BenchmarkGPT-5.2Phi 3 Mini 128k Instruct
LMArena Expert1445984
GPQA Diamond91.4%—
Humanity's Last Exam27.8%—
SimpleQA Verified37.1%—
Vectara Hallucination Rate8.4%—

Multimodal Not comparable

GPT-5.2: 51.3 (#7), Phi 3 Mini 128k Instruct: —

Multimodal benchmarks
BenchmarkGPT-5.2Phi 3 Mini 128k Instruct
LMArena Vision1268—
VPCT84%—
Furniture Assembly38.3%—
LMArena Document1405—

Multilingual GPT-5.2 leads

GPT-5.2: 53.4 (#67), Phi 3 Mini 128k Instruct: 25.2 (#285)

Multilingual benchmarks
BenchmarkGPT-5.2Phi 3 Mini 128k Instruct
LMArena Non-English14251000
LMArena Chinese14601016
LMArena French14551039
LMArena German14481006
LMArena Japanese1420899
LMArena Korean1392856
LMArena Russian14401004
LMArena Spanish14331059

Instruction Following GPT-5.2 leads

GPT-5.2: 74.7 (#89), Phi 3 Mini 128k Instruct: 51.8 (#294)

Instruction Following benchmarks
BenchmarkGPT-5.2Phi 3 Mini 128k Instruct
LMArena Instruction Following14171023

Long Context GPT-5.2 leads

GPT-5.2: 44.0 (#78), Phi 3 Mini 128k Instruct: 30.4 (#289)

Long Context benchmarks
BenchmarkGPT-5.2Phi 3 Mini 128k Instruct
LMArena Longer Query1428996
CL-bench18.2%—

Writing & Preference GPT-5.2 leads

GPT-5.2: 66.8 (#32), Phi 3 Mini 128k Instruct: 27.1 (#301)

Writing & Preference benchmarks
BenchmarkGPT-5.2Phi 3 Mini 128k Instruct
LMArena Text14391050
LMArena Creative Writing14011024
LMArena Multi-Turn1458989
EQ-Bench Creative Writing1703—

Frequently asked questions

Is GPT-5.2 better than Phi 3 Mini 128k Instruct?

GPT-5.2 is the stronger model overall, scoring 54.1 to 29.7 on the Noometry Index.

Is GPT-5.2 or Phi 3 Mini 128k Instruct better for coding?

GPT-5.2 scores higher on coding benchmarks: 51.6 versus 28.8 in the Noometry coding category.

How many benchmarks do GPT-5.2 and Phi 3 Mini 128k Instruct share?

17 benchmarks have published results for both models. GPT-5.2 has 67 scored results on Noometry and Phi 3 Mini 128k Instruct has 19.

Related comparisons

Go deeper