Model comparison

GPT-5.6 Terra vs phi-3-medium 14B

GPT-5.6 Terra is the stronger model overall, scoring 59.2 to 29.7 on the Noometry Index.

Last verified . 2 shared benchmarks.

GPT-5.6 Terra OpenAI

59.2

Rank #17 Confirmed

phi-3-medium 14B Microsoft

29.7

Rank #306 Reported

Summary

  • They share 2 benchmarks with published results for both. GPT-5.6 Terra scores higher in 3 categories and phi-3-medium 14B in 0 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.6 Terra leads 81.6 to 27.3.
  • The biggest single-benchmark swing is GPQA Diamond: 93.3% for GPT-5.6 Terra and 27.6% for phi-3-medium 14B.
  • phi-3-medium 14B has downloadable open weights; the other is API-only.

Side by side

GPT-5.6 Terra and phi-3-medium 14B specifications
GPT-5.6 Terraphi-3-medium 14B
ProviderOpenAIMicrosoft
Noometry Index59.229.7
Released2026-07-092024-04-23
WeightsProprietaryOpen
Context window1.05M—
Max output128K—
Input $ / M tokens$2—
Output $ / M tokens$12—
Results tracked5213

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.6 Terra leads

GPT-5.6 Terra: 57.7 (#19), phi-3-medium 14B: 36.8 (#201)

Coding benchmarks
BenchmarkGPT-5.6 Terraphi-3-medium 14B
DeepSWE69.6%—
FrontierCode41.3%—
CursorBench41.3%—
LMArena WebDev1522—
SciCode55%—
WeirdML78.3%—
BigCodeBench Instruct—37.6%
LMArena Coding1484—
BigCodeBench Complete—48.7%
ALE-Bench1,951—

Agentic & Tool Use Not comparable

GPT-5.6 Terra: 40.1 (#25), phi-3-medium 14B: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.6 Terraphi-3-medium 14B
APEX-Agents58.2%—
BALROG53.2%—
GDP.pdf24.7%—
Vending-Bench 27,343—

Reasoning Not comparable

GPT-5.6 Terra: 60.7 (#21), phi-3-medium 14B: —

Reasoning benchmarks
BenchmarkGPT-5.6 Terraphi-3-medium 14B
Epoch Capabilities Index159.62121.23
ARC-AGI-283.9%—
SimpleBench48.9%—
Kagi LLM Benchmark51.3%—
NYT Connections (extended)78.4%—
ARC-AGI-196.5%—
CritPt30%—
Chess Puzzles54%—
LMArena Hard Prompts1468—
Mystery Game Puzzles35%—
DTBench93.3%—
LMCA55%—
Surface Evolver Bench83.8%—
Adversarial NLI—55.8%
BIG-Bench Hard—81.4%
HellaSwag—82.4%
WinoGrande—81.5%

Math GPT-5.6 Terra leads

GPT-5.6 Terra: 81.6 (#12), phi-3-medium 14B: 27.3 (#250)

Math benchmarks
BenchmarkGPT-5.6 Terraphi-3-medium 14B
FrontierMath (Tiers 1-3)86%—
FrontierMath Tier 470.7%—
OTIS Mock AIME 2024-202599.7%—
ProofBench74%—
LMArena Math1466—
MATH Level 5—17.6%

Knowledge GPT-5.6 Terra leads

GPT-5.6 Terra: 61.2 (#30), phi-3-medium 14B: 9.1 (#306)

Knowledge benchmarks
BenchmarkGPT-5.6 Terraphi-3-medium 14B
GPQA Diamond93.3%27.6%
SimpleQA Verified43.2%—
LMArena Expert1492—
ARC (AI2) Challenge—91.6%
MMLU—78%
OpenBookQA—87.4%
TriviaQA—73.9%

Multimodal Not comparable

GPT-5.6 Terra: 47.3 (#11), phi-3-medium 14B: —

Multimodal benchmarks
BenchmarkGPT-5.6 Terraphi-3-medium 14B
LMArena Vision1271—
Blueprint-Bench 230.8%—
Furniture Assembly54.2%—
LMArena Document1472—

Multilingual Not comparable

GPT-5.6 Terra: 54.4 (#44), phi-3-medium 14B: —

Multilingual benchmarks
BenchmarkGPT-5.6 Terraphi-3-medium 14B
LMArena Non-English1439—
LMArena Chinese1513—
LMArena French1471—
LMArena German1460—
LMArena Japanese1457—
LMArena Korean1425—
LMArena Russian1450—
LMArena Spanish1448—

Instruction Following Not comparable

GPT-5.6 Terra: 76.4 (#40), phi-3-medium 14B: —

Instruction Following benchmarks
BenchmarkGPT-5.6 Terraphi-3-medium 14B
LMArena Instruction Following1454—

Long Context Not comparable

GPT-5.6 Terra: 44.4 (#68), phi-3-medium 14B: —

Long Context benchmarks
BenchmarkGPT-5.6 Terraphi-3-medium 14B
LMArena Longer Query1451—

Writing & Preference Not comparable

GPT-5.6 Terra: 70.2 (#23), phi-3-medium 14B: —

Writing & Preference benchmarks
BenchmarkGPT-5.6 Terraphi-3-medium 14B
LMArena Text1447—
LMArena Creative Writing1410—
EQ-Bench Creative Writing1855—
EQ-Bench 41234—
LMArena Multi-Turn1449—

Frequently asked questions

Is GPT-5.6 Terra better than phi-3-medium 14B?

GPT-5.6 Terra is the stronger model overall, scoring 59.2 to 29.7 on the Noometry Index.

Is GPT-5.6 Terra or phi-3-medium 14B better for coding?

GPT-5.6 Terra scores higher on coding benchmarks: 57.7 versus 36.8 in the Noometry coding category.

How many benchmarks do GPT-5.6 Terra and phi-3-medium 14B share?

2 benchmarks have published results for both models. GPT-5.6 Terra has 52 scored results on Noometry and phi-3-medium 14B has 13.

Related comparisons

Go deeper