# o3-pro vs phi-3-medium 14B

> o3-pro is the stronger model overall, scoring 42.7 to 29.1 on the Noometry Index.

- Canonical page: https://noometry.com/compare/o3-pro-vs-phi-3-medium-14b
- Last updated: 2026-10-10
- Shared benchmarks: 1

## Summary

- They share 1 benchmark with published results for both. o3-pro scores higher in 2 categories and phi-3-medium 14B in 0 categories; 2 gaps are clear of the uncertainty.
- The widest gap is in knowledge, where o3-pro leads 29.0 to 9.1.
- phi-3-medium 14B has downloadable open weights; the other is API-only.

## Snapshot

| | o3-pro | phi-3-medium 14B |
|---|---|---|
| Provider | OpenAI | Microsoft |
| Noometry Index | 42.7 | 29.1 |
| Rank | 94 | 306 |
| Context | 200K | — |
| Input $/M | $20 | — |
| Output $/M | $80 | — |
| Weights | Proprietary | Open |

## Coding

- o3-pro: 55.1 (#22)
- phi-3-medium 14B: 36.3 (#198)

| Benchmark | o3-pro | phi-3-medium 14B |
|---|---|---|
| Aider Polyglot | 84.9% | — |
| WeirdML | 58.2% | — |
| BigCodeBench Instruct | — | 37.6% |
| BigCodeBench Complete | — | 48.7% |

## Reasoning

- o3-pro: 24.1 (#152)
- phi-3-medium 14B: —

| Benchmark | o3-pro | phi-3-medium 14B |
|---|---|---|
| Epoch Capabilities Index | 147.43 | 121.18 |
| ARC-AGI-2 | 4.9% | — |
| Kagi LLM Benchmark | 72.1% | — |
| ARC-AGI-1 | 59.3% | — |
| DTBench | 86.9% | — |
| LMCA | 38.5% | — |
| Adversarial NLI | — | 55.8% |
| BIG-Bench Hard | — | 81.4% |
| HellaSwag | — | 82.4% |
| WinoGrande | — | 81.5% |

## Math

- o3-pro: —
- phi-3-medium 14B: 25.2 (#249)

| Benchmark | o3-pro | phi-3-medium 14B |
|---|---|---|
| MATH Level 5 | — | 17.6% |

## Knowledge

- o3-pro: 29.0 (#234)
- phi-3-medium 14B: 9.1 (#301)

| Benchmark | o3-pro | phi-3-medium 14B |
|---|---|---|
| GPQA Diamond | — | 27.6% |
| Confabulations | 14.2% | — |
| Vectara Hallucination Rate | 23.3% | — |
| ARC (AI2) Challenge | — | 91.6% |
| MMLU | — | 78% |
| OpenBookQA | — | 87.4% |
| TriviaQA | — | 73.9% |

## Long Context

- o3-pro: 72.1 (#1)
- phi-3-medium 14B: —

| Benchmark | o3-pro | phi-3-medium 14B |
|---|---|---|
| Fiction.LiveBench | 97.2% | — |

## Writing & Preference

- o3-pro: 57.1 (#128)
- phi-3-medium 14B: —

| Benchmark | o3-pro | phi-3-medium 14B |
|---|---|---|
| Short-Story Creative Writing | 84.4% | — |

## FAQ

### Is o3-pro better than phi-3-medium 14B?

o3-pro is the stronger model overall, scoring 42.7 to 29.1 on the Noometry Index.

### Is o3-pro or phi-3-medium 14B better for coding?

o3-pro scores higher on coding benchmarks: 55.1 versus 36.3 in the Noometry coding category.

### How many benchmarks do o3-pro and phi-3-medium 14B share?

1 benchmark has published results for both models. o3-pro has 12 scored results on Noometry and phi-3-medium 14B has 13.