Model comparison

Nova 2.0 Pro Preview vs Phi-2

Nova 2.0 Pro Preview has enough public results to be ranked (#244); Phi-2 does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Nova 2.0 Pro Preview Amazon

33.4

Rank #244 Reported

Phi-2 Microsoft

—

Unranked

Summary

  • Phi-2 has downloadable open weights; the other is API-only.

Side by side

Nova 2.0 Pro Preview and Phi-2 specifications
Nova 2.0 Pro PreviewPhi-2
ProviderAmazonMicrosoft
Noometry Index33.4—
Released2025-12-022023-12-12
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked311

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Nova 2.0 Pro Preview: 40.8 (#133), Phi-2: —

Coding benchmarks
BenchmarkNova 2.0 Pro PreviewPhi-2
SciCode42.7%—
HumanEval+—45.1%
MBPP+—54.2%

Agentic & Tool Use Not comparable

Nova 2.0 Pro Preview: 21.9 (#136), Phi-2: —

Agentic & Tool Use benchmarks
BenchmarkNova 2.0 Pro PreviewPhi-2
GDP.pdf2%—

Reasoning Not comparable

Nova 2.0 Pro Preview: 22.4 (#194), Phi-2: —

Reasoning benchmarks
BenchmarkNova 2.0 Pro PreviewPhi-2
CritPt0%—
Adversarial NLI—42.5%
BIG-Bench Hard—59.4%
Epoch Capabilities Index—107.94
HellaSwag—53.6%
WinoGrande—54.7%

Knowledge Not comparable

Nova 2.0 Pro Preview: —, Phi-2: —

Knowledge benchmarks
BenchmarkNova 2.0 Pro PreviewPhi-2
ARC (AI2) Challenge—75.9%
MMLU—58.4%
OpenBookQA—73.6%
TriviaQA—45.2%

Frequently asked questions

Is Nova 2.0 Pro Preview better than Phi-2?

Nova 2.0 Pro Preview has enough public results to be ranked (#244); Phi-2 does not yet, so treat this comparison as directional.

How many benchmarks do Nova 2.0 Pro Preview and Phi-2 share?

0 benchmarks have published results for both models. Nova 2.0 Pro Preview has 3 scored results on Noometry and Phi-2 has 11.

Related comparisons

Go deeper