Model comparison

Nova 2.0 Pro Preview vs Phi 3 Mini 4k Instruct June 2024

Nova 2.0 Pro Preview is the stronger model overall, scoring 33.4 to 31.3 on the Noometry Index.

Last verified . 0 shared benchmarks.

Nova 2.0 Pro Preview Amazon

33.4

Rank #244 Reported

Summary

  • The widest gap is in coding, where Nova 2.0 Pro Preview leads 40.8 to 31.8.
  • Phi 3 Mini 4k Instruct June 2024 has downloadable open weights; the other is API-only.

Side by side

Nova 2.0 Pro Preview and Phi 3 Mini 4k Instruct June 2024 specifications
Nova 2.0 Pro PreviewPhi 3 Mini 4k Instruct June 2024
ProviderAmazonMicrosoft
Noometry Index33.431.3
Released2025-12-02—
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked315

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nova 2.0 Pro Preview leads

Nova 2.0 Pro Preview: 40.8 (#133), Phi 3 Mini 4k Instruct June 2024: 31.8 (#279)

Coding benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Mini 4k Instruct June 2024
SciCode42.7%—
LMArena Coding—1093

Agentic & Tool Use Not comparable

Nova 2.0 Pro Preview: 21.9 (#136), Phi 3 Mini 4k Instruct June 2024: —

Agentic & Tool Use benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Mini 4k Instruct June 2024
GDP.pdf2%—

Reasoning Nova 2.0 Pro Preview leads

Nova 2.0 Pro Preview: 22.4 (#194), Phi 3 Mini 4k Instruct June 2024: 20.8 (#231)

Reasoning benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Mini 4k Instruct June 2024
CritPt0%—
LMArena Hard Prompts—1087

Math Not comparable

Nova 2.0 Pro Preview: —, Phi 3 Mini 4k Instruct June 2024: 33.0 (#208)

Math benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Mini 4k Instruct June 2024
LMArena Math—1152

Knowledge Not comparable

Nova 2.0 Pro Preview: —, Phi 3 Mini 4k Instruct June 2024: 28.6 (#244)

Knowledge benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Mini 4k Instruct June 2024
LMArena Expert—1051

Multilingual Not comparable

Nova 2.0 Pro Preview: —, Phi 3 Mini 4k Instruct June 2024: 25.9 (#282)

Multilingual benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Mini 4k Instruct June 2024
LMArena Non-English—1013
LMArena Chinese—1033
LMArena German—1031
LMArena Japanese—954
LMArena Korean—880
LMArena Russian—1019

Instruction Following Not comparable

Nova 2.0 Pro Preview: —, Phi 3 Mini 4k Instruct June 2024: 54.1 (#282)

Instruction Following benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Mini 4k Instruct June 2024
LMArena Instruction Following—1058

Long Context Not comparable

Nova 2.0 Pro Preview: —, Phi 3 Mini 4k Instruct June 2024: 31.7 (#277)

Long Context benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Mini 4k Instruct June 2024
LMArena Longer Query—1042

Writing & Preference Not comparable

Nova 2.0 Pro Preview: —, Phi 3 Mini 4k Instruct June 2024: 29.6 (#294)

Writing & Preference benchmarks
BenchmarkNova 2.0 Pro PreviewPhi 3 Mini 4k Instruct June 2024
LMArena Text—1080
LMArena Creative Writing—1045
LMArena Multi-Turn—1049

Frequently asked questions

Is Nova 2.0 Pro Preview better than Phi 3 Mini 4k Instruct June 2024?

Nova 2.0 Pro Preview is the stronger model overall, scoring 33.4 to 31.3 on the Noometry Index.

Is Nova 2.0 Pro Preview or Phi 3 Mini 4k Instruct June 2024 better for coding?

Nova 2.0 Pro Preview scores higher on coding benchmarks: 40.8 versus 31.8 in the Noometry coding category.

How many benchmarks do Nova 2.0 Pro Preview and Phi 3 Mini 4k Instruct June 2024 share?

0 benchmarks have published results for both models. Nova 2.0 Pro Preview has 3 scored results on Noometry and Phi 3 Mini 4k Instruct June 2024 has 15.

Related comparisons

Go deeper