Model comparison

Amazon Nova Experimental Chat 26 01 10 vs Phi-4 Mini

Amazon Nova Experimental Chat 26 01 10 is the stronger model overall, scoring 42.8 to 30.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Phi-4 Mini Microsoft

30.9

Rank #283 Reported

Summary

  • The widest gap is in knowledge, where Amazon Nova Experimental Chat 26 01 10 leads 40.3 to 25.3.
  • Phi-4 Mini has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 26 01 10 and Phi-4 Mini specifications
Amazon Nova Experimental Chat 26 01 10Phi-4 Mini
ProviderAmazonMicrosoft
Noometry Index42.830.9
Released—2024-12-11
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.075
Output $ / M tokens—$0.30
Results tracked133

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 42.7 (#96), Phi-4 Mini: 28.1 (#317)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Phi-4 Mini
SciCode—10.8%
LMArena Coding1447—

Reasoning Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 28.9 (#98), Phi-4 Mini: 22.4 (#195)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Phi-4 Mini
CritPt—0%
LMArena Hard Prompts1415—

Math Not comparable

Amazon Nova Experimental Chat 26 01 10: 38.5 (#136), Phi-4 Mini: —

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Phi-4 Mini
LMArena Math1404—

Knowledge Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 40.3 (#120), Phi-4 Mini: 25.3 (#262)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Phi-4 Mini
Vectara Hallucination Rate—23.5%
LMArena Expert1444—

Multilingual Not comparable

Amazon Nova Experimental Chat 26 01 10: 50.2 (#126), Phi-4 Mini: —

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Phi-4 Mini
LMArena Non-English1381—
LMArena Chinese1372—
LMArena Russian1391—
LMArena Spanish1390—

Instruction Following Not comparable

Amazon Nova Experimental Chat 26 01 10: 72.9 (#126), Phi-4 Mini: —

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Phi-4 Mini
LMArena Instruction Following1381—

Long Context Not comparable

Amazon Nova Experimental Chat 26 01 10: 42.7 (#119), Phi-4 Mini: —

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Phi-4 Mini
LMArena Longer Query1400—

Writing & Preference Not comparable

Amazon Nova Experimental Chat 26 01 10: 57.4 (#129), Phi-4 Mini: —

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Phi-4 Mini
LMArena Text1396—
LMArena Creative Writing1331—
LMArena Multi-Turn1380—

Frequently asked questions

Is Amazon Nova Experimental Chat 26 01 10 better than Phi-4 Mini?

Amazon Nova Experimental Chat 26 01 10 is the stronger model overall, scoring 42.8 to 30.9 on the Noometry Index.

Is Amazon Nova Experimental Chat 26 01 10 or Phi-4 Mini better for coding?

Amazon Nova Experimental Chat 26 01 10 scores higher on coding benchmarks: 42.7 versus 28.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 26 01 10 and Phi-4 Mini share?

0 benchmarks have published results for both models. Amazon Nova Experimental Chat 26 01 10 has 13 scored results on Noometry and Phi-4 Mini has 3.

Related comparisons

Go deeper