Model comparison

Amazon Nova Experimental Chat 10 09 vs Phi 3 Medium 4k Instruct

Amazon Nova Experimental Chat 10 09 is the stronger model overall, scoring 41.9 to 33.0 on the Noometry Index.

Last verified . 9 shared benchmarks.

Summary

  • They share 9 benchmarks with published results for both. Amazon Nova Experimental Chat 10 09 scores higher in 6 categories and Phi 3 Medium 4k Instruct in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Experimental Chat 10 09 leads 54.7 to 34.1.
  • Phi 3 Medium 4k Instruct has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 10 09 and Phi 3 Medium 4k Instruct specifications
Amazon Nova Experimental Chat 10 09Phi 3 Medium 4k Instruct
ProviderAmazonMicrosoft
Noometry Index41.933.0
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked917

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 40.2 (#145), Phi 3 Medium 4k Instruct: 32.9 (#268)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Phi 3 Medium 4k Instruct
LMArena Coding13701130

Reasoning Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 27.3 (#120), Phi 3 Medium 4k Instruct: 21.7 (#214)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Phi 3 Medium 4k Instruct
LMArena Hard Prompts13561127

Math Not comparable

Amazon Nova Experimental Chat 10 09: —, Phi 3 Medium 4k Instruct: 33.4 (#202)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Phi 3 Medium 4k Instruct
LMArena Math—1173

Knowledge Not comparable

Amazon Nova Experimental Chat 10 09: —, Phi 3 Medium 4k Instruct: 30.2 (#229)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Phi 3 Medium 4k Instruct
LMArena Expert—1108

Multilingual Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 47.3 (#150), Phi 3 Medium 4k Instruct: 30.6 (#263)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Phi 3 Medium 4k Instruct
LMArena Non-English13401094
LMArena Chinese13411108
LMArena French—1110
LMArena German—1101
LMArena Japanese—1042
LMArena Korean—954
LMArena Russian—1145
LMArena Spanish—1095

Instruction Following Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 69.4 (#172), Phi 3 Medium 4k Instruct: 57.6 (#268)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Phi 3 Medium 4k Instruct
LMArena Instruction Following13151113

Long Context Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 40.5 (#152), Phi 3 Medium 4k Instruct: 34.0 (#255)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Phi 3 Medium 4k Instruct
LMArena Longer Query13331120

Writing & Preference Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 54.7 (#149), Phi 3 Medium 4k Instruct: 34.1 (#272)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Phi 3 Medium 4k Instruct
LMArena Text13641138
LMArena Creative Writing13071107
LMArena Multi-Turn13551088

Frequently asked questions

Is Amazon Nova Experimental Chat 10 09 better than Phi 3 Medium 4k Instruct?

Amazon Nova Experimental Chat 10 09 is the stronger model overall, scoring 41.9 to 33.0 on the Noometry Index.

Is Amazon Nova Experimental Chat 10 09 or Phi 3 Medium 4k Instruct better for coding?

Amazon Nova Experimental Chat 10 09 scores higher on coding benchmarks: 40.2 versus 32.9 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 10 09 and Phi 3 Medium 4k Instruct share?

9 benchmarks have published results for both models. Amazon Nova Experimental Chat 10 09 has 9 scored results on Noometry and Phi 3 Medium 4k Instruct has 17.

Related comparisons

Go deeper