Model comparison

Amazon Nova Micro vs Phi-3.5-MoE

Amazon Nova Micro has enough public results to be ranked (#290); Phi-3.5-MoE does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Amazon Nova Micro Amazon

29.9

Rank #290 Confirmed

Phi-3.5-MoE Microsoft

—

Unranked

Summary

  • Phi-3.5-MoE has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Micro and Phi-3.5-MoE specifications
Amazon Nova MicroPhi-3.5-MoE
ProviderAmazonMicrosoft
Noometry Index29.9—
Released2024-12-032024-08-17
WeightsProprietaryOpen
Context window128K—
Max output10K—
Input $ / M tokens$0.035—
Output $ / M tokens$0.14—
Results tracked323

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Amazon Nova Micro: 30.0 (#289), Phi-3.5-MoE: —

Coding benchmarks
BenchmarkAmazon Nova MicroPhi-3.5-MoE
LiveBench Coding20.2%—
LMArena Coding1218—

Agentic & Tool Use Not comparable

Amazon Nova Micro: 21.9 (#125), Phi-3.5-MoE: —

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova MicroPhi-3.5-MoE
Berkeley Function Calling Leaderboard22.3%—

Reasoning Not comparable

Amazon Nova Micro: 16.7 (#289), Phi-3.5-MoE: —

Reasoning benchmarks
BenchmarkAmazon Nova MicroPhi-3.5-MoE
LiveBench Reasoning25.1%—
LMArena Hard Prompts1191—
LiveBench Data Analysis34%—
LiveBench29.6%—
PIQA—88.6%

Math Not comparable

Amazon Nova Micro: 24.9 (#252), Phi-3.5-MoE: —

Math benchmarks
BenchmarkAmazon Nova MicroPhi-3.5-MoE
Omni-MATH21.4%—
LiveBench Math34.5%—
LMArena Math1206—
GSM8K—88.7%

Knowledge Not comparable

Amazon Nova Micro: 29.2 (#231), Phi-3.5-MoE: —

Knowledge benchmarks
BenchmarkAmazon Nova MicroPhi-3.5-MoE
MMLU-Pro51.1%—
Vectara Hallucination Rate5.5%—
GPQA (HELM)38.3%—
LMArena Expert1184—
BoolQ—84.6%
MMLU70.8%—

Multilingual Not comparable

Amazon Nova Micro: 36.7 (#234), Phi-3.5-MoE: —

Multilingual benchmarks
BenchmarkAmazon Nova MicroPhi-3.5-MoE
LMArena Non-English1186—
LMArena Chinese1209—
LMArena French1237—
LMArena German1192—
LMArena Japanese1154—
LMArena Korean1150—
LMArena Russian1185—
LMArena Spanish1225—

Instruction Following Not comparable

Amazon Nova Micro: 56.6 (#267), Phi-3.5-MoE: —

Instruction Following benchmarks
BenchmarkAmazon Nova MicroPhi-3.5-MoE
LiveBench Instruction Following48%—
IFEval76%—
LMArena Instruction Following1174—

Long Context Not comparable

Amazon Nova Micro: 36.5 (#224), Phi-3.5-MoE: —

Long Context benchmarks
BenchmarkAmazon Nova MicroPhi-3.5-MoE
LMArena Longer Query1206—

Writing & Preference Not comparable

Amazon Nova Micro: 39.7 (#242), Phi-3.5-MoE: —

Writing & Preference benchmarks
BenchmarkAmazon Nova MicroPhi-3.5-MoE
LMArena Text1208—
LMArena Creative Writing1172—
WildBench74.3%—
LMArena Multi-Turn1178—
LiveBench Language15.8%—

Frequently asked questions

Is Amazon Nova Micro better than Phi-3.5-MoE?

Amazon Nova Micro has enough public results to be ranked (#290); Phi-3.5-MoE does not yet, so treat this comparison as directional.

How many benchmarks do Amazon Nova Micro and Phi-3.5-MoE share?

0 benchmarks have published results for both models. Amazon Nova Micro has 32 scored results on Noometry and Phi-3.5-MoE has 3.

Related comparisons

Go deeper