Model comparison

Mistral Small 3.1 vs Phi-3.5-MoE

Mistral Small 3.1 has enough public results to be ranked (#263); Phi-3.5-MoE does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Mistral Small 3.1 Mistral AI

31.4

Rank #263 Confirmed

Phi-3.5-MoE Microsoft

—

Unranked

Side by side

Mistral Small 3.1 and Phi-3.5-MoE specifications
Mistral Small 3.1Phi-3.5-MoE
ProviderMistral AIMicrosoft
Noometry Index31.4—
Released2025-03-172024-08-17
WeightsOpenOpen
Context window128K—
Max output102K—
Input $ / M tokens$0.35—
Output $ / M tokens$0.56—
Results tracked283

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Small 3.1: 37.7 (#175), Phi-3.5-MoE: —

Coding benchmarks
BenchmarkMistral Small 3.1Phi-3.5-MoE
LMArena Coding1309—

Reasoning Not comparable

Mistral Small 3.1: 18.9 (#249), Phi-3.5-MoE: —

Reasoning benchmarks
BenchmarkMistral Small 3.1Phi-3.5-MoE
Chess Puzzles1%—
LMArena Hard Prompts1278—
Epoch Capabilities Index127.48—
PIQA—88.6%

Math Not comparable

Mistral Small 3.1: 13.7 (#295), Phi-3.5-MoE: —

Math benchmarks
BenchmarkMistral Small 3.1Phi-3.5-MoE
OTIS Mock AIME 2024-20253.9%—
Omni-MATH24.8%—
LMArena Math1261—
GSM8K—88.7%

Knowledge Not comparable

Mistral Small 3.1: 22.6 (#266), Phi-3.5-MoE: —

Knowledge benchmarks
BenchmarkMistral Small 3.1Phi-3.5-MoE
GPQA Diamond41.9%—
MMLU-Pro61%—
GPQA (HELM)39.2%—
LMArena Expert1258—
BoolQ—84.6%

Multimodal Not comparable

Mistral Small 3.1: 32.6 (#93), Phi-3.5-MoE: —

Multimodal benchmarks
BenchmarkMistral Small 3.1Phi-3.5-MoE
LMArena Vision1136—

Multilingual Not comparable

Mistral Small 3.1: 41.4 (#204), Phi-3.5-MoE: —

Multilingual benchmarks
BenchmarkMistral Small 3.1Phi-3.5-MoE
LMArena Non-English1255—
LMArena Chinese1254—
LMArena French1270—
LMArena German1266—
LMArena Japanese1210—
LMArena Korean1206—
LMArena Russian1263—
LMArena Spanish1283—

Instruction Following Not comparable

Mistral Small 3.1: 63.8 (#225), Phi-3.5-MoE: —

Instruction Following benchmarks
BenchmarkMistral Small 3.1Phi-3.5-MoE
IFEval75%—
LMArena Instruction Following1264—

Long Context Not comparable

Mistral Small 3.1: 39.5 (#172), Phi-3.5-MoE: —

Long Context benchmarks
BenchmarkMistral Small 3.1Phi-3.5-MoE
LMArena Longer Query1300—

Writing & Preference Not comparable

Mistral Small 3.1: 37.2 (#254), Phi-3.5-MoE: —

Writing & Preference benchmarks
BenchmarkMistral Small 3.1Phi-3.5-MoE
LMArena Text1278—
LMArena Creative Writing1253—
EQ-Bench Creative Writing761—
WildBench78.8%—
LMArena Multi-Turn1270—

Frequently asked questions

Is Mistral Small 3.1 better than Phi-3.5-MoE?

Mistral Small 3.1 has enough public results to be ranked (#263); Phi-3.5-MoE does not yet, so treat this comparison as directional.

How many benchmarks do Mistral Small 3.1 and Phi-3.5-MoE share?

0 benchmarks have published results for both models. Mistral Small 3.1 has 28 scored results on Noometry and Phi-3.5-MoE has 3.

Related comparisons

Go deeper