Model comparison

Magistral Small vs Phi 3 Mini 128k Instruct

Magistral Small and Phi 3 Mini 128k Instruct score almost the same on the Noometry Index (30.2 vs 29.7), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Magistral Small Mistral AI

30.2

Rank #296 Confirmed

Phi 3 Mini 128k Instruct Microsoft

29.7

Rank #305 Confirmed

Summary

  • The widest gap is in reasoning, where Phi 3 Mini 128k Instruct leads 19.6 to 6.8.

Side by side

Magistral Small and Phi 3 Mini 128k Instruct specifications
Magistral SmallPhi 3 Mini 128k Instruct
ProviderMistral AIMicrosoft
Noometry Index30.229.7
Released2025-06-102024-04-23
WeightsOpenOpen
Context window128K—
Max output40K—
Input $ / M tokens$0.50—
Output $ / M tokens$1.50—
Results tracked1019

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Magistral Small leads

Magistral Small: 38.4 (#176), Phi 3 Mini 128k Instruct: 28.8 (#312)

Coding benchmarks
BenchmarkMagistral SmallPhi 3 Mini 128k Instruct
SciCode35.2%—
BigCodeBench Instruct—29.6%
LMArena Coding—1039
BigCodeBench Complete—40.6%

Reasoning Phi 3 Mini 128k Instruct leads

Magistral Small: 6.8 (#350), Phi 3 Mini 128k Instruct: 19.6 (#256)

Reasoning benchmarks
BenchmarkMagistral SmallPhi 3 Mini 128k Instruct
ARC-AGI-20%—
Kagi LLM Benchmark6.3%—
ARC-AGI-15%—
CritPt0.3%—
Chess Puzzles3%—
LMArena Hard Prompts—1028
DTBench61.3%—
Epoch Capabilities Index133.19—

Math Phi 3 Mini 128k Instruct leads

Magistral Small: 26.2 (#261), Phi 3 Mini 128k Instruct: 31.6 (#222)

Math benchmarks
BenchmarkMagistral SmallPhi 3 Mini 128k Instruct
OTIS Mock AIME 2024-202530%—
LMArena Math—1089

Knowledge Magistral Small leads

Magistral Small: 30.9 (#223), Phi 3 Mini 128k Instruct: 26.8 (#254)

Knowledge benchmarks
BenchmarkMagistral SmallPhi 3 Mini 128k Instruct
GPQA Diamond56.1%—
LMArena Expert—984

Multilingual Not comparable

Magistral Small: —, Phi 3 Mini 128k Instruct: 25.2 (#285)

Multilingual benchmarks
BenchmarkMagistral SmallPhi 3 Mini 128k Instruct
LMArena Non-English—1000
LMArena Chinese—1016
LMArena French—1039
LMArena German—1006
LMArena Japanese—899
LMArena Korean—856
LMArena Russian—1004
LMArena Spanish—1059

Instruction Following Not comparable

Magistral Small: —, Phi 3 Mini 128k Instruct: 51.8 (#294)

Instruction Following benchmarks
BenchmarkMagistral SmallPhi 3 Mini 128k Instruct
LMArena Instruction Following—1023

Long Context Not comparable

Magistral Small: —, Phi 3 Mini 128k Instruct: 30.4 (#289)

Long Context benchmarks
BenchmarkMagistral SmallPhi 3 Mini 128k Instruct
LMArena Longer Query—996

Writing & Preference Not comparable

Magistral Small: —, Phi 3 Mini 128k Instruct: 27.1 (#301)

Writing & Preference benchmarks
BenchmarkMagistral SmallPhi 3 Mini 128k Instruct
LMArena Text—1050
LMArena Creative Writing—1024
LMArena Multi-Turn—989

Frequently asked questions

Is Magistral Small better than Phi 3 Mini 128k Instruct?

Magistral Small and Phi 3 Mini 128k Instruct score almost the same on the Noometry Index (30.2 vs 29.7), so choose on price, context window or the category you care about most.

Is Magistral Small or Phi 3 Mini 128k Instruct better for coding?

Magistral Small scores higher on coding benchmarks: 38.4 versus 28.8 in the Noometry coding category.

How many benchmarks do Magistral Small and Phi 3 Mini 128k Instruct share?

0 benchmarks have published results for both models. Magistral Small has 10 scored results on Noometry and Phi 3 Mini 128k Instruct has 19.

Related comparisons

Go deeper