Noometry

Microsoft, open weights

Phi-3.5-mini

Phi-3.5-mini by Microsoft has 5 published benchmark results on Noometry, not yet enough to be ranked.

Last verified

Noometry rank
Unranked
Index score
Not ranked
Evidence
Sparse 5 results
Provider
Microsoft
Released
August 16, 2024
Weights
Open weights
Reasoning
Unknown
Context window
—
Max output
—
Input price
Not listed
Output price
Not listed
Blended price
Not listed
Output speed
Not measured
Value
Not ranked
Knowledge cutoff
Unknown

Category scores

Each category score combines every public result we have in that category.

  1. Coding 34.6
CategoryScoreRankResults
Coding34.6#2322

Sponsored placements are available on pages like this one. Advertise on Noometry

Benchmark results

Every published result we track, with its source. Bold rows are the ones used for ranking; where several exist we prefer independent runs over self-reported numbers.

Coding

BenchmarkScorePositionSettingSourceDate
BigCodeBench Instruct32.8%#52 of 64, top 82%BigCodeBench2024-08-21
BigCodeBench Complete38.5%#54 of 66, top 82%BigCodeBench2024-08-21

Reasoning

BenchmarkScorePositionSettingSourceDate
PIQA81%#19 of 27, top 71%Epoch AI

Math

BenchmarkScorePositionSettingSourceDate
GSM8K86.2%#8 of 38, top 22%Epoch AI

Knowledge

BenchmarkScorePositionSettingSourceDate
BoolQ78%#17 of 23, top 74%Epoch AI

Compare Phi-3.5-mini

Other Microsoft models

Frequently asked questions

How good is Phi-3.5-mini?

Phi-3.5-mini by Microsoft has 5 published benchmark results on Noometry, not yet enough to be ranked.

Is Phi-3.5-mini open source?

Yes. Phi-3.5-mini's weights are downloadable; check the license for commercial terms.