Model comparison

Ministral 3B vs Muse Glimmer

Muse Glimmer is the stronger model overall, scoring 41.7 to 26.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Ministral 3B Mistral AI

26.2

Rank #338 Confirmed

Muse Glimmer Meta

41.7

Rank #131 Confirmed

Summary

  • The widest gap is in knowledge, where Muse Glimmer leads 38.5 to 10.4.

Side by side

Ministral 3B and Muse Glimmer specifications
Ministral 3BMuse Glimmer
ProviderMistral AIMeta
Noometry Index26.241.7
Released2024-10-012026-08-10
WeightsOpenOpen
Context window131K—
Max output262K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.10—
Results tracked615

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Ministral 3B: —, Muse Glimmer: 40.4 (#142)

Coding benchmarks
BenchmarkMinistral 3BMuse Glimmer
LMArena WebDev—1355
SciCode—44.9%
LMArena Coding—1416

Reasoning Muse Glimmer leads

Ministral 3B: 18.4 (#282), Muse Glimmer: 25.7 (#144)

Reasoning benchmarks
BenchmarkMinistral 3BMuse Glimmer
CritPt—2.6%
LMArena Hard Prompts—1396
DTBench51.7%—
LMCA5.5%—
Epoch Capabilities Index118.1—

Math Muse Glimmer leads

Ministral 3B: 26.6 (#258), Muse Glimmer: 38.8 (#125)

Math benchmarks
BenchmarkMinistral 3BMuse Glimmer
LMArena Math—1417
MATH Level 514.4%—

Knowledge Muse Glimmer leads

Ministral 3B: 10.4 (#302), Muse Glimmer: 38.5 (#143)

Knowledge benchmarks
BenchmarkMinistral 3BMuse Glimmer
GPQA Diamond25.3%—
Vectara Hallucination Rate7.3%—
LMArena Expert—1386

Multilingual Not comparable

Ministral 3B: —, Muse Glimmer: 50.5 (#122)

Multilingual benchmarks
BenchmarkMinistral 3BMuse Glimmer
LMArena Non-English—1384
LMArena Chinese—1412
LMArena Russian—1390

Instruction Following Not comparable

Ministral 3B: —, Muse Glimmer: 72.6 (#135)

Instruction Following benchmarks
BenchmarkMinistral 3BMuse Glimmer
LMArena Instruction Following—1375

Long Context Not comparable

Ministral 3B: —, Muse Glimmer: 42.1 (#129)

Long Context benchmarks
BenchmarkMinistral 3BMuse Glimmer
LMArena Longer Query—1382

Writing & Preference Not comparable

Ministral 3B: —, Muse Glimmer: 57.5 (#126)

Writing & Preference benchmarks
BenchmarkMinistral 3BMuse Glimmer
LMArena Text—1389
LMArena Creative Writing—1339
LMArena Multi-Turn—1399

Frequently asked questions

Is Ministral 3B better than Muse Glimmer?

Muse Glimmer is the stronger model overall, scoring 41.7 to 26.2 on the Noometry Index.

How many benchmarks do Ministral 3B and Muse Glimmer share?

0 benchmarks have published results for both models. Ministral 3B has 6 scored results on Noometry and Muse Glimmer has 15.

Related comparisons

Go deeper