Model comparison

Codestral vs Muse Glimmer

Muse Glimmer is the stronger model overall, scoring 41.7 to 30.6 on the Noometry Index.

Last verified . 0 shared benchmarks.

Codestral Mistral AI

30.6

Rank #290 Reported

Muse Glimmer Meta

41.7

Rank #131 Confirmed

Summary

  • The widest gap is in coding, where Muse Glimmer leads 40.4 to 27.3.
  • Muse Glimmer has downloadable open weights; the other is API-only.

Side by side

Codestral and Muse Glimmer specifications
CodestralMuse Glimmer
ProviderMistral AIMeta
Noometry Index30.641.7
Released2024-05-292026-08-10
WeightsProprietaryOpen
Context window256K—
Max output8K—
Input $ / M tokens$0.30—
Output $ / M tokens$0.90—
Results tracked715

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Glimmer leads

Codestral: 27.3 (#321), Muse Glimmer: 40.4 (#142)

Coding benchmarks
BenchmarkCodestralMuse Glimmer
Aider Polyglot11.1%—
LMArena WebDev—1355
SciCode—44.9%
BigCodeBench Instruct41.8%—
LMArena Coding—1416
BigCodeBench Complete52.5%—
ALE-Bench137.78—
HumanEval+73.8%—
MBPP+61.9%—

Reasoning Muse Glimmer leads

Codestral: 19.8 (#251), Muse Glimmer: 25.7 (#144)

Reasoning benchmarks
BenchmarkCodestralMuse Glimmer
Kagi LLM Benchmark32.5%—
CritPt—2.6%
LMArena Hard Prompts—1396

Math Not comparable

Codestral: —, Muse Glimmer: 38.8 (#125)

Math benchmarks
BenchmarkCodestralMuse Glimmer
LMArena Math—1417

Knowledge Not comparable

Codestral: —, Muse Glimmer: 38.5 (#143)

Knowledge benchmarks
BenchmarkCodestralMuse Glimmer
LMArena Expert—1386

Multilingual Not comparable

Codestral: —, Muse Glimmer: 50.5 (#122)

Multilingual benchmarks
BenchmarkCodestralMuse Glimmer
LMArena Non-English—1384
LMArena Chinese—1412
LMArena Russian—1390

Instruction Following Not comparable

Codestral: —, Muse Glimmer: 72.6 (#135)

Instruction Following benchmarks
BenchmarkCodestralMuse Glimmer
LMArena Instruction Following—1375

Long Context Not comparable

Codestral: —, Muse Glimmer: 42.1 (#129)

Long Context benchmarks
BenchmarkCodestralMuse Glimmer
LMArena Longer Query—1382

Writing & Preference Not comparable

Codestral: —, Muse Glimmer: 57.5 (#126)

Writing & Preference benchmarks
BenchmarkCodestralMuse Glimmer
LMArena Text—1389
LMArena Creative Writing—1339
LMArena Multi-Turn—1399

Frequently asked questions

Is Codestral better than Muse Glimmer?

Muse Glimmer is the stronger model overall, scoring 41.7 to 30.6 on the Noometry Index.

Is Codestral or Muse Glimmer better for coding?

Muse Glimmer scores higher on coding benchmarks: 40.4 versus 27.3 in the Noometry coding category.

How many benchmarks do Codestral and Muse Glimmer share?

0 benchmarks have published results for both models. Codestral has 7 scored results on Noometry and Muse Glimmer has 15.

Related comparisons

Go deeper