Model comparison

Mistral Nemo vs Muse Glimmer

Muse Glimmer is the stronger model overall, scoring 41.7 to 26.4 on the Noometry Index.

Last verified . 0 shared benchmarks.

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Muse Glimmer Meta

41.7

Rank #131 Confirmed

Summary

  • The widest gap is in writing & preference, where Muse Glimmer leads 57.5 to 28.5.

Side by side

Mistral Nemo and Muse Glimmer specifications
Mistral NemoMuse Glimmer
ProviderMistral AIMeta
Noometry Index26.441.7
Released2024-07-012026-08-10
WeightsOpenOpen
Context window128K—
Max output128K—
Input $ / M tokens$0.15—
Output $ / M tokens$0.15—
Results tracked1015

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Nemo: —, Muse Glimmer: 40.4 (#142)

Coding benchmarks
BenchmarkMistral NemoMuse Glimmer
LMArena WebDev—1355
SciCode—44.9%
LMArena Coding—1416

Agentic & Tool Use Not comparable

Mistral Nemo: 23.5 (#125), Muse Glimmer: —

Agentic & Tool Use benchmarks
BenchmarkMistral NemoMuse Glimmer
Berkeley Function Calling Leaderboard27.6%—
BALROG17.6%—

Reasoning Muse Glimmer leads

Mistral Nemo: 20.7 (#232), Muse Glimmer: 25.7 (#144)

Reasoning benchmarks
BenchmarkMistral NemoMuse Glimmer
CritPt—2.6%
LMArena Hard Prompts—1396
DTBench48.6%—
Epoch Capabilities Index118.68—
PIQA83.5%—

Math Muse Glimmer leads

Mistral Nemo: 25.5 (#268), Muse Glimmer: 38.8 (#125)

Math benchmarks
BenchmarkMistral NemoMuse Glimmer
LMArena Math—1417
MATH Level 510.8%—
GSM8K84.2%—

Knowledge Muse Glimmer leads

Mistral Nemo: 12.3 (#298), Muse Glimmer: 38.5 (#143)

Knowledge benchmarks
BenchmarkMistral NemoMuse Glimmer
GPQA Diamond29.9%—
LMArena Expert—1386
BoolQ82.5%—

Multilingual Not comparable

Mistral Nemo: —, Muse Glimmer: 50.5 (#122)

Multilingual benchmarks
BenchmarkMistral NemoMuse Glimmer
LMArena Non-English—1384
LMArena Chinese—1412
LMArena Russian—1390

Instruction Following Not comparable

Mistral Nemo: —, Muse Glimmer: 72.6 (#135)

Instruction Following benchmarks
BenchmarkMistral NemoMuse Glimmer
LMArena Instruction Following—1375

Long Context Not comparable

Mistral Nemo: —, Muse Glimmer: 42.1 (#129)

Long Context benchmarks
BenchmarkMistral NemoMuse Glimmer
LMArena Longer Query—1382

Writing & Preference Muse Glimmer leads

Mistral Nemo: 28.5 (#296), Muse Glimmer: 57.5 (#126)

Writing & Preference benchmarks
BenchmarkMistral NemoMuse Glimmer
LMArena Text—1389
LMArena Creative Writing—1339
EQ-Bench Creative Writing881—
LMArena Multi-Turn—1399

Frequently asked questions

Is Mistral Nemo better than Muse Glimmer?

Muse Glimmer is the stronger model overall, scoring 41.7 to 26.4 on the Noometry Index.

How many benchmarks do Mistral Nemo and Muse Glimmer share?

0 benchmarks have published results for both models. Mistral Nemo has 10 scored results on Noometry and Muse Glimmer has 15.

Related comparisons

Go deeper