Model comparison

Llama 3.2 90B vs Muse Glimmer

Muse Glimmer is the stronger model overall, scoring 41.3 to 27.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Llama 3.2 90B Meta

27.1

Rank #326 Confirmed

Muse Glimmer Meta

41.3

Rank #128 Confirmed

Summary

  • The widest gap is in math, where Muse Glimmer leads 36.1 to 10.4.

Side by side

Llama 3.2 90B and Muse Glimmer specifications
Llama 3.2 90BMuse Glimmer
ProviderMetaMeta
Noometry Index27.141.3
Released2024-09-24—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked913

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 3.2 90B: —, Muse Glimmer: 38.7 (#157)

Coding benchmarks
BenchmarkLlama 3.2 90BMuse Glimmer
LMArena WebDev—1355
LMArena Coding—1417

Agentic & Tool Use Not comparable

Llama 3.2 90B: 29.7 (#73), Muse Glimmer: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 90BMuse Glimmer
BALROG27.3%—

Reasoning Muse Glimmer leads

Llama 3.2 90B: 20.9 (#207), Muse Glimmer: 27.2 (#111)

Reasoning benchmarks
BenchmarkLlama 3.2 90BMuse Glimmer
EnigmaEval0.4%—
LMArena Hard Prompts—1395
Epoch Capabilities Index125.5—

Math Muse Glimmer leads

Llama 3.2 90B: 10.4 (#302), Muse Glimmer: 36.1 (#128)

Math benchmarks
BenchmarkLlama 3.2 90BMuse Glimmer
OTIS Mock AIME 2024-20252.6%—
LMArena Math—1419
MATH Level 539.4%—

Knowledge Muse Glimmer leads

Llama 3.2 90B: 21.7 (#269), Muse Glimmer: 37.9 (#140)

Knowledge benchmarks
BenchmarkLlama 3.2 90BMuse Glimmer
GPQA Diamond41%—
LMArena Expert—1388
MMLU80.3%—

Multimodal Not comparable

Llama 3.2 90B: 24.9 (#119), Muse Glimmer: —

Multimodal benchmarks
BenchmarkLlama 3.2 90BMuse Glimmer
LMArena Vision1000—
GeoBench52%—

Multilingual Not comparable

Llama 3.2 90B: —, Muse Glimmer: 50.6 (#117)

Multilingual benchmarks
BenchmarkLlama 3.2 90BMuse Glimmer
LMArena Non-English—1384
LMArena Chinese—1412
LMArena Russian—1393

Instruction Following Not comparable

Llama 3.2 90B: —, Muse Glimmer: 72.7 (#134)

Instruction Following benchmarks
BenchmarkLlama 3.2 90BMuse Glimmer
LMArena Instruction Following—1374

Long Context Not comparable

Llama 3.2 90B: —, Muse Glimmer: 42.1 (#124)

Long Context benchmarks
BenchmarkLlama 3.2 90BMuse Glimmer
LMArena Longer Query—1381

Writing & Preference Not comparable

Llama 3.2 90B: —, Muse Glimmer: 57.7 (#122)

Writing & Preference benchmarks
BenchmarkLlama 3.2 90BMuse Glimmer
LMArena Text—1389
LMArena Creative Writing—1338
LMArena Multi-Turn—1398

Frequently asked questions

Is Llama 3.2 90B better than Muse Glimmer?

Muse Glimmer is the stronger model overall, scoring 41.3 to 27.1 on the Noometry Index.

How many benchmarks do Llama 3.2 90B and Muse Glimmer share?

0 benchmarks have published results for both models. Llama 3.2 90B has 9 scored results on Noometry and Muse Glimmer has 13.

Related comparisons

Go deeper