Model comparison

Falcon 2 11B vs Muse Spark 1.1

Muse Spark 1.1 has enough public results to be ranked (#43); Falcon 2 11B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Summary

  • They share 1 benchmark with published results for both.
  • Falcon 2 11B has downloadable open weights; the other is API-only.

Side by side

Falcon 2 11B and Muse Spark 1.1 specifications
Falcon 2 11BMuse Spark 1.1
ProviderTechnology Innovation InstituteMeta
Noometry Index—49.9
Released2024-05-092026-04-08
WeightsOpenProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked536

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon 2 11B: —, Muse Spark 1.1: 50.8 (#38)

Coding benchmarks
BenchmarkFalcon 2 11BMuse Spark 1.1
DeepSWE—53.3%
LMArena WebDev—1542
SciCode—58.8%
LMArena Coding—1497

Agentic & Tool Use Not comparable

Falcon 2 11B: —, Muse Spark 1.1: 33.9 (#45)

Agentic & Tool Use benchmarks
BenchmarkFalcon 2 11BMuse Spark 1.1
τ²-bench Banking—40.5%
GBAEval—7.9%
GDP.pdf—15%
Vending-Bench 2—6,520

Reasoning Not comparable

Falcon 2 11B: —, Muse Spark 1.1: 45.9 (#41)

Reasoning benchmarks
BenchmarkFalcon 2 11BMuse Spark 1.1
Epoch Capabilities Index109.25154.32
NYT Connections (extended)—84.9%
CritPt—15.1%
LMArena Hard Prompts—1486
DTBench—94.4%
LMCA—49.9%
Surface Evolver Bench—52.5%
HellaSwag82.9%—
WinoGrande78.3%—

Math Not comparable

Falcon 2 11B: —, Muse Spark 1.1: 44.0 (#67)

Math benchmarks
BenchmarkFalcon 2 11BMuse Spark 1.1
ProofBench—39%
LMArena Math—1477
GSM8K53.8%—

Knowledge Not comparable

Falcon 2 11B: —, Muse Spark 1.1: 52.8 (#55)

Knowledge benchmarks
BenchmarkFalcon 2 11BMuse Spark 1.1
SimpleQA Verified—57.8%
LMArena Expert—1480
MMLU58.4%—

Multimodal Not comparable

Falcon 2 11B: —, Muse Spark 1.1: 41.9 (#28)

Multimodal benchmarks
BenchmarkFalcon 2 11BMuse Spark 1.1
LMArena Vision—1292
LMArena Document—1465

Multilingual Not comparable

Falcon 2 11B: —, Muse Spark 1.1: 56.8 (#16)

Multilingual benchmarks
BenchmarkFalcon 2 11BMuse Spark 1.1
LMArena Non-English—1471
LMArena Chinese—1518
LMArena French—1494
LMArena German—1466
LMArena Japanese—1445
LMArena Korean—1459
LMArena Russian—1482
LMArena Spanish—1471

Instruction Following Not comparable

Falcon 2 11B: —, Muse Spark 1.1: 76.8 (#36)

Instruction Following benchmarks
BenchmarkFalcon 2 11BMuse Spark 1.1
LMArena Instruction Following—1457

Long Context Not comparable

Falcon 2 11B: —, Muse Spark 1.1: 44.8 (#55)

Long Context benchmarks
BenchmarkFalcon 2 11BMuse Spark 1.1
LMArena Longer Query—1463

Writing & Preference Not comparable

Falcon 2 11B: —, Muse Spark 1.1: 73.6 (#11)

Writing & Preference benchmarks
BenchmarkFalcon 2 11BMuse Spark 1.1
LMArena Text—1479
LMArena Creative Writing—1440
EQ-Bench Creative Writing—1927
EQ-Bench 4—1260
LMArena Multi-Turn—1484

Frequently asked questions

Is Falcon 2 11B better than Muse Spark 1.1?

Muse Spark 1.1 has enough public results to be ranked (#43); Falcon 2 11B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon 2 11B and Muse Spark 1.1 share?

1 benchmark has published results for both models. Falcon 2 11B has 5 scored results on Noometry and Muse Spark 1.1 has 36.

Related comparisons

Go deeper