Model comparison

Falcon-7B vs Muse Spark 1.1

Muse Spark 1.1 has enough public results to be ranked (#51); Falcon-7B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Summary

  • They share 1 benchmark with published results for both.
  • Falcon-7B has downloadable open weights; the other is API-only.

Side by side

Falcon-7B and Muse Spark 1.1 specifications
Falcon-7BMuse Spark 1.1
ProviderTechnology Innovation InstituteMeta
Noometry Index—49.9
Released2023-04-242026-04-08
WeightsOpenProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked1237

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-7B: —, Muse Spark 1.1: 51.3 (#40)

Coding benchmarks
BenchmarkFalcon-7BMuse Spark 1.1
DeepSWE—53.3%
LMArena WebDev—1542
SciCode—58.8%
LMArena Coding—1498

Agentic & Tool Use Not comparable

Falcon-7B: —, Muse Spark 1.1: 30.8 (#73)

Agentic & Tool Use benchmarks
BenchmarkFalcon-7BMuse Spark 1.1
APEX-Agents—31.8%
τ²-bench Banking—40.5%
GBAEval—7.9%
GDP.pdf—15%
Vending-Bench 2—6,520

Reasoning Not comparable

Falcon-7B: —, Muse Spark 1.1: 47.1 (#44)

Reasoning benchmarks
BenchmarkFalcon-7BMuse Spark 1.1
Epoch Capabilities Index95.1154.21
NYT Connections (extended)—84.9%
CritPt—15.1%
LMArena Hard Prompts—1486
DTBench—94.4%
LMCA—49.9%
Surface Evolver Bench—52.5%
BIG-Bench Hard28.8%—
HellaSwag78.1%—
LAMBADA74.9%—
PIQA80.3%—
WinoGrande67.2%—

Math Not comparable

Falcon-7B: —, Muse Spark 1.1: 45.5 (#76)

Math benchmarks
BenchmarkFalcon-7BMuse Spark 1.1
ProofBench—39%
LMArena Math—1483
GSM8K6.8%—

Knowledge Not comparable

Falcon-7B: —, Muse Spark 1.1: 53.1 (#59)

Knowledge benchmarks
BenchmarkFalcon-7BMuse Spark 1.1
SimpleQA Verified—57.8%
LMArena Expert—1478
ARC (AI2) Challenge47.9%—
BoolQ75.3%—
MMLU35%—
OpenBookQA51.6%—
TriviaQA64.6%—

Multimodal Not comparable

Falcon-7B: —, Muse Spark 1.1: 42.6 (#29)

Multimodal benchmarks
BenchmarkFalcon-7BMuse Spark 1.1
LMArena Vision—1293
LMArena Document—1465

Multilingual Not comparable

Falcon-7B: —, Muse Spark 1.1: 56.7 (#17)

Multilingual benchmarks
BenchmarkFalcon-7BMuse Spark 1.1
LMArena Non-English—1472
LMArena Chinese—1518
LMArena French—1494
LMArena German—1466
LMArena Japanese—1451
LMArena Korean—1458
LMArena Russian—1483
LMArena Spanish—1464

Instruction Following Not comparable

Falcon-7B: —, Muse Spark 1.1: 76.5 (#39)

Instruction Following benchmarks
BenchmarkFalcon-7BMuse Spark 1.1
LMArena Instruction Following—1457

Long Context Not comparable

Falcon-7B: —, Muse Spark 1.1: 44.8 (#58)

Long Context benchmarks
BenchmarkFalcon-7BMuse Spark 1.1
LMArena Longer Query—1462

Writing & Preference Not comparable

Falcon-7B: —, Muse Spark 1.1: 73.4 (#11)

Writing & Preference benchmarks
BenchmarkFalcon-7BMuse Spark 1.1
LMArena Text—1479
LMArena Creative Writing—1437
EQ-Bench Creative Writing—1927
EQ-Bench 4—1260
LMArena Multi-Turn—1485

Frequently asked questions

Is Falcon-7B better than Muse Spark 1.1?

Muse Spark 1.1 has enough public results to be ranked (#51); Falcon-7B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon-7B and Muse Spark 1.1 share?

1 benchmark has published results for both models. Falcon-7B has 12 scored results on Noometry and Muse Spark 1.1 has 37.

Related comparisons

Go deeper