Model comparison

Falcon-40B vs Muse Spark 1.3

Muse Spark 1.3 has enough public results to be ranked (#27); Falcon-40B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Summary

  • They share 1 benchmark with published results for both.
  • Falcon-40B has downloadable open weights; the other is API-only.

Side by side

Falcon-40B and Muse Spark 1.3 specifications
Falcon-40BMuse Spark 1.3
ProviderTechnology Innovation InstituteMeta
Noometry Index—54.4
Released2023-03-152026-09-02
WeightsOpenProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked1234

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-40B: —, Muse Spark 1.3: 56.1 (#18)

Coding benchmarks
BenchmarkFalcon-40BMuse Spark 1.3
CursorBench—41.6%
LMArena WebDev—1655
SciCode—59.7%
LMArena Coding—1516

Agentic & Tool Use Not comparable

Falcon-40B: —, Muse Spark 1.3: 38.6 (#28)

Agentic & Tool Use benchmarks
BenchmarkFalcon-40BMuse Spark 1.3
APEX-Agents—57.8%
GDP.pdf—27.6%

Reasoning Not comparable

Falcon-40B: —, Muse Spark 1.3: 52.9 (#27)

Reasoning benchmarks
BenchmarkFalcon-40BMuse Spark 1.3
Epoch Capabilities Index104.04156.89
NYT Connections (extended)—85.1%
CritPt—24.9%
Chess Puzzles—38%
LMArena Hard Prompts—1503
Mystery Game Puzzles—25%
DTBench—96.5%
LMCA—53.9%
Bench to the Future 3—0.14
BIG-Bench Hard37.1%—
HellaSwag85.3%—
LAMBADA77.3%—
PIQA83%—
WinoGrande76.9%—

Math Not comparable

Falcon-40B: —, Muse Spark 1.3: 72.4 (#16)

Math benchmarks
BenchmarkFalcon-40BMuse Spark 1.3
FrontierMath (Tiers 1-3)—74.4%
FrontierMath Tier 4—46.3%
OTIS Mock AIME 2024-2025—99.2%
LMArena Math—1497
GSM8K33.8%—

Knowledge Not comparable

Falcon-40B: —, Muse Spark 1.3: 42.0 (#92)

Knowledge benchmarks
BenchmarkFalcon-40BMuse Spark 1.3
LMArena Expert—1516
ARC (AI2) Challenge61.9%—
BoolQ83.1%—
MMLU56.9%—
OpenBookQA56.6%—
TriviaQA79.9%—

Multimodal Not comparable

Falcon-40B: —, Muse Spark 1.3: 43.0 (#21)

Multimodal benchmarks
BenchmarkFalcon-40BMuse Spark 1.3
LMArena Vision—1310
LMArena Document—1471

Multilingual Not comparable

Falcon-40B: —, Muse Spark 1.3: 57.8 (#6)

Multilingual benchmarks
BenchmarkFalcon-40BMuse Spark 1.3
LMArena Non-English—1485
LMArena Chinese—1527
LMArena French—1534
LMArena Korean—1513
LMArena Russian—1491
LMArena Spanish—1485

Instruction Following Not comparable

Falcon-40B: —, Muse Spark 1.3: 77.8 (#14)

Instruction Following benchmarks
BenchmarkFalcon-40BMuse Spark 1.3
LMArena Instruction Following—1481

Long Context Not comparable

Falcon-40B: —, Muse Spark 1.3: 45.7 (#29)

Long Context benchmarks
BenchmarkFalcon-40BMuse Spark 1.3
LMArena Longer Query—1491

Writing & Preference Not comparable

Falcon-40B: —, Muse Spark 1.3: 73.7 (#10)

Writing & Preference benchmarks
BenchmarkFalcon-40BMuse Spark 1.3
LMArena Text—1490
LMArena Creative Writing—1450
EQ-Bench Creative Writing—1906
LMArena Multi-Turn—1486

Frequently asked questions

Is Falcon-40B better than Muse Spark 1.3?

Muse Spark 1.3 has enough public results to be ranked (#27); Falcon-40B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon-40B and Muse Spark 1.3 share?

1 benchmark has published results for both models. Falcon-40B has 12 scored results on Noometry and Muse Spark 1.3 has 34.

Related comparisons

Go deeper