Model comparison

Muse Spark 1.1 vs Qwen3-4B

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 31.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

Muse Spark 1.1 Meta

49.9

Rank #43 Confirmed

Qwen3-4B Alibaba (Qwen)

31.5

Rank #261 Confirmed

Summary

  • The widest gap is in reasoning, where Muse Spark 1.1 leads 45.9 to 18.5.
  • Qwen3-4B has downloadable open weights; the other is API-only.

Side by side

Muse Spark 1.1 and Qwen3-4B specifications
Muse Spark 1.1Qwen3-4B
ProviderMetaAlibaba (Qwen)
Noometry Index49.931.5
Released2026-04-082025-04-29
WeightsProprietaryOpen
Context window1.05M—
Max output131K—
Input $ / M tokens$1.25—
Output $ / M tokens$4.25—
Results tracked366

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Muse Spark 1.1: 50.8 (#38), Qwen3-4B: —

Coding benchmarks
BenchmarkMuse Spark 1.1Qwen3-4B
DeepSWE53.3%—
LMArena WebDev1542—
SciCode58.8%—
LMArena Coding1497—

Agentic & Tool Use Muse Spark 1.1 leads

Muse Spark 1.1: 33.9 (#45), Qwen3-4B: 27.3 (#94)

Agentic & Tool Use benchmarks
BenchmarkMuse Spark 1.1Qwen3-4B
Berkeley Function Calling Leaderboard—35.7%
τ²-bench Banking40.5%—
GBAEval7.9%—
GDP.pdf15%—
Vending-Bench 26,520—

Reasoning Muse Spark 1.1 leads

Muse Spark 1.1: 45.9 (#41), Qwen3-4B: 18.5 (#264)

Reasoning benchmarks
BenchmarkMuse Spark 1.1Qwen3-4B
NYT Connections (extended)84.9%—
CritPt15.1%—
Chess Puzzles—4%
LMArena Hard Prompts1486—
DTBench94.4%—
LMCA49.9%—
Surface Evolver Bench52.5%—
Epoch Capabilities Index154.32—

Math Muse Spark 1.1 leads

Muse Spark 1.1: 44.0 (#67), Qwen3-4B: 28.5 (#228)

Math benchmarks
BenchmarkMuse Spark 1.1Qwen3-4B
MathArena Final-Answer Competitions—38.5%
OTIS Mock AIME 2024-2025—52.2%
ProofBench39%—
LMArena Math1477—

Knowledge Muse Spark 1.1 leads

Muse Spark 1.1: 52.8 (#55), Qwen3-4B: 33.0 (#198)

Knowledge benchmarks
BenchmarkMuse Spark 1.1Qwen3-4B
GPQA Diamond—52.3%
SimpleQA Verified57.8%—
Vectara Hallucination Rate—5.7%
LMArena Expert1480—

Multimodal Not comparable

Muse Spark 1.1: 41.9 (#28), Qwen3-4B: —

Multimodal benchmarks
BenchmarkMuse Spark 1.1Qwen3-4B
LMArena Vision1292—
LMArena Document1465—

Multilingual Not comparable

Muse Spark 1.1: 56.8 (#16), Qwen3-4B: —

Multilingual benchmarks
BenchmarkMuse Spark 1.1Qwen3-4B
LMArena Non-English1471—
LMArena Chinese1518—
LMArena French1494—
LMArena German1466—
LMArena Japanese1445—
LMArena Korean1459—
LMArena Russian1482—
LMArena Spanish1471—

Instruction Following Not comparable

Muse Spark 1.1: 76.8 (#36), Qwen3-4B: —

Instruction Following benchmarks
BenchmarkMuse Spark 1.1Qwen3-4B
LMArena Instruction Following1457—

Long Context Not comparable

Muse Spark 1.1: 44.8 (#55), Qwen3-4B: —

Long Context benchmarks
BenchmarkMuse Spark 1.1Qwen3-4B
LMArena Longer Query1463—

Writing & Preference Not comparable

Muse Spark 1.1: 73.6 (#11), Qwen3-4B: —

Writing & Preference benchmarks
BenchmarkMuse Spark 1.1Qwen3-4B
LMArena Text1479—
LMArena Creative Writing1440—
EQ-Bench Creative Writing1927—
EQ-Bench 41260—
LMArena Multi-Turn1484—

Frequently asked questions

Is Muse Spark 1.1 better than Qwen3-4B?

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 31.5 on the Noometry Index.

How many benchmarks do Muse Spark 1.1 and Qwen3-4B share?

0 benchmarks have published results for both models. Muse Spark 1.1 has 36 scored results on Noometry and Qwen3-4B has 6.

Related comparisons

Go deeper