Noometry

Model comparison

GPT-3.5-turbo vs Muse Spark

Muse Spark is the stronger model overall, scoring 50.3 to 23.1 on the Noometry Index.

Last verified . 19 shared benchmarks.

GPT-3.5-turbo OpenAI

23.1

Rank #345 Confirmed

Muse Spark Meta

50.3

Rank #41 Confirmed

Summary

  • They share 19 benchmarks with published results for both. GPT-3.5-turbo scores higher in 0 categories and Muse Spark in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Muse Spark leads 65.7 to 10.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 2.2% for GPT-3.5-turbo and 88.9% for Muse Spark.

Side by side

GPT-3.5-turboMuse Spark
ProviderOpenAIMeta
Noometry Index23.150.3
Released2023-03-012026-04-08
WeightsProprietaryProprietary
Context window16K—
Max output4K—
Input $ / M tokens$0.50—
Output $ / M tokens$1.50—
Results tracked4427

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark leads

GPT-3.5-turbo: 23.5 (#326), Muse Spark: 45.6 (#65)

BenchmarkGPT-3.5-turboMuse Spark
LMArena Coding11371482
SciCode—51.5%
WeirdML3.5%—
BigCodeBench Instruct39.1%—
BigCodeBench Complete50.6%—
HumanEval+70.7%—
MBPP+69.7%—

Agentic & Tool Use Not comparable

GPT-3.5-turbo: —, Muse Spark: —

BenchmarkGPT-3.5-turboMuse Spark
METR Time Horizons21.5%—

Reasoning Muse Spark leads

GPT-3.5-turbo: 13.3 (#328), Muse Spark: 34.9 (#61)

BenchmarkGPT-3.5-turboMuse Spark
LMArena Hard Prompts11081475
Epoch Capabilities Index118.48152.09
CritPt—11.3%
Chess Puzzles0%—
Mystery Game Puzzles3%—
DTBench48.5%—
LMCA9.7%—
Adversarial NLI58.1%—
BIG-Bench Hard61.6%—
CommonsenseQA 2.057%—
ForecastBench50.4—
WinoGrande81.6%—

Math Muse Spark leads

GPT-3.5-turbo: 6.0 (#321), Muse Spark: 46.8 (#57)

BenchmarkGPT-3.5-turboMuse Spark
OTIS Mock AIME 2024-20252.2%88.9%
LMArena Math11421455
FrontierMath (Tiers 1-3)0%—
ProofBench—17%
MATH Level 515.9%—
FrontierMath (Feb 2025 set)—39%
FrontierMath Tier 4 (v1)—14.6%
GSM8K57.8%—

Knowledge Muse Spark leads

GPT-3.5-turbo: 10.0 (#298), Muse Spark: 65.7 (#12)

BenchmarkGPT-3.5-turboMuse Spark
GPQA Diamond28%89.8%
LMArena Expert10701458
Humanity's Last Exam—40.6%
ARC (AI2) Challenge87.4%—
BoolQ87%—
MMLU71.4%—
OpenBookQA86%—
TriviaQA85.8%—

Multimodal Not comparable

GPT-3.5-turbo: —, Muse Spark: 42.7 (#23)

BenchmarkGPT-3.5-turboMuse Spark
LMArena Vision—1306
LMArena Document—1444

Multilingual Muse Spark leads

GPT-3.5-turbo: 31.6 (#253), Muse Spark: 56.3 (#23)

BenchmarkGPT-3.5-turboMuse Spark
LMArena Non-English11081464
LMArena Chinese10751507
LMArena French11171497
LMArena German10901497
LMArena Korean10191457
LMArena Russian11231467
LMArena Spanish11201471
LMArena Japanese1043—

Instruction Following Muse Spark leads

GPT-3.5-turbo: 58.1 (#257), Muse Spark: 76.1 (#47)

BenchmarkGPT-3.5-turboMuse Spark
LMArena Instruction Following11191443

Long Context Muse Spark leads

GPT-3.5-turbo: 34.0 (#249), Muse Spark: 44.4 (#65)

BenchmarkGPT-3.5-turboMuse Spark
LMArena Longer Query11211451

Writing & Preference Muse Spark leads

GPT-3.5-turbo: 25.4 (#300), Muse Spark: 66.2 (#37)

BenchmarkGPT-3.5-turboMuse Spark
LMArena Text11251474
LMArena Creative Writing10921460
LMArena Multi-Turn11171477
EQ-Bench Creative Writing451—

Frequently asked questions

Is GPT-3.5-turbo better than Muse Spark?

Muse Spark is the stronger model overall, scoring 50.3 to 23.1 on the Noometry Index.

Is GPT-3.5-turbo or Muse Spark better for coding?

Muse Spark scores higher on coding benchmarks: 45.6 versus 23.5 in the Noometry coding category.

How many benchmarks do GPT-3.5-turbo and Muse Spark share?

19 benchmarks have published results for both models. GPT-3.5-turbo has 44 scored results on Noometry and Muse Spark has 27.

Related comparisons

Go deeper