Model comparison

DeepSeek LLM 67B vs Molmo 2 8b

Molmo 2 8b is the stronger model overall, scoring 39.1 to 24.9 on the Noometry Index.

Last verified . 4 shared benchmarks.

DeepSeek LLM 67B DeepSeek

24.9

Rank #347 Confirmed

Summary

  • They share 4 benchmarks with published results for both. DeepSeek LLM 67B scores higher in 0 categories and Molmo 2 8b in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Molmo 2 8b leads 49.4 to 31.6.

Side by side

DeepSeek LLM 67B and Molmo 2 8b specifications
DeepSeek LLM 67BMolmo 2 8b
ProviderDeepSeekAllen Institute for AI (Ai2)
Noometry Index24.939.1
Released2023-11-29—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked155

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

DeepSeek LLM 67B: 31.9 (#278), Molmo 2 8b: —

Coding benchmarks
BenchmarkDeepSeek LLM 67BMolmo 2 8b
LMArena Coding1096—

Reasoning Molmo 2 8b leads

DeepSeek LLM 67B: 16.5 (#304), Molmo 2 8b: 25.6 (#146)

Reasoning benchmarks
BenchmarkDeepSeek LLM 67BMolmo 2 8b
LMArena Hard Prompts10701287
Chess Puzzles0%—
Epoch Capabilities Index110.5—

Math Not comparable

DeepSeek LLM 67B: 8.7 (#324), Molmo 2 8b: —

Math benchmarks
BenchmarkDeepSeek LLM 67BMolmo 2 8b
OTIS Mock AIME 2024-20250.8%—
LMArena Math1108—
MATH Level 56.4%—

Knowledge Not comparable

DeepSeek LLM 67B: 7.0 (#313), Molmo 2 8b: —

Knowledge benchmarks
BenchmarkDeepSeek LLM 67BMolmo 2 8b
GPQA Diamond24.6%—

Multimodal Not comparable

DeepSeek LLM 67B: —, Molmo 2 8b: 30.2 (#112)

Multimodal benchmarks
BenchmarkDeepSeek LLM 67BMolmo 2 8b
LMArena Vision—1081

Multilingual Molmo 2 8b leads

DeepSeek LLM 67B: 29.4 (#267), Molmo 2 8b: 42.7 (#190)

Multilingual benchmarks
BenchmarkDeepSeek LLM 67BMolmo 2 8b
LMArena Non-English10731276
LMArena Chinese1132—

Instruction Following Molmo 2 8b leads

DeepSeek LLM 67B: 55.4 (#277), Molmo 2 8b: 67.0 (#201)

Instruction Following benchmarks
BenchmarkDeepSeek LLM 67BMolmo 2 8b
LMArena Instruction Following10791270

Long Context Not comparable

DeepSeek LLM 67B: 33.1 (#265), Molmo 2 8b: —

Long Context benchmarks
BenchmarkDeepSeek LLM 67BMolmo 2 8b
LMArena Longer Query1092—

Writing & Preference Molmo 2 8b leads

DeepSeek LLM 67B: 31.6 (#282), Molmo 2 8b: 49.4 (#191)

Writing & Preference benchmarks
BenchmarkDeepSeek LLM 67BMolmo 2 8b
LMArena Text11051288
LMArena Creative Writing1067—
LMArena Multi-Turn1082—

Frequently asked questions

Is DeepSeek LLM 67B better than Molmo 2 8b?

Molmo 2 8b is the stronger model overall, scoring 39.1 to 24.9 on the Noometry Index.

How many benchmarks do DeepSeek LLM 67B and Molmo 2 8b share?

4 benchmarks have published results for both models. DeepSeek LLM 67B has 15 scored results on Noometry and Molmo 2 8b has 5.

Related comparisons

Go deeper