Noometry

Model comparison

DeepSeek V4 Flash vs Olmo 3.1 32b Instruct

DeepSeek V4 Flash is the stronger model overall, scoring 53.6 to 39.4 on the Noometry Index.

Last verified . 16 shared benchmarks.

DeepSeek V4 Flash DeepSeek

53.6

Rank #35 Confirmed

Olmo 3.1 32b Instruct Allen Institute for AI (Ai2)

39.4

Rank #168 Confirmed

Summary

  • They share 16 benchmarks with published results for both. DeepSeek V4 Flash scores higher in 8 categories and Olmo 3.1 32b Instruct in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where DeepSeek V4 Flash leads 53.7 to 26.4.

Side by side

DeepSeek V4 FlashOlmo 3.1 32b Instruct
ProviderDeepSeekAllen Institute for AI (Ai2)
Noometry Index53.639.4
Released2026-04-24—
WeightsOpenOpen
Context window1M—
Max output393K—
Input $ / M tokens$0.15—
Output $ / M tokens$0.60—
Results tracked4116

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek V4 Flash leads

DeepSeek V4 Flash: 47.9 (#59), Olmo 3.1 32b Instruct: 39.5 (#157)

BenchmarkDeepSeek V4 FlashOlmo 3.1 32b Instruct
LMArena Coding14571347
FrontierCode18.8%—
LMArena WebDev1582—
SciCode49.9%—
WeirdML63%—
ALE-Bench1,306—

Reasoning DeepSeek V4 Flash leads

DeepSeek V4 Flash: 53.7 (#30), Olmo 3.1 32b Instruct: 26.4 (#132)

BenchmarkDeepSeek V4 FlashOlmo 3.1 32b Instruct
LMArena Hard Prompts14441322
ARC-AGI-261.4%—
SimpleBench61.1%—
Kagi LLM Benchmark52.2%—
NYT Connections (extended)89.6%—
ARC-AGI-189%—
CritPt16.6%—
Chess Puzzles33%—
Mystery Game Puzzles34%—
DTBench90.9%—
LMCA41.7%—
Epoch Capabilities Index154.49—

Math DeepSeek V4 Flash leads

DeepSeek V4 Flash: 60.3 (#37), Olmo 3.1 32b Instruct: 36.3 (#167)

BenchmarkDeepSeek V4 FlashOlmo 3.1 32b Instruct
LMArena Math14271305
FrontierMath (Tiers 1-3)57.5%—
FrontierMath Tier 424.4%—
MathArena Final-Answer Competitions76.5%—
OTIS Mock AIME 2024-202594.4%—
ProofBench56%—

Knowledge DeepSeek V4 Flash leads

DeepSeek V4 Flash: 55.4 (#48), Olmo 3.1 32b Instruct: 36.1 (#175)

BenchmarkDeepSeek V4 FlashOlmo 3.1 32b Instruct
LMArena Expert14411308
GPQA Diamond91%—
SimpleQA Verified33.6%—

Multilingual DeepSeek V4 Flash leads

DeepSeek V4 Flash: 53.0 (#72), Olmo 3.1 32b Instruct: 42.6 (#191)

BenchmarkDeepSeek V4 FlashOlmo 3.1 32b Instruct
LMArena Non-English14201275
LMArena Chinese14681304
LMArena French14391328
LMArena German14181282
LMArena Korean13841206
LMArena Russian14281268
LMArena Spanish14361336
LMArena Japanese1406—

Instruction Following DeepSeek V4 Flash leads

DeepSeek V4 Flash: 74.9 (#81), Olmo 3.1 32b Instruct: 68.6 (#187)

BenchmarkDeepSeek V4 FlashOlmo 3.1 32b Instruct
LMArena Instruction Following14211299

Long Context DeepSeek V4 Flash leads

DeepSeek V4 Flash: 43.8 (#85), Olmo 3.1 32b Instruct: 39.9 (#166)

BenchmarkDeepSeek V4 FlashOlmo 3.1 32b Instruct
LMArena Longer Query14341312

Writing & Preference DeepSeek V4 Flash leads

DeepSeek V4 Flash: 63.8 (#61), Olmo 3.1 32b Instruct: 50.2 (#185)

BenchmarkDeepSeek V4 FlashOlmo 3.1 32b Instruct
LMArena Text14321311
LMArena Creative Writing14031264
LMArena Multi-Turn14491309
EQ-Bench Creative Writing1559—

Frequently asked questions

Is DeepSeek V4 Flash better than Olmo 3.1 32b Instruct?

DeepSeek V4 Flash is the stronger model overall, scoring 53.6 to 39.4 on the Noometry Index.

Is DeepSeek V4 Flash or Olmo 3.1 32b Instruct better for coding?

DeepSeek V4 Flash scores higher on coding benchmarks: 47.9 versus 39.5 in the Noometry coding category.

How many benchmarks do DeepSeek V4 Flash and Olmo 3.1 32b Instruct share?

16 benchmarks have published results for both models. DeepSeek V4 Flash has 41 scored results on Noometry and Olmo 3.1 32b Instruct has 16.

Related comparisons

Go deeper