Noometry

Model comparison

DeepSeek V4.1 Flash vs GPT-5.4 mini

DeepSeek V4.1 Flash is the stronger model overall, scoring 52.8 to 45.0 on the Noometry Index.

Last verified . 33 shared benchmarks.

DeepSeek V4.1 Flash DeepSeek

52.8

Rank #38 Confirmed

GPT-5.4 mini OpenAI

45.0

Rank #76 Confirmed

Summary

  • They share 33 benchmarks with published results for both. DeepSeek V4.1 Flash scores higher in 9 categories and GPT-5.4 mini in 1 category; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where DeepSeek V4.1 Flash leads 66.7 to 45.5.
  • The biggest single-benchmark swing is ProofBench: 54% for DeepSeek V4.1 Flash and 21% for GPT-5.4 mini.
  • DeepSeek V4.1 Flash is cheaper at $0.15 / $0.60 per million input/output tokens, against $0.75 / $4.50 for GPT-5.4 mini.
  • DeepSeek V4.1 Flash accepts more context: 1M tokens versus 400K.
  • DeepSeek V4.1 Flash has downloadable open weights; the other is API-only.

Side by side

DeepSeek V4.1 FlashGPT-5.4 mini
ProviderDeepSeekOpenAI
Noometry Index52.845.0
Released2026-09-092026-03-17
WeightsOpenProprietary
Context window1M400K
Max output393K128K
Input $ / M tokens$0.15$0.75
Output $ / M tokens$0.60$4.50
Results tracked3746

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 52.9 (#32), GPT-5.4 mini: 45.2 (#72)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
LMArena WebDev16191397
SciCode51.9%49.9%
LMArena Coding15061438
ALE-Bench1,0921,189
FrontierCode—27%
WeirdML—60.3%

Agentic & Tool Use DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 31.2 (#69), GPT-5.4 mini: 29.9 (#81)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
APEX-Agents39.5%—
DeepResearch Bench—36.3%
GDP.pdf19.8%—

Reasoning DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 50.2 (#36), GPT-5.4 mini: 30.4 (#85)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
NYT Connections (extended)89.6%61.8%
CritPt14.3%10%
LMArena Hard Prompts14831424
Mystery Game Puzzles43%11%
DTBench89.9%80%
LMCA47%40.8%
Epoch Capabilities Index154.9148.84
ARC-AGI-2—18.9%
Kagi LLM Benchmark—37.9%
ARC-AGI-1—63.7%
Chess Puzzles—24%
Thematic Generalization—61.7%
Surface Evolver Bench46.3%—
ForecastBench—57

Math DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 66.7 (#25), GPT-5.4 mini: 45.5 (#75)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
FrontierMath (Tiers 1-3)67.4%51.2%
FrontierMath Tier 426.8%9.8%
OTIS Mock AIME 2024-202598.3%88.9%
ProofBench54%21%
LMArena Math14771419
FrontierMath (Feb 2025 set)—28.3%
FrontierMath Tier 4 (v1)—2.1%

Knowledge DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 57.9 (#38), GPT-5.4 mini: 51.5 (#67)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
GPQA Diamond89.8%86.9%
LMArena Expert15061435
SimpleQA Verified—29.4%
Vectara Hallucination Rate—5.5%

Multimodal Too close to call

DeepSeek V4.1 Flash: 39.1 (#61), GPT-5.4 mini: 39.7 (#56)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
LMArena Vision12771245
Furniture Assembly34.2%—

Multilingual DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 55.0 (#35), GPT-5.4 mini: 51.9 (#96)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
LMArena Non-English14481405
LMArena Chinese14971446
LMArena French14521440
LMArena German14841409
LMArena Japanese14121374
LMArena Korean14521368
LMArena Russian14711417
LMArena Spanish14591405

Instruction Following DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 77.3 (#26), GPT-5.4 mini: 74.1 (#102)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
LMArena Instruction Following14741405

Long Context DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 45.2 (#47), GPT-5.4 mini: 43.0 (#112)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
LMArena Longer Query14751407

Writing & Preference DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 65.4 (#48), GPT-5.4 mini: 64.0 (#58)

BenchmarkDeepSeek V4.1 FlashGPT-5.4 mini
LMArena Text14621412
LMArena Creative Writing14351370
EQ-Bench Creative Writing15401665
LMArena Multi-Turn14571429

Frequently asked questions

Is DeepSeek V4.1 Flash better than GPT-5.4 mini?

DeepSeek V4.1 Flash is the stronger model overall, scoring 52.8 to 45.0 on the Noometry Index.

Which is cheaper, DeepSeek V4.1 Flash or GPT-5.4 mini?

DeepSeek V4.1 Flash is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; GPT-5.4 mini lists at $0.75 and $4.50.

Is DeepSeek V4.1 Flash or GPT-5.4 mini better for coding?

DeepSeek V4.1 Flash scores higher on coding benchmarks: 52.9 versus 45.2 in the Noometry coding category.

Which has the bigger context window?

DeepSeek V4.1 Flash does, with 1M tokens against 400K.

How many benchmarks do DeepSeek V4.1 Flash and GPT-5.4 mini share?

33 benchmarks have published results for both models. DeepSeek V4.1 Flash has 37 scored results on Noometry and GPT-5.4 mini has 46.

Related comparisons

Go deeper