Noometry

Model comparison

DeepSeek V4.1 Flash vs Gemma 2 27B

DeepSeek V4.1 Flash is the stronger model overall, scoring 52.8 to 29.4 on the Noometry Index.

Last verified . 22 shared benchmarks.

DeepSeek V4.1 Flash DeepSeek

52.8

Rank #38 Confirmed

Gemma 2 27B Google

29.4

Rank #312 Confirmed

Summary

  • They share 22 benchmarks with published results for both. DeepSeek V4.1 Flash scores higher in 8 categories and Gemma 2 27B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where DeepSeek V4.1 Flash leads 66.7 to 10.7.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 98.3% for DeepSeek V4.1 Flash and 1.4% for Gemma 2 27B.
  • DeepSeek V4.1 Flash is cheaper at $0.15 / $0.60 per million input/output tokens, against $0.65 / $0.65 for Gemma 2 27B.
  • DeepSeek V4.1 Flash accepts more context: 1M tokens versus 8K.

Side by side

DeepSeek V4.1 FlashGemma 2 27B
ProviderDeepSeekGoogle
Noometry Index52.829.4
Released2026-09-092024-06-24
WeightsOpenOpen
Context window1M8K
Max output393K2K
Input $ / M tokens$0.15$0.65
Output $ / M tokens$0.60$0.65
Results tracked3734

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 52.9 (#32), Gemma 2 27B: 34.1 (#246)

BenchmarkDeepSeek V4.1 FlashGemma 2 27B
LMArena Coding15061211
LMArena WebDev1619—
SciCode51.9%—
BigCodeBench Instruct—42.8%
LiveBench Coding—36%
BigCodeBench Complete—52.5%
ALE-Bench1,092—

Agentic & Tool Use Not comparable

DeepSeek V4.1 Flash: 31.2 (#69), Gemma 2 27B: —

BenchmarkDeepSeek V4.1 FlashGemma 2 27B
APEX-Agents39.5%—
GDP.pdf19.8%—

Reasoning DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 50.2 (#36), Gemma 2 27B: 15.3 (#315)

BenchmarkDeepSeek V4.1 FlashGemma 2 27B
LMArena Hard Prompts14831198
DTBench89.9%48%
LMCA47%7.1%
Epoch Capabilities Index154.9122.08
NYT Connections (extended)89.6%—
CritPt14.3%—
LiveBench Reasoning—28.1%
Mystery Game Puzzles43%—
LiveBench Data Analysis—47.9%
Surface Evolver Bench46.3%—
LiveBench—38.2%

Math DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 66.7 (#25), Gemma 2 27B: 10.7 (#311)

BenchmarkDeepSeek V4.1 FlashGemma 2 27B
OTIS Mock AIME 2024-202598.3%1.4%
LMArena Math14771212
FrontierMath (Tiers 1-3)67.4%—
FrontierMath Tier 426.8%—
ProofBench54%—
LiveBench Math—26.5%
MATH Level 5—27.9%

Knowledge DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 57.9 (#38), Gemma 2 27B: 19.0 (#280)

BenchmarkDeepSeek V4.1 FlashGemma 2 27B
GPQA Diamond89.8%36.5%
LMArena Expert15061172
Confabulations—27.1%
MMLU—75.7%

Multimodal Not comparable

DeepSeek V4.1 Flash: 39.1 (#61), Gemma 2 27B: —

BenchmarkDeepSeek V4.1 FlashGemma 2 27B
LMArena Vision1277—
Furniture Assembly34.2%—

Multilingual DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 55.0 (#35), Gemma 2 27B: 38.6 (#226)

BenchmarkDeepSeek V4.1 FlashGemma 2 27B
LMArena Non-English14481217
LMArena Chinese14971221
LMArena French14521247
LMArena German14841209
LMArena Japanese14121175
LMArena Korean14521174
LMArena Russian14711234
LMArena Spanish14591228

Instruction Following DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 77.3 (#26), Gemma 2 27B: 60.5 (#249)

BenchmarkDeepSeek V4.1 FlashGemma 2 27B
LMArena Instruction Following14741206
LiveBench Instruction Following—58.1%

Long Context DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 45.2 (#47), Gemma 2 27B: 37.3 (#218)

BenchmarkDeepSeek V4.1 FlashGemma 2 27B
LMArena Longer Query14751231

Writing & Preference DeepSeek V4.1 Flash leads

DeepSeek V4.1 Flash: 65.4 (#48), Gemma 2 27B: 44.2 (#225)

BenchmarkDeepSeek V4.1 FlashGemma 2 27B
LMArena Text14621231
LMArena Creative Writing14351241
LMArena Multi-Turn14571224
EQ-Bench Creative Writing1540—
LiveBench Language—32.6%

Frequently asked questions

Is DeepSeek V4.1 Flash better than Gemma 2 27B?

DeepSeek V4.1 Flash is the stronger model overall, scoring 52.8 to 29.4 on the Noometry Index.

Which is cheaper, DeepSeek V4.1 Flash or Gemma 2 27B?

DeepSeek V4.1 Flash is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; Gemma 2 27B lists at $0.65 and $0.65.

Is DeepSeek V4.1 Flash or Gemma 2 27B better for coding?

DeepSeek V4.1 Flash scores higher on coding benchmarks: 52.9 versus 34.1 in the Noometry coding category.

Which has the bigger context window?

DeepSeek V4.1 Flash does, with 1M tokens against 8K.

How many benchmarks do DeepSeek V4.1 Flash and Gemma 2 27B share?

22 benchmarks have published results for both models. DeepSeek V4.1 Flash has 37 scored results on Noometry and Gemma 2 27B has 34.

Related comparisons

Go deeper