Model comparison

DeepSeek LLM 67B vs Gemma 3n E4b IT

Gemma 3n E4b IT is the stronger model overall, scoring 37.3 to 24.9 on the Noometry Index.

Last verified . 10 shared benchmarks.

DeepSeek LLM 67B DeepSeek

24.9

Rank #347 Confirmed

Gemma 3n E4b IT Google

37.3

Rank #206 Confirmed

Summary

  • They share 10 benchmarks with published results for both. DeepSeek LLM 67B scores higher in 0 categories and Gemma 3n E4b IT in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemma 3n E4b IT leads 34.2 to 7.0.

Side by side

DeepSeek LLM 67B and Gemma 3n E4b IT specifications
DeepSeek LLM 67BGemma 3n E4b IT
ProviderDeepSeekGoogle
Noometry Index24.937.3
Released2023-11-29—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1518

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemma 3n E4b IT leads

DeepSeek LLM 67B: 31.9 (#278), Gemma 3n E4b IT: 37.0 (#198)

Coding benchmarks
BenchmarkDeepSeek LLM 67BGemma 3n E4b IT
LMArena Coding10961268

Reasoning Gemma 3n E4b IT leads

DeepSeek LLM 67B: 16.5 (#304), Gemma 3n E4b IT: 19.9 (#247)

Reasoning benchmarks
BenchmarkDeepSeek LLM 67BGemma 3n E4b IT
LMArena Hard Prompts10701284
Kagi LLM Benchmark—31.5%
Chess Puzzles0%—
Epoch Capabilities Index110.5—

Math Gemma 3n E4b IT leads

DeepSeek LLM 67B: 8.7 (#324), Gemma 3n E4b IT: 35.1 (#188)

Math benchmarks
BenchmarkDeepSeek LLM 67BGemma 3n E4b IT
LMArena Math11081251
OTIS Mock AIME 2024-20250.8%—
MATH Level 56.4%—

Knowledge Gemma 3n E4b IT leads

DeepSeek LLM 67B: 7.0 (#313), Gemma 3n E4b IT: 34.2 (#198)

Knowledge benchmarks
BenchmarkDeepSeek LLM 67BGemma 3n E4b IT
GPQA Diamond24.6%—
LMArena Expert—1246

Multilingual Gemma 3n E4b IT leads

DeepSeek LLM 67B: 29.4 (#267), Gemma 3n E4b IT: 43.4 (#183)

Multilingual benchmarks
BenchmarkDeepSeek LLM 67BGemma 3n E4b IT
LMArena Non-English10731285
LMArena Chinese11321309
LMArena French—1330
LMArena German—1311
LMArena Japanese—1272
LMArena Korean—1259
LMArena Russian—1288
LMArena Spanish—1305

Instruction Following Gemma 3n E4b IT leads

DeepSeek LLM 67B: 55.4 (#277), Gemma 3n E4b IT: 66.1 (#210)

Instruction Following benchmarks
BenchmarkDeepSeek LLM 67BGemma 3n E4b IT
LMArena Instruction Following10791255

Long Context Gemma 3n E4b IT leads

DeepSeek LLM 67B: 33.1 (#265), Gemma 3n E4b IT: 38.7 (#191)

Long Context benchmarks
BenchmarkDeepSeek LLM 67BGemma 3n E4b IT
LMArena Longer Query10921276

Writing & Preference Gemma 3n E4b IT leads

DeepSeek LLM 67B: 31.6 (#282), Gemma 3n E4b IT: 50.1 (#186)

Writing & Preference benchmarks
BenchmarkDeepSeek LLM 67BGemma 3n E4b IT
LMArena Text11051306
LMArena Creative Writing10671287
LMArena Multi-Turn10821276

Frequently asked questions

Is DeepSeek LLM 67B better than Gemma 3n E4b IT?

Gemma 3n E4b IT is the stronger model overall, scoring 37.3 to 24.9 on the Noometry Index.

Is DeepSeek LLM 67B or Gemma 3n E4b IT better for coding?

Gemma 3n E4b IT scores higher on coding benchmarks: 37.0 versus 31.9 in the Noometry coding category.

How many benchmarks do DeepSeek LLM 67B and Gemma 3n E4b IT share?

10 benchmarks have published results for both models. DeepSeek LLM 67B has 15 scored results on Noometry and Gemma 3n E4b IT has 18.

Related comparisons

Go deeper