Model comparison

DeepSeek-V2.5 (Sep 2024) vs Granite 4.0 Micro

DeepSeek-V2.5 (Sep 2024) is the stronger model overall, scoring 37.6 to 29.0 on the Noometry Index.

Last verified . 0 shared benchmarks.

DeepSeek-V2.5 (Sep 2024) DeepSeek

37.6

Rank #200 Confirmed

Granite 4.0 Micro IBM

29.0

Rank #318 Confirmed

Summary

  • The widest gap is in knowledge, where DeepSeek-V2.5 (Sep 2024) leads 34.8 to 9.9.

Side by side

DeepSeek-V2.5 (Sep 2024) and Granite 4.0 Micro specifications
DeepSeek-V2.5 (Sep 2024)Granite 4.0 Micro
ProviderDeepSeekIBM
Noometry Index37.629.0
Released2024-09-062025-10-02
WeightsOpenOpen
Context window—131K
Max output—118K
Input $ / M tokens—$0.017
Output $ / M tokens—$0.11
Results tracked228

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

DeepSeek-V2.5 (Sep 2024): 31.7 (#281), Granite 4.0 Micro: —

Coding benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Granite 4.0 Micro
Aider Polyglot17.8%—
BigCodeBench Instruct48.6%—
LMArena Coding1309—
BigCodeBench Complete53.2%—
HumanEval+83.5%—
MBPP+74.1%—

Reasoning DeepSeek-V2.5 (Sep 2024) leads

DeepSeek-V2.5 (Sep 2024): 25.6 (#145), Granite 4.0 Micro: 19.2 (#265)

Reasoning benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Granite 4.0 Micro
Chess Puzzles—0%
LMArena Hard Prompts1289—

Math DeepSeek-V2.5 (Sep 2024) leads

DeepSeek-V2.5 (Sep 2024): 35.9 (#177), Granite 4.0 Micro: 12.0 (#307)

Math benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Granite 4.0 Micro
OTIS Mock AIME 2024-2025—2.8%
Omni-MATH—20.9%
LMArena Math1288—

Knowledge DeepSeek-V2.5 (Sep 2024) leads

DeepSeek-V2.5 (Sep 2024): 34.8 (#193), Granite 4.0 Micro: 9.9 (#304)

Knowledge benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Granite 4.0 Micro
GPQA Diamond—28.3%
MMLU-Pro—39.5%
GPQA (HELM)—30.7%
LMArena Expert1266—

Multilingual Not comparable

DeepSeek-V2.5 (Sep 2024): 42.5 (#193), Granite 4.0 Micro: —

Multilingual benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Granite 4.0 Micro
LMArena Non-English1273—
LMArena Chinese1318—
LMArena French1289—
LMArena German1258—
LMArena Japanese1228—
LMArena Korean1209—
LMArena Russian1289—
LMArena Spanish1248—

Instruction Following Granite 4.0 Micro leads

DeepSeek-V2.5 (Sep 2024): 67.5 (#194), Granite 4.0 Micro: 69.9 (#169)

Instruction Following benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Granite 4.0 Micro
IFEval—84.9%
LMArena Instruction Following1280—

Long Context Not comparable

DeepSeek-V2.5 (Sep 2024): 39.5 (#174), Granite 4.0 Micro: —

Long Context benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Granite 4.0 Micro
LMArena Longer Query1301—

Writing & Preference DeepSeek-V2.5 (Sep 2024) leads

DeepSeek-V2.5 (Sep 2024): 49.8 (#187), Granite 4.0 Micro: 46.7 (#216)

Writing & Preference benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Granite 4.0 Micro
LMArena Text1294—
LMArena Creative Writing1285—
WildBench—67%
LMArena Multi-Turn1297—

Frequently asked questions

Is DeepSeek-V2.5 (Sep 2024) better than Granite 4.0 Micro?

DeepSeek-V2.5 (Sep 2024) is the stronger model overall, scoring 37.6 to 29.0 on the Noometry Index.

How many benchmarks do DeepSeek-V2.5 (Sep 2024) and Granite 4.0 Micro share?

0 benchmarks have published results for both models. DeepSeek-V2.5 (Sep 2024) has 22 scored results on Noometry and Granite 4.0 Micro has 8.

Related comparisons

Go deeper