Model comparison

Granite 3.0 2b Instruct vs OLMo 2 Furious 13B

Granite 3.0 2b Instruct and OLMo 2 Furious 13B score almost the same on the Noometry Index (30.2 vs 29.2), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Granite 3.0 2b Instruct IBM

30.2

Rank #284 Confirmed

Summary

  • The widest gap is in writing & preference, where OLMo 2 Furious 13B leads 43.0 to 29.8.

Side by side

Granite 3.0 2b Instruct and OLMo 2 Furious 13B specifications
Granite 3.0 2b InstructOLMo 2 Furious 13B
ProviderIBMAllen Institute for AI (Ai2)
Noometry Index30.229.2
Released—2024-12-31
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1312

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Granite 3.0 2b Instruct: 27.8 (#311), OLMo 2 Furious 13B: 28.1 (#309)

Coding benchmarks
BenchmarkGranite 3.0 2b InstructOLMo 2 Furious 13B
BigCodeBench Instruct20.5%—
LiveBench Coding—10.4%
LMArena Coding1090—

Reasoning Granite 3.0 2b Instruct leads

Granite 3.0 2b Instruct: 19.6 (#234), OLMo 2 Furious 13B: 14.8 (#312)

Reasoning benchmarks
BenchmarkGranite 3.0 2b InstructOLMo 2 Furious 13B
LiveBench Reasoning—16.3%
LMArena Hard Prompts1073—
LiveBench Data Analysis—20.6%
LiveBench—22.1%

Math Granite 3.0 2b Instruct leads

Granite 3.0 2b Instruct: 29.7 (#215), OLMo 2 Furious 13B: 21.3 (#270)

Math benchmarks
BenchmarkGranite 3.0 2b InstructOLMo 2 Furious 13B
Omni-MATH—15.6%
LiveBench Math—13.6%
LMArena Math1117—

Knowledge Granite 3.0 2b Instruct leads

Granite 3.0 2b Instruct: 28.4 (#238), OLMo 2 Furious 13B: 18.0 (#278)

Knowledge benchmarks
BenchmarkGranite 3.0 2b InstructOLMo 2 Furious 13B
MMLU-Pro—31%
GPQA (HELM)—31.6%
LMArena Expert1064—

Multilingual Not comparable

Granite 3.0 2b Instruct: 27.1 (#273), OLMo 2 Furious 13B: —

Multilingual benchmarks
BenchmarkGranite 3.0 2b InstructOLMo 2 Furious 13B
LMArena Non-English1033—
LMArena Chinese1070—
LMArena Russian1045—

Instruction Following OLMo 2 Furious 13B leads

Granite 3.0 2b Instruct: 54.2 (#279), OLMo 2 Furious 13B: 61.1 (#243)

Instruction Following benchmarks
BenchmarkGranite 3.0 2b InstructOLMo 2 Furious 13B
LiveBench Instruction Following—60.6%
IFEval—73%
LMArena Instruction Following1056—

Long Context Not comparable

Granite 3.0 2b Instruct: 32.5 (#263), OLMo 2 Furious 13B: —

Long Context benchmarks
BenchmarkGranite 3.0 2b InstructOLMo 2 Furious 13B
LMArena Longer Query1071—

Writing & Preference OLMo 2 Furious 13B leads

Granite 3.0 2b Instruct: 29.8 (#287), OLMo 2 Furious 13B: 43.0 (#226)

Writing & Preference benchmarks
BenchmarkGranite 3.0 2b InstructOLMo 2 Furious 13B
LMArena Text1080—
LMArena Creative Writing1046—
WildBench—68.9%
LMArena Multi-Turn1053—
LiveBench Language—11.2%

Frequently asked questions

Is Granite 3.0 2b Instruct better than OLMo 2 Furious 13B?

Granite 3.0 2b Instruct and OLMo 2 Furious 13B score almost the same on the Noometry Index (30.2 vs 29.2), so choose on price, context window or the category you care about most.

Is Granite 3.0 2b Instruct or OLMo 2 Furious 13B better for coding?

They score almost the same on coding (27.8 vs 28.1); test both on your own repository before choosing.

How many benchmarks do Granite 3.0 2b Instruct and OLMo 2 Furious 13B share?

0 benchmarks have published results for both models. Granite 3.0 2b Instruct has 13 scored results on Noometry and OLMo 2 Furious 13B has 12.

Related comparisons

Go deeper