Model comparison

Claude 3.5 Sonnet vs Granite 4.2 30b

Granite 4.2 30b is the stronger model overall, scoring 41.4 to 34.4 on the Noometry Index.

Last verified . 11 shared benchmarks.

Claude 3.5 Sonnet Anthropic

34.4

Rank #225 Confirmed

Granite 4.2 30b IBM

41.4

Rank #126 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Claude 3.5 Sonnet scores higher in 0 categories and Granite 4.2 30b in 7 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Granite 4.2 30b leads 38.5 to 28.5.
  • Granite 4.2 30b has downloadable open weights; the other is API-only.

Side by side

Claude 3.5 Sonnet and Granite 4.2 30b specifications
Claude 3.5 SonnetGranite 4.2 30b
ProviderAnthropicIBM
Noometry Index34.441.4
Released2024-06-20—
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked6011

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Claude 3.5 Sonnet: 39.5 (#145), Granite 4.2 30b: 40.4 (#127)

Coding benchmarks
BenchmarkClaude 3.5 SonnetGranite 4.2 30b
LMArena Coding13431394
Aider Polyglot51.6%—
GSO4.6%—
WeirdML40%—
BigCodeBench Instruct46.8%—
LiveBench Coding67.1%—
BigCodeBench Complete58.6%—
CadEval48%—
HumanEval+81.7%—
MBPP+74.3%—

Agentic & Tool Use Not comparable

Claude 3.5 Sonnet: 32.1 (#61), Granite 4.2 30b: —

Agentic & Tool Use benchmarks
BenchmarkClaude 3.5 SonnetGranite 4.2 30b
TheAgentCompany24%—
Cybench17.5%—
BALROG32.6%—
METR Time Horizons45.2%—

Reasoning Granite 4.2 30b leads

Claude 3.5 Sonnet: 22.5 (#176), Granite 4.2 30b: 26.7 (#114)

Reasoning benchmarks
BenchmarkClaude 3.5 SonnetGranite 4.2 30b
LMArena Hard Prompts13051375
SimpleBench41.4%—
EnigmaEval0.9%—
LiveBench Reasoning56.7%—
DTBench67.8%—
LiveBench Data Analysis55%—
Epoch Capabilities Index133.55—
ForecastBench60.7—
LiveBench59%—

Math Not comparable

Claude 3.5 Sonnet: 18.0 (#282), Granite 4.2 30b: —

Math benchmarks
BenchmarkClaude 3.5 SonnetGranite 4.2 30b
OTIS Mock AIME 2024-20258.5%—
Omni-MATH27.6%—
LiveBench Math52.3%—
LMArena Math1306—
MATH Level 556.9%—
FrontierMath (Feb 2025 set)2.1%—
FrontierMath Tier 4 (v1)0%—

Knowledge Granite 4.2 30b leads

Claude 3.5 Sonnet: 28.5 (#236), Granite 4.2 30b: 38.5 (#134)

Knowledge benchmarks
BenchmarkClaude 3.5 SonnetGranite 4.2 30b
LMArena Expert12641405
GPQA Diamond55.3%—
Humanity's Last Exam4.1%—
MMLU-Pro77.7%—
Confabulations19.9%—
GPQA (HELM)56.5%—
MMLU87.3%—

Multimodal Not comparable

Claude 3.5 Sonnet: 26.0 (#115), Granite 4.2 30b: —

Multimodal benchmarks
BenchmarkClaude 3.5 SonnetGranite 4.2 30b
LMArena Vision1125—
Video-MME60%—
GeoBench62%—
VPCT33%—

Multilingual Granite 4.2 30b leads

Claude 3.5 Sonnet: 43.4 (#180), Granite 4.2 30b: 47.4 (#146)

Multilingual benchmarks
BenchmarkClaude 3.5 SonnetGranite 4.2 30b
LMArena Non-English12831340
LMArena Chinese12711415
LMArena Russian13051342
LMArena French1304—
LMArena German1297—
LMArena Japanese1234—
LMArena Korean1200—
LMArena Spanish1289—

Instruction Following Granite 4.2 30b leads

Claude 3.5 Sonnet: 69.0 (#177), Granite 4.2 30b: 71.3 (#150)

Instruction Following benchmarks
BenchmarkClaude 3.5 SonnetGranite 4.2 30b
LMArena Instruction Following12971346
LiveBench Instruction Following69.3%—
IFEval85.5%—

Long Context Granite 4.2 30b leads

Claude 3.5 Sonnet: 39.9 (#162), Granite 4.2 30b: 41.4 (#135)

Long Context benchmarks
BenchmarkClaude 3.5 SonnetGranite 4.2 30b
LMArena Longer Query13111359

Writing & Preference Granite 4.2 30b leads

Claude 3.5 Sonnet: 53.0 (#159), Granite 4.2 30b: 54.3 (#147)

Writing & Preference benchmarks
BenchmarkClaude 3.5 SonnetGranite 4.2 30b
LMArena Text12981363
LMArena Creative Writing12921294
LMArena Multi-Turn13261340
Short-Story Creative Writing80.3%—
EQ-Bench Creative Writing1451—
WildBench79.2%—
LiveBench Language53.8%—

Frequently asked questions

Is Claude 3.5 Sonnet better than Granite 4.2 30b?

Granite 4.2 30b is the stronger model overall, scoring 41.4 to 34.4 on the Noometry Index.

Is Claude 3.5 Sonnet or Granite 4.2 30b better for coding?

They score almost the same on coding (39.5 vs 40.4); test both on your own repository before choosing.

How many benchmarks do Claude 3.5 Sonnet and Granite 4.2 30b share?

11 benchmarks have published results for both models. Claude 3.5 Sonnet has 60 scored results on Noometry and Granite 4.2 30b has 11.

Related comparisons

Go deeper