Model comparison

Claude 2 vs Seed 2.0 Pro

Seed 2.0 Pro is the stronger model overall, scoring 43.2 to 25.0 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 2 Anthropic

25.0

Rank #346 Reported

Seed 2.0 Pro ByteDance Seed

43.2

Rank #96 Confirmed

Summary

  • The widest gap is in math, where Seed 2.0 Pro leads 39.3 to 9.3.

Side by side

Claude 2 and Seed 2.0 Pro specifications
Claude 2Seed 2.0 Pro
ProviderAnthropicByteDance Seed
Noometry Index25.043.2
Released2023-07-112026-02-14
WeightsProprietaryProprietary
Context window—256K
Max output—128K
Input $ / M tokens—$0.50
Output $ / M tokens—$3
Results tracked820

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 2: —, Seed 2.0 Pro: 43.5 (#86)

Coding benchmarks
BenchmarkClaude 2Seed 2.0 Pro
LMArena Coding—1472
HumanEval+61.6%—

Reasoning Seed 2.0 Pro leads

Claude 2: 21.7 (#216), Seed 2.0 Pro: 24.1 (#165)

Reasoning benchmarks
BenchmarkClaude 2Seed 2.0 Pro
NYT Connections (extended)—28.4%
Thematic Generalization—57.1%
LMArena Hard Prompts—1453
DTBench51.9%—
Epoch Capabilities Index120.13—

Math Seed 2.0 Pro leads

Claude 2: 9.3 (#320), Seed 2.0 Pro: 39.3 (#108)

Math benchmarks
BenchmarkClaude 2Seed 2.0 Pro
OTIS Mock AIME 2024-20252.5%—
LMArena Math—1439
MATH Level 511.7%—

Knowledge Seed 2.0 Pro leads

Claude 2: 16.9 (#287), Seed 2.0 Pro: 40.2 (#122)

Knowledge benchmarks
BenchmarkClaude 2Seed 2.0 Pro
GPQA Diamond34.7%—
LMArena Expert—1440
MMLU78.5%—
TriviaQA87.5%—

Multimodal Not comparable

Claude 2: —, Seed 2.0 Pro: 41.5 (#35)

Multimodal benchmarks
BenchmarkClaude 2Seed 2.0 Pro
LMArena Vision—1274

Multilingual Not comparable

Claude 2: —, Seed 2.0 Pro: 54.5 (#39)

Multilingual benchmarks
BenchmarkClaude 2Seed 2.0 Pro
LMArena Non-English—1441
LMArena Chinese—1489
LMArena French—1471
LMArena German—1442
LMArena Japanese—1408
LMArena Korean—1411
LMArena Russian—1449
LMArena Spanish—1460

Instruction Following Not comparable

Claude 2: —, Seed 2.0 Pro: 74.5 (#91)

Instruction Following benchmarks
BenchmarkClaude 2Seed 2.0 Pro
LMArena Instruction Following—1414

Long Context Not comparable

Claude 2: —, Seed 2.0 Pro: 43.6 (#90)

Long Context benchmarks
BenchmarkClaude 2Seed 2.0 Pro
LMArena Longer Query—1428

Writing & Preference Not comparable

Claude 2: —, Seed 2.0 Pro: 62.9 (#69)

Writing & Preference benchmarks
BenchmarkClaude 2Seed 2.0 Pro
LMArena Text—1448
LMArena Creative Writing—1406
LMArena Multi-Turn—1441

Frequently asked questions

Is Claude 2 better than Seed 2.0 Pro?

Seed 2.0 Pro is the stronger model overall, scoring 43.2 to 25.0 on the Noometry Index.

How many benchmarks do Claude 2 and Seed 2.0 Pro share?

0 benchmarks have published results for both models. Claude 2 has 8 scored results on Noometry and Seed 2.0 Pro has 20.

Related comparisons

Go deeper