Noometry

Model comparison

Claude Opus 5 vs Tulu 3 (Tülu 3) 70B

Claude Opus 5 is the stronger model overall, scoring 67.7 to 32.6 on the Noometry Index.

Last verified . 13 shared benchmarks.

Claude Opus 5 Anthropic

67.7

Rank #4 Confirmed

Tulu 3 (Tülu 3) 70B Allen Institute for AI (Ai2)

32.6

Rank #242 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Claude Opus 5 scores higher in 8 categories and Tulu 3 (Tülu 3) 70B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Opus 5 leads 86.1 to 13.3.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 98.9% for Claude Opus 5 and 4.4% for Tulu 3 (Tülu 3) 70B.
  • Tulu 3 (Tülu 3) 70B has downloadable open weights; the other is API-only.

Side by side

Claude Opus 5Tulu 3 (Tülu 3) 70B
ProviderAnthropicAllen Institute for AI (Ai2)
Noometry Index67.732.6
Released2026-07-242024-11-21
WeightsProprietaryOpen
Context window1M—
Max output128K—
Input $ / M tokens$5—
Output $ / M tokens$25—
Results tracked5714

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 5 leads

Claude Opus 5: 67.0 (#5), Tulu 3 (Tülu 3) 70B: 35.4 (#211)

BenchmarkClaude Opus 5Tulu 3 (Tülu 3) 70B
LMArena Coding15331236
DeepSWE73.6%—
FrontierCode53.4%—
CursorBench46.6%—
LMArena WebDev1694—
FrontierSWE52%—
SciCode56.4%—
WeirdML91.8%—
ALE-Bench2,165—

Agentic & Tool Use Not comparable

Claude Opus 5: 55.5 (#1), Tulu 3 (Tülu 3) 70B: —

BenchmarkClaude Opus 5Tulu 3 (Tülu 3) 70B
APEX-Agents65.8%—
OSWorld 2.031.4%—
τ²-bench Banking48.7%—
PostTrainBench35%—
BALROG63.4%—
GBAEval79.6%—
GDP.pdf24%—
Vending-Bench 211,182—

Reasoning Claude Opus 5 leads

Claude Opus 5: 77.1 (#3), Tulu 3 (Tülu 3) 70B: 22.9 (#172)

BenchmarkClaude Opus 5Tulu 3 (Tülu 3) 70B
LMArena Hard Prompts15251220
ARC-AGI-290.4%—
SimpleBench80.6%—
NYT Connections (extended)94.3%—
ARC-AGI-197.5%—
CritPt29.1%—
Chess Puzzles42%—
EBR-Bench45.7%—
Mystery Game Puzzles59%—
DTBench97.9%—
LMCA64.5%—
Bench to the Future 30.12—
Epoch Capabilities Index162.67—

Math Claude Opus 5 leads

Claude Opus 5: 86.1 (#6), Tulu 3 (Tülu 3) 70B: 13.3 (#297)

BenchmarkClaude Opus 5Tulu 3 (Tülu 3) 70B
OTIS Mock AIME 2024-202598.9%4.4%
LMArena Math15331242
FrontierMath (Tiers 1-3)85.6%—
FrontierMath Tier 473.2%—
ProofBench99%—
MATH Level 5—42.7%

Knowledge Claude Opus 5 leads

Claude Opus 5: 66.8 (#8), Tulu 3 (Tülu 3) 70B: 25.1 (#257)

BenchmarkClaude Opus 5Tulu 3 (Tülu 3) 70B
GPQA Diamond93.9%46.3%
SimpleQA Verified59.9%—
LMArena Expert1558—

Multimodal Not comparable

Claude Opus 5: 51.1 (#6), Tulu 3 (Tülu 3) 70B: —

BenchmarkClaude Opus 5Tulu 3 (Tülu 3) 70B
LMArena Vision1321—
Blueprint-Bench 230.4%—
Furniture Assembly60.8%—
LMArena Document1516—

Multilingual Claude Opus 5 leads

Claude Opus 5: 58.8 (#3), Tulu 3 (Tülu 3) 70B: 40.1 (#217)

BenchmarkClaude Opus 5Tulu 3 (Tülu 3) 70B
LMArena Non-English15001236
LMArena Chinese15751249
LMArena Russian15071246
LMArena French1522—
LMArena German1522—
LMArena Japanese1510—
LMArena Korean1526—
LMArena Spanish1519—

Instruction Following Claude Opus 5 leads

Claude Opus 5: 79.3 (#5), Tulu 3 (Tülu 3) 70B: 65.0 (#222)

BenchmarkClaude Opus 5Tulu 3 (Tülu 3) 70B
LMArena Instruction Following15161233

Long Context Claude Opus 5 leads

Claude Opus 5: 46.5 (#20), Tulu 3 (Tülu 3) 70B: 37.1 (#217)

BenchmarkClaude Opus 5Tulu 3 (Tülu 3) 70B
LMArena Longer Query15161224

Writing & Preference Claude Opus 5 leads

Claude Opus 5: 79.3 (#2), Tulu 3 (Tülu 3) 70B: 45.8 (#218)

BenchmarkClaude Opus 5Tulu 3 (Tülu 3) 70B
LMArena Text15061256
LMArena Creative Writing14911231
LMArena Multi-Turn14961252
EQ-Bench Creative Writing2133—
EQ-Bench 41385—

Frequently asked questions

Is Claude Opus 5 better than Tulu 3 (Tülu 3) 70B?

Claude Opus 5 is the stronger model overall, scoring 67.7 to 32.6 on the Noometry Index.

Is Claude Opus 5 or Tulu 3 (Tülu 3) 70B better for coding?

Claude Opus 5 scores higher on coding benchmarks: 67.0 versus 35.4 in the Noometry coding category.

How many benchmarks do Claude Opus 5 and Tulu 3 (Tülu 3) 70B share?

13 benchmarks have published results for both models. Claude Opus 5 has 57 scored results on Noometry and Tulu 3 (Tülu 3) 70B has 14.

Related comparisons

Go deeper