Model comparison

Claude Opus 4.7 vs Yi-34B

Claude Opus 4.7 is the stronger model overall, scoring 58.3 to 27.8 on the Noometry Index.

Last verified . 19 shared benchmarks.

Claude Opus 4.7 Anthropic

58.3

Rank #19 Confirmed

Yi-34B 01.AI

27.8

Rank #329 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Claude Opus 4.7 scores higher in 8 categories and Yi-34B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Claude Opus 4.7 leads 62.6 to 7.5.
  • The biggest single-benchmark swing is GPQA Diamond: 90.2% for Claude Opus 4.7 and 14.7% for Yi-34B.
  • Yi-34B has downloadable open weights; the other is API-only.

Side by side

Claude Opus 4.7 and Yi-34B specifications
Claude Opus 4.7Yi-34B
ProviderAnthropic01.AI
Noometry Index58.327.8
Released2026-04-142023-11-02
WeightsProprietaryOpen
Context window1M—
Max output128K—
Input $ / M tokens$5—
Output $ / M tokens$25—
Results tracked6623

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4.7 leads

Claude Opus 4.7: 59.6 (#13), Yi-34B: 32.3 (#274)

Coding benchmarks
BenchmarkClaude Opus 4.7Yi-34B
LMArena Coding15181112
SWE-bench Verified83.5%—
FrontierCode38.5%—
LMArena WebDev1558—
SciCode54.5%—
GSO44.1%—
WeirdML76.4%—
MirrorCode31.1%—
ALE-Bench1,323—

Agentic & Tool Use Not comparable

Claude Opus 4.7: 47.9 (#10), Yi-34B: —

Agentic & Tool Use benchmarks
BenchmarkClaude Opus 4.7Yi-34B
Terminal-Bench80.2%—
APEX-Agents49.2%—
OSWorld 2.018.2%—
τ²-bench Banking40.2%—
PostTrainBench28.6%—
ExploitBench26.5%—
GBAEval43.8%—
GDP.pdf21%—
LMArena Search1233—
Vending-Bench 210,937—

Reasoning Claude Opus 4.7 leads

Claude Opus 4.7: 53.8 (#29), Yi-34B: 21.2 (#226)

Reasoning benchmarks
BenchmarkClaude Opus 4.7Yi-34B
LMArena Hard Prompts15061104
Epoch Capabilities Index156.25117.39
ARC-AGI-275.8%—
SimpleBench61.7%—
Kagi LLM Benchmark80.7%—
NYT Connections (extended)39%—
ARC-AGI-193.5%—
CritPt12%—
Chess Puzzles30%—
Thematic Generalization72.8%—
EBR-Bench19%—
Mystery Game Puzzles28%—
DTBench94.7%—
LMCA52.2%—
BIG-Bench Hard—71.7%
ForecastBench60.3—

Math Claude Opus 4.7 leads

Claude Opus 4.7: 66.7 (#26), Yi-34B: 21.6 (#282)

Knowledge Claude Opus 4.7 leads

Claude Opus 4.7: 62.6 (#23), Yi-34B: 7.5 (#309)

Knowledge benchmarks
BenchmarkClaude Opus 4.7Yi-34B
GPQA Diamond90.2%14.7%
LMArena Expert15211061
Humanity's Last Exam36.2%—
SimpleQA Verified51.7%—
Vectara Hallucination Rate12%—
MMLU—76.3%

Multimodal Not comparable

Claude Opus 4.7: 41.2 (#38), Yi-34B: —

Multimodal benchmarks
BenchmarkClaude Opus 4.7Yi-34B
LMArena Vision1316—
Blueprint-Bench 224.5%—
Furniture Assembly33.3%—
LMArena Document1495—

Multilingual Claude Opus 4.7 leads

Claude Opus 4.7: 57.3 (#10), Yi-34B: 29.7 (#264)

Multilingual benchmarks
BenchmarkClaude Opus 4.7Yi-34B
LMArena Non-English14801079
LMArena Chinese15311176
LMArena French15031081
LMArena German14951042
LMArena Japanese1472993
LMArena Korean1464959
LMArena Russian14941050
LMArena Spanish14951070

Instruction Following Claude Opus 4.7 leads

Claude Opus 4.7: 78.4 (#10), Yi-34B: 56.2 (#274)

Instruction Following benchmarks
BenchmarkClaude Opus 4.7Yi-34B
LMArena Instruction Following14981091

Long Context Claude Opus 4.7 leads

Claude Opus 4.7: 46.2 (#25), Yi-34B: 33.2 (#264)

Long Context benchmarks
BenchmarkClaude Opus 4.7Yi-34B
LMArena Longer Query15051094

Writing & Preference Claude Opus 4.7 leads

Claude Opus 4.7: 75.1 (#8), Yi-34B: 34.1 (#273)

Writing & Preference benchmarks
BenchmarkClaude Opus 4.7Yi-34B
LMArena Text14901129
LMArena Creative Writing14861108
LMArena Multi-Turn15051113
EQ-Bench Creative Writing1914—
EQ-Bench 41311—

Frequently asked questions

Is Claude Opus 4.7 better than Yi-34B?

Claude Opus 4.7 is the stronger model overall, scoring 58.3 to 27.8 on the Noometry Index.

Is Claude Opus 4.7 or Yi-34B better for coding?

Claude Opus 4.7 scores higher on coding benchmarks: 59.6 versus 32.3 in the Noometry coding category.

How many benchmarks do Claude Opus 4.7 and Yi-34B share?

19 benchmarks have published results for both models. Claude Opus 4.7 has 66 scored results on Noometry and Yi-34B has 23.

Related comparisons

Go deeper