Model comparison

Claude 3.5 Sonnet vs Laguna M.1

Claude 3.5 Sonnet is the stronger model overall, scoring 34.4 to 31.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 3.5 Sonnet Anthropic

34.4

Rank #225 Confirmed

Laguna M.1 Poolside

31.9

Rank #252 Reported

Summary

  • The widest gap is in coding, where Claude 3.5 Sonnet leads 39.5 to 36.4.
  • Laguna M.1 has downloadable open weights; the other is API-only.

Side by side

Claude 3.5 Sonnet and Laguna M.1 specifications
Claude 3.5 SonnetLaguna M.1
ProviderAnthropicPoolside
Noometry Index34.431.9
Released2024-06-202026-04-28
WeightsProprietaryOpen
Context window—262K
Max output—33K
Input $ / M tokens——
Output $ / M tokens——
Results tracked603

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude 3.5 Sonnet leads

Claude 3.5 Sonnet: 39.5 (#145), Laguna M.1: 36.4 (#195)

Coding benchmarks
BenchmarkClaude 3.5 SonnetLaguna M.1
Aider Polyglot51.6%—
LMArena WebDev—1348
GSO4.6%—
WeirdML40%—
BigCodeBench Instruct46.8%—
LiveBench Coding67.1%—
LMArena Coding1343—
BigCodeBench Complete58.6%—
CadEval48%—
HumanEval+81.7%—
MBPP+74.3%—

Agentic & Tool Use Not comparable

Claude 3.5 Sonnet: 32.1 (#61), Laguna M.1: —

Agentic & Tool Use benchmarks
BenchmarkClaude 3.5 SonnetLaguna M.1
TheAgentCompany24%—
Cybench17.5%—
BALROG32.6%—
METR Time Horizons45.2%—

Reasoning Too close to call

Claude 3.5 Sonnet: 22.5 (#176), Laguna M.1: 21.9 (#187)

Reasoning benchmarks
BenchmarkClaude 3.5 SonnetLaguna M.1
SimpleBench41.4%—
EnigmaEval0.9%—
LiveBench Reasoning56.7%—
LMArena Hard Prompts1305—
DTBench67.8%—
LiveBench Data Analysis55%—
Surface Evolver Bench—15.6%
Epoch Capabilities Index133.55—
ForecastBench60.7—
LiveBench59%—

Math Laguna M.1 leads

Claude 3.5 Sonnet: 18.0 (#282), Laguna M.1: 20.3 (#276)

Math benchmarks
BenchmarkClaude 3.5 SonnetLaguna M.1
OTIS Mock AIME 2024-20258.5%—
ProofBench—0%
Omni-MATH27.6%—
LiveBench Math52.3%—
LMArena Math1306—
MATH Level 556.9%—
FrontierMath (Feb 2025 set)2.1%—
FrontierMath Tier 4 (v1)0%—

Knowledge Not comparable

Claude 3.5 Sonnet: 28.5 (#236), Laguna M.1: —

Knowledge benchmarks
BenchmarkClaude 3.5 SonnetLaguna M.1
GPQA Diamond55.3%—
Humanity's Last Exam4.1%—
MMLU-Pro77.7%—
Confabulations19.9%—
GPQA (HELM)56.5%—
LMArena Expert1264—
MMLU87.3%—

Multimodal Not comparable

Claude 3.5 Sonnet: 26.0 (#115), Laguna M.1: —

Multimodal benchmarks
BenchmarkClaude 3.5 SonnetLaguna M.1
LMArena Vision1125—
Video-MME60%—
GeoBench62%—
VPCT33%—

Multilingual Not comparable

Claude 3.5 Sonnet: 43.4 (#180), Laguna M.1: —

Multilingual benchmarks
BenchmarkClaude 3.5 SonnetLaguna M.1
LMArena Non-English1283—
LMArena Chinese1271—
LMArena French1304—
LMArena German1297—
LMArena Japanese1234—
LMArena Korean1200—
LMArena Russian1305—
LMArena Spanish1289—

Instruction Following Not comparable

Claude 3.5 Sonnet: 69.0 (#177), Laguna M.1: —

Instruction Following benchmarks
BenchmarkClaude 3.5 SonnetLaguna M.1
LiveBench Instruction Following69.3%—
IFEval85.5%—
LMArena Instruction Following1297—

Long Context Not comparable

Claude 3.5 Sonnet: 39.9 (#162), Laguna M.1: —

Long Context benchmarks
BenchmarkClaude 3.5 SonnetLaguna M.1
LMArena Longer Query1311—

Writing & Preference Not comparable

Claude 3.5 Sonnet: 53.0 (#159), Laguna M.1: —

Writing & Preference benchmarks
BenchmarkClaude 3.5 SonnetLaguna M.1
LMArena Text1298—
LMArena Creative Writing1292—
Short-Story Creative Writing80.3%—
EQ-Bench Creative Writing1451—
WildBench79.2%—
LMArena Multi-Turn1326—
LiveBench Language53.8%—

Frequently asked questions

Is Claude 3.5 Sonnet better than Laguna M.1?

Claude 3.5 Sonnet is the stronger model overall, scoring 34.4 to 31.9 on the Noometry Index.

Is Claude 3.5 Sonnet or Laguna M.1 better for coding?

Claude 3.5 Sonnet scores higher on coding benchmarks: 39.5 versus 36.4 in the Noometry coding category.

How many benchmarks do Claude 3.5 Sonnet and Laguna M.1 share?

0 benchmarks have published results for both models. Claude 3.5 Sonnet has 60 scored results on Noometry and Laguna M.1 has 3.

Related comparisons

Go deeper