Noometry

Model comparison

Olmo 2 0325 32b Instruct vs Qwen3.7 Plus

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 32.7 on the Noometry Index.

Last verified . 11 shared benchmarks.

Olmo 2 0325 32b Instruct Allen Institute for AI (Ai2)

32.7

Rank #254 Confirmed

Qwen3.7 Plus Alibaba (Qwen)

45.3

Rank #72 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Olmo 2 0325 32b Instruct scores higher in 0 categories and Qwen3.7 Plus in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.7 Plus leads 54.9 to 19.5.
  • Olmo 2 0325 32b Instruct has downloadable open weights; the other is API-only.

Side by side

Olmo 2 0325 32b InstructQwen3.7 Plus
ProviderAllen Institute for AI (Ai2)Alibaba (Qwen)
Noometry Index32.745.3
Released—2026-06-02
WeightsOpenProprietary
Context window—1M
Max output—131K
Input $ / M tokens—$0.40
Output $ / M tokens—$1.60
Results tracked1632

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.7 Plus leads

Olmo 2 0325 32b Instruct: 35.2 (#227), Qwen3.7 Plus: 36.6 (#206)

BenchmarkOlmo 2 0325 32b InstructQwen3.7 Plus
LMArena Coding12101473
FrontierCode—10.2%
SciCode—45.5%

Agentic & Tool Use Not comparable

Olmo 2 0325 32b Instruct: —, Qwen3.7 Plus: 21.4 (#138)

BenchmarkOlmo 2 0325 32b InstructQwen3.7 Plus
OSWorld 2.0—2.8%

Reasoning Qwen3.7 Plus leads

Olmo 2 0325 32b Instruct: 23.6 (#175), Qwen3.7 Plus: 39.3 (#59)

BenchmarkOlmo 2 0325 32b InstructQwen3.7 Plus
LMArena Hard Prompts12081460
NYT Connections (extended)—74.8%
CritPt—9.1%
Chess Puzzles—24%
Mystery Game Puzzles—17%
DTBench—84%
LMCA—37.6%
Epoch Capabilities Index—147.37

Math Qwen3.7 Plus leads

Olmo 2 0325 32b Instruct: 26.8 (#255), Qwen3.7 Plus: 50.5 (#56)

BenchmarkOlmo 2 0325 32b InstructQwen3.7 Plus
LMArena Math12081466
FrontierMath (Tiers 1-3)—34.4%
OTIS Mock AIME 2024-2025—93.3%
Omni-MATH16.1%—

Knowledge Qwen3.7 Plus leads

Olmo 2 0325 32b Instruct: 19.5 (#279), Qwen3.7 Plus: 54.9 (#51)

BenchmarkOlmo 2 0325 32b InstructQwen3.7 Plus
GPQA Diamond—87.9%
MMLU-Pro41.4%—
GPQA (HELM)28.7%—
LMArena Expert—1467

Multimodal Not comparable

Olmo 2 0325 32b Instruct: —, Qwen3.7 Plus: 41.8 (#33)

BenchmarkOlmo 2 0325 32b InstructQwen3.7 Plus
LMArena Vision—1279
LMArena Document—1444

Multilingual Qwen3.7 Plus leads

Olmo 2 0325 32b Instruct: 34.8 (#248), Qwen3.7 Plus: 54.8 (#38)

BenchmarkOlmo 2 0325 32b InstructQwen3.7 Plus
LMArena Non-English11601445
LMArena Chinese11921510
LMArena Russian11871457
LMArena French—1473
LMArena German—1471
LMArena Japanese—1413
LMArena Korean—1415
LMArena Spanish—1457

Instruction Following Qwen3.7 Plus leads

Olmo 2 0325 32b Instruct: 61.5 (#244), Qwen3.7 Plus: 75.8 (#52)

BenchmarkOlmo 2 0325 32b InstructQwen3.7 Plus
LMArena Instruction Following11861440
IFEval78%—

Long Context Qwen3.7 Plus leads

Olmo 2 0325 32b Instruct: 36.2 (#234), Qwen3.7 Plus: 44.5 (#65)

BenchmarkOlmo 2 0325 32b InstructQwen3.7 Plus
LMArena Longer Query11941455

Writing & Preference Qwen3.7 Plus leads

Olmo 2 0325 32b Instruct: 42.1 (#236), Qwen3.7 Plus: 64.3 (#56)

BenchmarkOlmo 2 0325 32b InstructQwen3.7 Plus
LMArena Text12181455
LMArena Creative Writing11991439
LMArena Multi-Turn12211460
WildBench73.4%—

Frequently asked questions

Is Olmo 2 0325 32b Instruct better than Qwen3.7 Plus?

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 32.7 on the Noometry Index.

Is Olmo 2 0325 32b Instruct or Qwen3.7 Plus better for coding?

Qwen3.7 Plus scores higher on coding benchmarks: 36.6 versus 35.2 in the Noometry coding category.

How many benchmarks do Olmo 2 0325 32b Instruct and Qwen3.7 Plus share?

11 benchmarks have published results for both models. Olmo 2 0325 32b Instruct has 16 scored results on Noometry and Qwen3.7 Plus has 32.

Related comparisons

Go deeper