Model comparison

Olmo 2 0325 32b Instruct vs Qwen3.5 Max Preview

Qwen3.5 Max Preview is the stronger model overall, scoring 44.7 to 32.2 on the Noometry Index.

Last verified . 11 shared benchmarks.

Summary

  • They share 11 benchmarks with published results for both. Olmo 2 0325 32b Instruct scores higher in 0 categories and Qwen3.5 Max Preview in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3.5 Max Preview leads 66.1 to 42.3.
  • Olmo 2 0325 32b Instruct has downloadable open weights; the other is API-only.

Side by side

Olmo 2 0325 32b Instruct and Qwen3.5 Max Preview specifications
Olmo 2 0325 32b InstructQwen3.5 Max Preview
ProviderAllen Institute for AI (Ai2)Alibaba (Qwen)
Noometry Index32.244.7
Released——
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1617

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5 Max Preview leads

Olmo 2 0325 32b Instruct: 34.6 (#222), Qwen3.5 Max Preview: 43.4 (#79)

Coding benchmarks
BenchmarkOlmo 2 0325 32b InstructQwen3.5 Max Preview
LMArena Coding12101488

Reasoning Qwen3.5 Max Preview leads

Olmo 2 0325 32b Instruct: 22.6 (#174), Qwen3.5 Max Preview: 29.6 (#81)

Reasoning benchmarks
BenchmarkOlmo 2 0325 32b InstructQwen3.5 Max Preview
LMArena Hard Prompts12081483

Math Qwen3.5 Max Preview leads

Olmo 2 0325 32b Instruct: 24.8 (#255), Qwen3.5 Max Preview: 37.3 (#99)

Math benchmarks
BenchmarkOlmo 2 0325 32b InstructQwen3.5 Max Preview
LMArena Math12081473
Omni-MATH16.1%—

Knowledge Qwen3.5 Max Preview leads

Olmo 2 0325 32b Instruct: 19.2 (#274), Qwen3.5 Max Preview: 41.1 (#104)

Knowledge benchmarks
BenchmarkOlmo 2 0325 32b InstructQwen3.5 Max Preview
MMLU-Pro41.4%—
GPQA (HELM)28.7%—
LMArena Expert—1489

Multilingual Qwen3.5 Max Preview leads

Olmo 2 0325 32b Instruct: 35.0 (#243), Qwen3.5 Max Preview: 56.4 (#21)

Multilingual benchmarks
BenchmarkOlmo 2 0325 32b InstructQwen3.5 Max Preview
LMArena Non-English11601465
LMArena Chinese11921534
LMArena Russian11871472
LMArena French—1483
LMArena German—1487
LMArena Japanese—1497
LMArena Korean—1438
LMArena Spanish—1470

Instruction Following Qwen3.5 Max Preview leads

Olmo 2 0325 32b Instruct: 61.8 (#238), Qwen3.5 Max Preview: 77.2 (#28)

Instruction Following benchmarks
BenchmarkOlmo 2 0325 32b InstructQwen3.5 Max Preview
LMArena Instruction Following11861467
IFEval78%—

Long Context Qwen3.5 Max Preview leads

Olmo 2 0325 32b Instruct: 36.2 (#229), Qwen3.5 Max Preview: 45.2 (#44)

Long Context benchmarks
BenchmarkOlmo 2 0325 32b InstructQwen3.5 Max Preview
LMArena Longer Query11941477

Writing & Preference Qwen3.5 Max Preview leads

Olmo 2 0325 32b Instruct: 42.3 (#231), Qwen3.5 Max Preview: 66.1 (#39)

Writing & Preference benchmarks
BenchmarkOlmo 2 0325 32b InstructQwen3.5 Max Preview
LMArena Text12181471
LMArena Creative Writing11991464
LMArena Multi-Turn12211478
WildBench73.4%—

Frequently asked questions

Is Olmo 2 0325 32b Instruct better than Qwen3.5 Max Preview?

Qwen3.5 Max Preview is the stronger model overall, scoring 44.7 to 32.2 on the Noometry Index.

Is Olmo 2 0325 32b Instruct or Qwen3.5 Max Preview better for coding?

Qwen3.5 Max Preview scores higher on coding benchmarks: 43.4 versus 34.6 in the Noometry coding category.

How many benchmarks do Olmo 2 0325 32b Instruct and Qwen3.5 Max Preview share?

11 benchmarks have published results for both models. Olmo 2 0325 32b Instruct has 16 scored results on Noometry and Qwen3.5 Max Preview has 17.

Related comparisons

Go deeper