Noometry

Model comparison

Olmo 3.1 32b Instruct vs Qwen3-1.7B

Olmo 3.1 32b Instruct is the stronger model overall, scoring 38.8 to 26.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Olmo 3.1 32b Instruct Allen Institute for AI (Ai2)

38.8

Rank #168 Confirmed

Qwen3-1.7B Alibaba (Qwen)

26.2

Rank #331 Reported

Summary

  • The widest gap is in math, where Olmo 3.1 32b Instruct leads 33.6 to 15.4.

Side by side

Olmo 3.1 32b InstructQwen3-1.7B
ProviderAllen Institute for AI (Ai2)Alibaba (Qwen)
Noometry Index38.826.2
Released—2025-04-29
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked164

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Olmo 3.1 32b Instruct: 38.9 (#154), Qwen3-1.7B: —

BenchmarkOlmo 3.1 32b InstructQwen3-1.7B
LMArena Coding1346—

Agentic & Tool Use Not comparable

Olmo 3.1 32b Instruct: —, Qwen3-1.7B: 24.5 (#108)

BenchmarkOlmo 3.1 32b InstructQwen3-1.7B
Berkeley Function Calling Leaderboard—28.4%

Reasoning Olmo 3.1 32b Instruct leads

Olmo 3.1 32b Instruct: 25.4 (#131), Qwen3-1.7B: 18.5 (#263)

BenchmarkOlmo 3.1 32b InstructQwen3-1.7B
Chess Puzzles—0%
LMArena Hard Prompts1322—

Math Olmo 3.1 32b Instruct leads

Olmo 3.1 32b Instruct: 33.6 (#169), Qwen3-1.7B: 15.4 (#288)

BenchmarkOlmo 3.1 32b InstructQwen3-1.7B
OTIS Mock AIME 2024-2025—8.1%
LMArena Math1305—

Knowledge Olmo 3.1 32b Instruct leads

Olmo 3.1 32b Instruct: 35.4 (#175), Qwen3-1.7B: 19.6 (#273)

BenchmarkOlmo 3.1 32b InstructQwen3-1.7B
GPQA Diamond—38%
LMArena Expert1307—

Multilingual Not comparable

Olmo 3.1 32b Instruct: 42.8 (#185), Qwen3-1.7B: —

BenchmarkOlmo 3.1 32b InstructQwen3-1.7B
LMArena Non-English1275—
LMArena Chinese1304—
LMArena French1328—
LMArena German1283—
LMArena Korean1206—
LMArena Russian1268—
LMArena Spanish1337—

Instruction Following Not comparable

Olmo 3.1 32b Instruct: 68.8 (#182), Qwen3-1.7B: —

BenchmarkOlmo 3.1 32b InstructQwen3-1.7B
LMArena Instruction Following1298—

Long Context Not comparable

Olmo 3.1 32b Instruct: 39.9 (#161), Qwen3-1.7B: —

BenchmarkOlmo 3.1 32b InstructQwen3-1.7B
LMArena Longer Query1312—

Writing & Preference Not comparable

Olmo 3.1 32b Instruct: 50.4 (#179), Qwen3-1.7B: —

BenchmarkOlmo 3.1 32b InstructQwen3-1.7B
LMArena Text1311—
LMArena Creative Writing1264—
LMArena Multi-Turn1309—

Frequently asked questions

Is Olmo 3.1 32b Instruct better than Qwen3-1.7B?

Olmo 3.1 32b Instruct is the stronger model overall, scoring 38.8 to 26.2 on the Noometry Index.

How many benchmarks do Olmo 3.1 32b Instruct and Qwen3-1.7B share?

0 benchmarks have published results for both models. Olmo 3.1 32b Instruct has 16 scored results on Noometry and Qwen3-1.7B has 4.

Related comparisons

Go deeper