Noometry

Model comparison

Olmo 3 32b Think vs Qwen3-1.7B

Olmo 3 32b Think is the stronger model overall, scoring 38.7 to 26.6 on the Noometry Index.

Last verified . 0 shared benchmarks.

Olmo 3 32b Think Allen Institute for AI (Ai2)

38.7

Rank #183 Confirmed

Qwen3-1.7B Alibaba (Qwen)

26.6

Rank #336 Reported

Summary

  • The widest gap is in math, where Olmo 3 32b Think leads 36.5 to 16.3.

Side by side

Olmo 3 32b ThinkQwen3-1.7B
ProviderAllen Institute for AI (Ai2)Alibaba (Qwen)
Noometry Index38.726.6
Released—2025-04-29
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked144

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Olmo 3 32b Think: 38.6 (#172), Qwen3-1.7B: —

BenchmarkOlmo 3 32b ThinkQwen3-1.7B
LMArena Coding1319—

Agentic & Tool Use Not comparable

Olmo 3 32b Think: —, Qwen3-1.7B: 24.7 (#115)

BenchmarkOlmo 3 32b ThinkQwen3-1.7B
Berkeley Function Calling Leaderboard—28.4%

Reasoning Olmo 3 32b Think leads

Olmo 3 32b Think: 25.9 (#140), Qwen3-1.7B: 19.2 (#267)

BenchmarkOlmo 3 32b ThinkQwen3-1.7B
Chess Puzzles—0%
LMArena Hard Prompts1302—

Math Olmo 3 32b Think leads

Olmo 3 32b Think: 36.5 (#165), Qwen3-1.7B: 16.3 (#294)

BenchmarkOlmo 3 32b ThinkQwen3-1.7B
OTIS Mock AIME 2024-2025—8.1%
LMArena Math1316—

Knowledge Olmo 3 32b Think leads

Olmo 3 32b Think: 35.0 (#190), Qwen3-1.7B: 19.6 (#278)

BenchmarkOlmo 3 32b ThinkQwen3-1.7B
GPQA Diamond—38%
LMArena Expert1273—

Multilingual Not comparable

Olmo 3 32b Think: 41.2 (#210), Qwen3-1.7B: —

BenchmarkOlmo 3 32b ThinkQwen3-1.7B
LMArena Non-English1255—
LMArena Chinese1300—
LMArena French1291—
LMArena German1290—
LMArena Russian1254—

Instruction Following Not comparable

Olmo 3 32b Think: 67.2 (#198), Qwen3-1.7B: —

BenchmarkOlmo 3 32b ThinkQwen3-1.7B
LMArena Instruction Following1275—

Long Context Not comparable

Olmo 3 32b Think: 39.4 (#182), Qwen3-1.7B: —

BenchmarkOlmo 3 32b ThinkQwen3-1.7B
LMArena Longer Query1296—

Writing & Preference Not comparable

Olmo 3 32b Think: 49.1 (#193), Qwen3-1.7B: —

BenchmarkOlmo 3 32b ThinkQwen3-1.7B
LMArena Text1300—
LMArena Creative Writing1256—
LMArena Multi-Turn1290—

Frequently asked questions

Is Olmo 3 32b Think better than Qwen3-1.7B?

Olmo 3 32b Think is the stronger model overall, scoring 38.7 to 26.6 on the Noometry Index.

How many benchmarks do Olmo 3 32b Think and Qwen3-1.7B share?

0 benchmarks have published results for both models. Olmo 3 32b Think has 14 scored results on Noometry and Qwen3-1.7B has 4.

Related comparisons

Go deeper