Model comparison

Olmo 3 32b Think vs Qwen3 14B

Olmo 3 32b Think is the stronger model overall, scoring 38.7 to 35.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

Qwen3 14B Alibaba (Qwen)

35.5

Rank #225 Confirmed

Summary

  • The widest gap is in reasoning, where Olmo 3 32b Think leads 25.9 to 18.5.

Side by side

Olmo 3 32b Think and Qwen3 14B specifications
Olmo 3 32b ThinkQwen3 14B
ProviderAllen Institute for AI (Ai2)Alibaba (Qwen)
Noometry Index38.735.5
Released—2025-04
WeightsOpenOpen
Context window—131K
Max output—8K
Input $ / M tokens—$0.35
Output $ / M tokens—$1.40
Results tracked1412

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Olmo 3 32b Think leads

Olmo 3 32b Think: 38.6 (#172), Qwen3 14B: 37.3 (#195)

Coding benchmarks
BenchmarkOlmo 3 32b ThinkQwen3 14B
SciCode—31.6%
LMArena Coding1319—

Agentic & Tool Use Not comparable

Olmo 3 32b Think: —, Qwen3 14B: 29.6 (#83)

Agentic & Tool Use benchmarks
BenchmarkOlmo 3 32b ThinkQwen3 14B
Berkeley Function Calling Leaderboard—41%

Reasoning Olmo 3 32b Think leads

Olmo 3 32b Think: 25.9 (#140), Qwen3 14B: 18.5 (#280)

Reasoning benchmarks
BenchmarkOlmo 3 32b ThinkQwen3 14B
Kagi LLM Benchmark—49.1%
CritPt—0%
Chess Puzzles—4%
LMArena Hard Prompts1302—
DTBench—64%
LMCA—18.2%
Epoch Capabilities Index—138.23

Math Qwen3 14B leads

Olmo 3 32b Think: 36.5 (#165), Qwen3 14B: 38.6 (#133)

Math benchmarks
BenchmarkOlmo 3 32b ThinkQwen3 14B
OTIS Mock AIME 2024-2025—66.4%
LMArena Math1316—

Knowledge Qwen3 14B leads

Olmo 3 32b Think: 35.0 (#190), Qwen3 14B: 39.3 (#134)

Knowledge benchmarks
BenchmarkOlmo 3 32b ThinkQwen3 14B
GPQA Diamond—63.8%
Vectara Hallucination Rate—5.4%
LMArena Expert1273—

Multilingual Not comparable

Olmo 3 32b Think: 41.2 (#210), Qwen3 14B: —

Multilingual benchmarks
BenchmarkOlmo 3 32b ThinkQwen3 14B
LMArena Non-English1255—
LMArena Chinese1300—
LMArena French1291—
LMArena German1290—
LMArena Russian1254—

Instruction Following Not comparable

Olmo 3 32b Think: 67.2 (#198), Qwen3 14B: —

Instruction Following benchmarks
BenchmarkOlmo 3 32b ThinkQwen3 14B
LMArena Instruction Following1275—

Long Context Olmo 3 32b Think leads

Olmo 3 32b Think: 39.4 (#182), Qwen3 14B: 38.1 (#204)

Long Context benchmarks
BenchmarkOlmo 3 32b ThinkQwen3 14B
Fiction.LiveBench—62.5%
LMArena Longer Query1296—

Writing & Preference Not comparable

Olmo 3 32b Think: 49.1 (#193), Qwen3 14B: —

Writing & Preference benchmarks
BenchmarkOlmo 3 32b ThinkQwen3 14B
LMArena Text1300—
LMArena Creative Writing1256—
LMArena Multi-Turn1290—

Frequently asked questions

Is Olmo 3 32b Think better than Qwen3 14B?

Olmo 3 32b Think is the stronger model overall, scoring 38.7 to 35.5 on the Noometry Index.

Is Olmo 3 32b Think or Qwen3 14B better for coding?

Olmo 3 32b Think scores higher on coding benchmarks: 38.6 versus 37.3 in the Noometry coding category.

How many benchmarks do Olmo 3 32b Think and Qwen3 14B share?

0 benchmarks have published results for both models. Olmo 3 32b Think has 14 scored results on Noometry and Qwen3 14B has 12.

Related comparisons

Go deeper