Allen Institute for AI (Ai2), open weights
Olmo 2 0325 32b Instruct
Olmo 2 0325 32b Instruct by Allen Institute for AI (Ai2) ranks 254th of 354 ranked models on the Noometry Index as of October 2026, with a score of 32.7. Its strongest category is reasoning, where it ranks 175th.
Last verified
Specifications
- Noometry rank
- #254 of 354
- Index score
- 32.7
- Evidence
- Confirmed 16 results
- Provider
Allen Institute for AI (Ai2)- Released
- Unknown
- Weights
- Open weights
- Reasoning
- Unknown
- Context window
- —
- Max output
- —
- Input price
- Not listed
- Output price
- Not listed
- Blended price
- Not listed
- Output speed
- Not measured
- Value
- Not ranked
- Knowledge cutoff
- Unknown
Category scores
Each category score combines every public result we have in that category.
- Coding 35.2
- Reasoning 23.6
- Math 26.8
- Knowledge 19.5
- Multilingual 34.8
- Instruction Following 61.5
- Long Context 36.2
- Writing & Preference 42.1
| Category | Score | Rank | Results |
|---|---|---|---|
| Coding | 35.2 | #227 | 1 |
| Reasoning | 23.6 | #175 | 1 |
| Math | 26.8 | #255 | 2 |
| Knowledge | 19.5 | #279 | 2 |
| Multilingual | 34.8 | #248 | 1 |
| Instruction Following | 61.5 | #244 | 2 |
| Long Context | 36.2 | #234 | 1 |
| Writing & Preference | 42.1 | #236 | 4 |
Strengths and weaknesses
Categories where Olmo 2 0325 32b Instruct places highest and lowest among the models ranked in each, with its score against that category's median.
Strongest categories
| Category | Score | vs median | Rank |
|---|---|---|---|
| Reasoning | 23.6 | −0.0 | #175 of 350, top 50% |
| Coding | 35.2 | −3.5 | #227 of 340, top 67% |
| Writing & Preference | 42.1 | −11.6 | #236 of 312, top 76% |
Weakest categories
| Category | Score | vs median | Rank |
|---|---|---|---|
| Knowledge | 19.5 | −17.8 | #279 of 314, top 89% |
| Multilingual | 34.8 | −12.6 | #248 of 297, top 84% |
| Instruction Following | 61.5 | −9.7 | #244 of 305, top 80% |
Closest competitors
The models ranked just above and below Olmo 2 0325 32b Instruct. When scores are this close, price and speed are often the better way to choose.
| Model | Rank | Score | Blended $/M | Speed | |
|---|---|---|---|---|---|
| Phi 3 Medium 4k Instruct | #250 | 33.0 | — | — | Compare |
| Tulu 3 (Tülu 3) 70B | #251 | 33.0 | — | — | Compare |
| DeepSeek-R1-Distill-Qwen-14B | #252 | 32.7 | — | — | Compare |
| Qwen1.5-14B | #253 | 32.7 | — | — | Compare |
| gpt-oss-20b | #255 | 32.5 | $0.036 | 96 | Compare |
| Laguna M.1 | #256 | 32.5 | — | — | Compare |
| Command R+ | #257 | 32.4 | $4.38 | — | Compare |
| Granite 3.1 8b Instruct | #258 | 32.4 | — | — | Compare |
Sponsored placements are available on pages like this one. Advertise on Noometry
Benchmark results
Every published result we track, with its source. Bold rows are the ones used for ranking; where several exist we prefer independent runs over self-reported numbers.
Coding
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Coding | 1210 | #237 of 294, top 81% | LMArena | 2026-10-08 |
Reasoning
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Hard Prompts | 1208 | #233 of 297, top 79% | LMArena | 2026-10-08 |
Math
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| Omni-MATH | 16.1% | #53 of 57, top 93% | HELM Capabilities | ||
| LMArena Math | 1208 | #229 of 285, top 81% | LMArena | 2026-10-08 |
Knowledge
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| MMLU-Pro | 41.4% | #53 of 58, top 92% | HELM Capabilities | ||
| GPQA (HELM) | 28.7% | #56 of 57, top 99% | HELM Capabilities |
Multilingual
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Non-English | 1160 | #248 of 297, top 84% | LMArena | 2026-10-08 | |
| LMArena Chinese | 1192 | #235 of 285, top 83% | LMArena | 2026-10-08 | |
| LMArena Russian | 1187 | #240 of 283, top 85% | LMArena | 2026-10-08 |
Instruction Following
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| IFEval | 78% | #47 of 57, top 83% | HELM Capabilities | ||
| LMArena Instruction Following | 1186 | #241 of 298, top 81% | LMArena | 2026-10-08 |
Long Context
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Longer Query | 1194 | #243 of 291, top 84% | LMArena | 2026-10-08 |
Writing & Preference
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Text | 1218 | #239 of 297, top 81% | LMArena | 2026-10-08 | |
| LMArena Creative Writing | 1199 | #234 of 295, top 80% | LMArena | 2026-10-08 | |
| WildBench | 73.4% | #49 of 57, top 86% | HELM Capabilities | ||
| LMArena Multi-Turn | 1221 | #232 of 295, top 79% | LMArena | 2026-10-08 |
Compare Olmo 2 0325 32b Instruct
- Olmo 2 0325 32b Instruct vs Qwen1.5-14B
- Olmo 2 0325 32b Instruct vs gpt-oss-20b
- Olmo 2 0325 32b Instruct vs DeepSeek-R1-Distill-Qwen-14B
- Olmo 2 0325 32b Instruct vs Laguna M.1
- Olmo 2 0325 32b Instruct vs Tulu 3 (Tülu 3) 70B
- Olmo 2 0325 32b Instruct vs Command R+
- Olmo 2 0325 32b Instruct vs GPT-6 Astra
- Olmo 2 0325 32b Instruct vs Claude Fable 5.1
- Olmo 2 0325 32b Instruct vs Gemini 3.8 Flash
- Olmo 2 0325 32b Instruct vs Kimi K3
- Olmo 2 0325 32b Instruct vs Grok 4.6
- Olmo 2 0325 32b Instruct vs Qwen3.8 Max
- Olmo 2 0325 32b Instruct vs GLM-5.3
- Olmo 2 0325 32b Instruct vs Muse Spark 1.3
Other Allen Institute for AI (Ai2) models
Frequently asked questions
How good is Olmo 2 0325 32b Instruct?
Olmo 2 0325 32b Instruct by Allen Institute for AI (Ai2) ranks 254th of 354 ranked models on the Noometry Index as of October 2026, with a score of 32.7. Its strongest category is reasoning, where it ranks 175th.
Is Olmo 2 0325 32b Instruct open source?
Yes. Olmo 2 0325 32b Instruct's weights are downloadable; check the license for commercial terms.
What are Olmo 2 0325 32b Instruct's strengths and weaknesses?
Relative to other ranked models, Olmo 2 0325 32b Instruct places best in reasoning, coding, writing & preference and lowest in knowledge, multilingual, instruction following.
What is Olmo 2 0325 32b Instruct best at?
Its best category is reasoning, where it ranks 175th on Noometry.