Allen Institute for AI (Ai2), open weights
Olmo 7b Instruct
Olmo 7b Instruct by Allen Institute for AI (Ai2) ranks 295th of 354 ranked models on the Noometry Index as of October 2026, with a score of 30.3. Its strongest category is math, where it ranks 237th.
Last verified
Specifications
- Noometry rank
- #295 of 354
- Index score
- 30.3
- Evidence
- Confirmed 10 results
- Provider
Allen Institute for AI (Ai2)- Released
- Unknown
- Weights
- Open weights
- Reasoning
- Unknown
- Context window
- —
- Max output
- —
- Input price
- Not listed
- Output price
- Not listed
- Blended price
- Not listed
- Output speed
- Not measured
- Value
- Not ranked
- Knowledge cutoff
- Unknown
Category scores
Each category score combines every public result we have in that category.
- Coding 29.6
- Reasoning 18.8
- Math 30.2
- Multilingual 24.0
- Instruction Following 49.0
- Writing & Preference 25.8
| Category | Score | Rank | Results |
|---|---|---|---|
| Coding | 29.6 | #303 | 1 |
| Reasoning | 18.8 | #274 | 1 |
| Math | 30.2 | #237 | 1 |
| Multilingual | 24.0 | #291 | 1 |
| Instruction Following | 49.0 | #301 | 1 |
| Writing & Preference | 25.8 | #303 | 3 |
Strengths and weaknesses
Categories where Olmo 7b Instruct places highest and lowest among the models ranked in each, with its score against that category's median.
Strongest categories
Weakest categories
| Category | Score | vs median | Rank |
|---|---|---|---|
| Instruction Following | 49.0 | −22.3 | #301 of 305, top 99% |
| Multilingual | 24.0 | −23.4 | #291 of 297, top 98% |
| Writing & Preference | 25.8 | −27.9 | #303 of 312, top 98% |
Closest competitors
The models ranked just above and below Olmo 7b Instruct. When scores are this close, price and speed are often the better way to choose.
| Model | Rank | Score | Blended $/M | Speed | |
|---|---|---|---|---|---|
| Llama-3.3-70B-Instruct | #291 | 30.6 | $0.16 | — | Compare |
| GPT-4 Turbo | #292 | 30.5 | $15 | — | Compare |
| Qwen1.5-32B | #293 | 30.5 | — | — | Compare |
| Amazon Nova Micro | #294 | 30.4 | $0.0613 | — | Compare |
| Magistral Small | #296 | 30.2 | $0.75 | 0 | Compare |
| Qwen2.5 32B Instruct | #297 | 30.1 | $1.22 | — | Compare |
| Palm 2 | #298 | 30.0 | — | — | Compare |
| Gemma 7B | #299 | 30.0 | — | — | Compare |
Sponsored placements are available on pages like this one. Advertise on Noometry
Benchmark results
Every published result we track, with its source. Bold rows are the ones used for ranking; where several exist we prefer independent runs over self-reported numbers.
Coding
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Coding | 1016 | #288 of 294, top 98% | LMArena | 2026-10-08 |
Reasoning
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Hard Prompts | 993 | #293 of 297, top 99% | LMArena | 2026-10-08 |
Math
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Math | 1018 | #281 of 285, top 99% | LMArena | 2026-10-08 |
Multilingual
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Non-English | 977 | #291 of 297, top 98% | LMArena | 2026-10-08 | |
| LMArena Chinese | 1014 | #275 of 285, top 97% | LMArena | 2026-10-08 | |
| LMArena Russian | 947 | #281 of 283, top 100% | LMArena | 2026-10-08 |
Instruction Following
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Instruction Following | 978 | #295 of 298, top 99% | LMArena | 2026-10-08 |
Writing & Preference
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| LMArena Text | 1032 | #291 of 297, top 98% | LMArena | 2026-10-08 | |
| LMArena Creative Writing | 990 | #291 of 295, top 99% | LMArena | 2026-10-08 | |
| LMArena Multi-Turn | 1007 | #287 of 295, top 98% | LMArena | 2026-10-08 |
Compare Olmo 7b Instruct
- Olmo 7b Instruct vs Amazon Nova Micro
- Olmo 7b Instruct vs Magistral Small
- Olmo 7b Instruct vs Qwen1.5-32B
- Olmo 7b Instruct vs Qwen2.5 32B Instruct
- Olmo 7b Instruct vs GPT-4 Turbo
- Olmo 7b Instruct vs Palm 2
- Olmo 7b Instruct vs GPT-6 Astra
- Olmo 7b Instruct vs Claude Fable 5.1
- Olmo 7b Instruct vs Gemini 3.8 Flash
- Olmo 7b Instruct vs Kimi K3
- Olmo 7b Instruct vs Grok 4.6
- Olmo 7b Instruct vs Qwen3.8 Max
- Olmo 7b Instruct vs GLM-5.3
- Olmo 7b Instruct vs Muse Spark 1.3
Other Allen Institute for AI (Ai2) models
Frequently asked questions
How good is Olmo 7b Instruct?
Olmo 7b Instruct by Allen Institute for AI (Ai2) ranks 295th of 354 ranked models on the Noometry Index as of October 2026, with a score of 30.3. Its strongest category is math, where it ranks 237th.
Is Olmo 7b Instruct open source?
Yes. Olmo 7b Instruct's weights are downloadable; check the license for commercial terms.
What are Olmo 7b Instruct's strengths and weaknesses?
Relative to other ranked models, Olmo 7b Instruct places best in math, reasoning, coding and lowest in instruction following, multilingual, writing & preference.
What is Olmo 7b Instruct best at?
Its best category is math, where it ranks 237th on Noometry.