Model comparison
Nova Premier 1.0 vs Olmo 7b Instruct
Nova Premier 1.0 is the stronger model overall, scoring 38.3 to 30.3 on the Noometry Index.
Last verified . 0 shared benchmarks.
Allen Institute for AI (Ai2)Summary
- The widest gap is in writing & preference, where Nova Premier 1.0 leads 51.0 to 25.8.
- Olmo 7b Instruct has downloadable open weights; the other is API-only.
Side by side
| Nova Premier 1.0 | Olmo 7b Instruct | |
|---|---|---|
| Provider | Amazon | Allen Institute for AI (Ai2) |
| Noometry Index | 38.3 | 30.3 |
| Released | 2025-04-30 | — |
| Weights | Proprietary | Open |
| Context window | 1M | — |
| Max output | 10K | — |
| Input $ / M tokens | $2.50 | — |
| Output $ / M tokens | $12.50 | — |
| Results tracked | 6 | 10 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Not comparable
Nova Premier 1.0: —, Olmo 7b Instruct: 29.6 (#303)
| Benchmark | Nova Premier 1.0 | Olmo 7b Instruct |
|---|---|---|
| LMArena Coding | — | 1016 |
Reasoning Nova Premier 1.0 leads
Nova Premier 1.0: 23.0 (#185), Olmo 7b Instruct: 18.8 (#274)
| Benchmark | Nova Premier 1.0 | Olmo 7b Instruct |
|---|---|---|
| Kagi LLM Benchmark | 44.8% | — |
| LMArena Hard Prompts | — | 993 |
Math Nova Premier 1.0 leads
Nova Premier 1.0: 33.8 (#199), Olmo 7b Instruct: 30.2 (#237)
| Benchmark | Nova Premier 1.0 | Olmo 7b Instruct |
|---|---|---|
| Omni-MATH | 35% | — |
| LMArena Math | — | 1018 |
Knowledge Not comparable
Nova Premier 1.0: 35.8 (#180), Olmo 7b Instruct: —
| Benchmark | Nova Premier 1.0 | Olmo 7b Instruct |
|---|---|---|
| MMLU-Pro | 72.6% | — |
| GPQA (HELM) | 51.8% | — |
Multilingual Not comparable
Nova Premier 1.0: —, Olmo 7b Instruct: 24.0 (#291)
| Benchmark | Nova Premier 1.0 | Olmo 7b Instruct |
|---|---|---|
| LMArena Non-English | — | 977 |
| LMArena Chinese | — | 1014 |
| LMArena Russian | — | 947 |
Instruction Following Nova Premier 1.0 leads
Nova Premier 1.0: 66.8 (#204), Olmo 7b Instruct: 49.0 (#301)
| Benchmark | Nova Premier 1.0 | Olmo 7b Instruct |
|---|---|---|
| IFEval | 80.3% | — |
| LMArena Instruction Following | — | 978 |
Writing & Preference Nova Premier 1.0 leads
Nova Premier 1.0: 51.0 (#178), Olmo 7b Instruct: 25.8 (#303)
| Benchmark | Nova Premier 1.0 | Olmo 7b Instruct |
|---|---|---|
| LMArena Text | — | 1032 |
| LMArena Creative Writing | — | 990 |
| WildBench | 78.8% | — |
| LMArena Multi-Turn | — | 1007 |
Frequently asked questions
Is Nova Premier 1.0 better than Olmo 7b Instruct?
Nova Premier 1.0 is the stronger model overall, scoring 38.3 to 30.3 on the Noometry Index.
How many benchmarks do Nova Premier 1.0 and Olmo 7b Instruct share?
0 benchmarks have published results for both models. Nova Premier 1.0 has 6 scored results on Noometry and Olmo 7b Instruct has 10.