NVIDIA, open weights
StarCoder 2 15B
StarCoder 2 15B by NVIDIA has 7 published benchmark results on Noometry, not yet enough to be ranked.
Last verified
Specifications
- Noometry rank
- Unranked
- Index score
- Not ranked
- Evidence
- Sparse 7 results
- Provider
NVIDIA- Released
- February 20, 2024
- Weights
- Open weights
- Reasoning
- Unknown
- Context window
- —
- Max output
- —
- Input price
- Not listed
- Output price
- Not listed
- Blended price
- Not listed
- Output speed
- Not measured
- Value
- Not ranked
- Knowledge cutoff
- Unknown
Category scores
Each category score combines every public result we have in that category.
- Coding 36.6
| Category | Score | Rank | Results |
|---|---|---|---|
| Coding | 36.6 | — | 1 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Benchmark results
Every published result we track, with its source. Bold rows are the ones used for ranking; where several exist we prefer independent runs over self-reported numbers.
Coding
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| BigCodeBench Complete | 38.4% | #55 of 66, top 84% | BigCodeBench | 2024-02-29 | |
| HumanEval+ | 37.8% | #38 of 45, top 85% | EvalPlus |
Reasoning
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| Epoch Capabilities Index | 105 | #198 of 213, top 93% | Epoch AI | 2024-02-20 | |
| WinoGrande | 64.3% | #36 of 43, top 84% | Epoch AI |
Math
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| GSM8K | 57.7% | #18 of 38, top 48% | Epoch AI |
Knowledge
| Benchmark | Score | Position | Setting | Source | Date |
|---|---|---|---|---|---|
| ARC (AI2) Challenge | 47.2% | #30 of 39, top 77% | Epoch AI | ||
| MMLU | 64.1% | #56 of 81, top 70% | Epoch AI |
Compare StarCoder 2 15B
- StarCoder 2 15B vs GPT-6 Astra
- StarCoder 2 15B vs Claude Fable 5.1
- StarCoder 2 15B vs Claude Opus 5.5
- StarCoder 2 15B vs Claude Opus 5
- StarCoder 2 15B vs Claude Fable 5
- StarCoder 2 15B vs GPT-6.1 Sol
- StarCoder 2 15B vs Gemini 3.8 Flash
- StarCoder 2 15B vs Kimi K3
- StarCoder 2 15B vs Grok 4.6
- StarCoder 2 15B vs Qwen3.8 Max
- StarCoder 2 15B vs GLM-5.3
- StarCoder 2 15B vs Muse Spark 1.3
- StarCoder 2 15B vs DeepSeek V4 Pro
- StarCoder 2 15B vs MiMo-V2.6-Pro
Frequently asked questions
How good is StarCoder 2 15B?
StarCoder 2 15B by NVIDIA has 7 published benchmark results on Noometry, not yet enough to be ranked.
Is StarCoder 2 15B open source?
Yes. StarCoder 2 15B's weights are downloadable; check the license for commercial terms.