Writing & Preference benchmark

# Short-Story Creative Writing leaderboard

> Short-Story Creative Writing results for 39 AI models, led by GPT-5 at 86%. What the benchmark measures, who runs it, and a source for every score.
- Canonical page: https://noometry.com/benchmarks/lech-mazur-writing
- Last updated: 2026-10-10
- Title: Short-Story Creative Writing Leaderboard (October 2026): Scores by Model

As of October 2026, GPT-5 has the highest published Short-Story Creative Writing score on Noometry at 86%, out of 39 models with results.

Last verified October 10, 2026

## About Short-Story Creative Writing

Short stories that must work in required elements, graded by a panel of LLM judges on a 10-point scale (shown here out of 100).

- **Category:** [Writing & Preference](https://noometry.com/best/writing)
- **Introduced:** 2025
- **Format:** Graded writing
- **Unit:** Percent (random guessing ≈ 0%)
- **Official site:** [github.com](https://github.com/lechmazur/writing)

## Top 15 models

Top models on Short-Story Creative Writing

1.  GPT-5 86%
2.  Kimi K2 (Jul 2025) 85.6%
3.  Claude Opus 4.1 84.7%
4.  o3-pro 84.4%
5.  o3 83.9%
6.  Gemini 2.5 Pro 83.8%
7.  Claude Opus 4 83.6%
8.  GPT-5 Mini 83.1%
9.  DeepSeek-R1 83%
10.  Qwen3 235B-A22B 83%
11.  GPT-4o 81.8%
12.  Claude Sonnet 4 81.4%
13.  Claude 3.7 Sonnet 81.1%
14.  Claude 3.5 Sonnet 80.3%
15.  QwQ-32B 80.2%
16.  7880828486

Sponsored placements are available on pages like this one. [Advertise on Noometry](https://noometry.com/advertise)

## All results

Short-Story Creative Writing results by model
| # | Model | Provider | Score | Setting | Source | Date |
| --- | --- | --- | --- | --- | --- | --- |
| 1 | [GPT-5](https://noometry.com/models/gpt-5) | [OpenAI](https://noometry.com/providers/openai) | 86% | medium | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 2 | [Kimi K2 (Jul 2025)](https://noometry.com/models/kimi-k2) | [Moonshot AI](https://noometry.com/providers/moonshot) | 85.6% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 3 | [Claude Opus 4.1](https://noometry.com/models/claude-opus-4-1) | [Anthropic](https://noometry.com/providers/anthropic) | 84.7% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 4 | [o3-pro](https://noometry.com/models/o3-pro) | [OpenAI](https://noometry.com/providers/openai) | 84.4% | medium | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 5 | [o3](https://noometry.com/models/o3) | [OpenAI](https://noometry.com/providers/openai) | 83.9% | medium | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 6 | [Gemini 2.5 Pro](https://noometry.com/models/gemini-2-5-pro) |  [![](/logos/google.svg) Google](https://noometry.com/providers/google) | 83.8% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 7 | [Claude Opus 4](https://noometry.com/models/claude-opus-4) | [Anthropic](https://noometry.com/providers/anthropic) | 83.6% | 16K | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 8 | [GPT-5 Mini](https://noometry.com/models/gpt-5-mini) | [OpenAI](https://noometry.com/providers/openai) | 83.1% | medium | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 9 | [DeepSeek-R1](https://noometry.com/models/deepseek-r1) |  [![](/logos/deepseek.svg) DeepSeek](https://noometry.com/providers/deepseek) | 83% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 10 | [Qwen3 235B-A22B](https://noometry.com/models/qwen3-235b-a22b) |  [![](/logos/alibaba.svg) Alibaba (Qwen)](https://noometry.com/providers/alibaba) | 83% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 11 | [GPT-4o](https://noometry.com/models/gpt-4o) | [OpenAI](https://noometry.com/providers/openai) | 81.8% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 12 | [Claude Sonnet 4](https://noometry.com/models/claude-sonnet-4) | [Anthropic](https://noometry.com/providers/anthropic) | 81.4% | 16K | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 13 | [Claude 3.7 Sonnet](https://noometry.com/models/claude-3-7-sonnet) | [Anthropic](https://noometry.com/providers/anthropic) | 81.1% | 16K | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 14 | [Claude 3.5 Sonnet](https://noometry.com/models/claude-3-5-sonnet) | [Anthropic](https://noometry.com/providers/anthropic) | 80.3% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 15 | [QwQ-32B](https://noometry.com/models/qwq-32b) |  [![](/logos/alibaba.svg) Alibaba (Qwen)](https://noometry.com/providers/alibaba) | 80.2% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 16 | [Gemma 3 27B](https://noometry.com/models/gemma-3-27b) |  [![](/logos/google.svg) Google](https://noometry.com/providers/google) | 79.9% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 17 | [Mistral Medium](https://noometry.com/models/mistral-medium) |  [![](/logos/mistral.svg) Mistral AI](https://noometry.com/providers/mistral) | 77.3% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 18 | [gpt-oss-120b](https://noometry.com/models/gpt-oss-120b) | [OpenAI](https://noometry.com/providers/openai) | 77.1% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 19 | [DeepSeek-V3](https://noometry.com/models/deepseek-v3) |  [![](/logos/deepseek.svg) DeepSeek](https://noometry.com/providers/deepseek) | 77% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 20 | [Grok 4](https://noometry.com/models/grok-4) | [xAI](https://noometry.com/providers/xai) | 76.9% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 21 | [Gemini 2.5 Flash](https://noometry.com/models/gemini-2-5-flash) |  [![](/logos/google.svg) Google](https://noometry.com/providers/google) | 76.5% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 22 | [Grok 3](https://noometry.com/models/grok-3) | [xAI](https://noometry.com/providers/xai) | 76.4% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 23 | [GPT-4.5](https://noometry.com/models/gpt-4-5) | [OpenAI](https://noometry.com/providers/openai) | 75.6% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 24 | [Qwen3-30B-A3B](https://noometry.com/models/qwen3-30b-a3b) |  [![](/logos/alibaba.svg) Alibaba (Qwen)](https://noometry.com/providers/alibaba) | 75.3% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 25 | [o4-mini](https://noometry.com/models/o4-mini) | [OpenAI](https://noometry.com/providers/openai) | 75% | medium | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 26 | [Gemini 2.0 Flash (Feb 2025)](https://noometry.com/models/gemini-2-0-flash) |  [![](/logos/google.svg) Google](https://noometry.com/providers/google) | 73.8% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 27 | [Claude 3.5 Haiku](https://noometry.com/models/claude-3-5-haiku) | [Anthropic](https://noometry.com/providers/anthropic) | 73.5% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 28 | [Grok-3 mini](https://noometry.com/models/grok-3-mini) | [xAI](https://noometry.com/providers/xai) | 73.5% | low | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 29 | [GLM-4.5](https://noometry.com/models/glm-4-5) | [Z.ai (Zhipu)](https://noometry.com/providers/zai) | 73.4% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 30 | [Qwen2.5-Max](https://noometry.com/models/qwen2-5-max) |  [![](/logos/alibaba.svg) Alibaba (Qwen)](https://noometry.com/providers/alibaba) | 72.9% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 31 | [o1](https://noometry.com/models/o1) | [OpenAI](https://noometry.com/providers/openai) | 70.2% | medium | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 32 | [Mistral Large](https://noometry.com/models/mistral-large) |  [![](/logos/mistral.svg) Mistral AI](https://noometry.com/providers/mistral) | 69% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 33 | [GPT-4o mini](https://noometry.com/models/gpt-4o-mini) | [OpenAI](https://noometry.com/providers/openai) | 67.2% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 34 | [o1-mini](https://noometry.com/models/o1-mini) | [OpenAI](https://noometry.com/providers/openai) | 64.9% | medium | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 35 | [Grok-2 (Dec 2024)](https://noometry.com/models/grok-2) | [xAI](https://noometry.com/providers/xai) | 63.6% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 36 | [Phi-4](https://noometry.com/models/phi-4) |  [![](/logos/microsoft.svg) Microsoft](https://noometry.com/providers/microsoft) | 62.6% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 37 | [Llama 4 Maverick](https://noometry.com/models/llama-4-maverick) |  [![](/logos/meta.svg) Meta](https://noometry.com/providers/meta) | 62% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 38 | [o3-mini](https://noometry.com/models/o3-mini) | [OpenAI](https://noometry.com/providers/openai) | 61.7% | high | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 39 | [Amazon Nova Pro](https://noometry.com/models/amazon-nova-pro) | [Amazon](https://noometry.com/providers/amazon) | 60.5% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |

## Compare the leaders

-   [GPT-5 vs Kimi K2 (Jul 2025)](https://noometry.com/compare/gpt-5-vs-kimi-k2)
-   [GPT-5 vs Claude Opus 4.1](https://noometry.com/compare/claude-opus-4-1-vs-gpt-5)
-   [GPT-5 vs o3-pro](https://noometry.com/compare/gpt-5-vs-o3-pro)
-   [GPT-5 vs o3](https://noometry.com/compare/gpt-5-vs-o3)
-   [Kimi K2 (Jul 2025) vs Claude Opus 4.1](https://noometry.com/compare/claude-opus-4-1-vs-kimi-k2)
-   [Kimi K2 (Jul 2025) vs o3-pro](https://noometry.com/compare/kimi-k2-vs-o3-pro)

## Other writing & preference benchmarks

-   [LMArena Text](https://noometry.com/benchmarks/arena-text)
-   [LMArena Creative Writing](https://noometry.com/benchmarks/arena-creative-writing)
-   [EQ-Bench Creative Writing](https://noometry.com/benchmarks/eqbench-creative-writing)
-   [WildBench](https://noometry.com/benchmarks/wildbench)
-   [LMArena Multi-Turn](https://noometry.com/benchmarks/arena-multi-turn)
-   [EQ-Bench 4](https://noometry.com/benchmarks/eqbench-4)
-   [LiveBench Language](https://noometry.com/benchmarks/livebench-language)

## Frequently asked questions

### What does Short-Story Creative Writing measure?

Short stories that must work in required elements, graded by a panel of LLM judges on a 10-point scale (shown here out of 100).

### Which model has the highest Short-Story Creative Writing score?

As of October 2026, GPT-5 has the highest published Short-Story Creative Writing score on Noometry at 86%, out of 39 models with results.

### What is the best open-weight model on Short-Story Creative Writing?

Kimi K2 (Jul 2025) has the highest Short-Story Creative Writing accuracy among open-weight models at 85.6%, ranking 2 of 39 overall.

### Cite this page

Noometry. (2026). Short-Story Creative Writing leaderboard. Retrieved October 10, 2026, from https://noometry.com/benchmarks/lech-mazur-writing

Quote Noometry with a link back to this page. It is also available in [Markdown](https://noometry.com/md/benchmarks/lech-mazur-writing.md).