Model comparison

GPT-5 Nano vs Qwen3.5-9B

GPT-5 Nano and Qwen3.5-9B score almost the same on the Noometry Index (33.5 vs 33.8), so choose on price, context window or the category you care about most.

Last verified . 7 shared benchmarks.

GPT-5 Nano OpenAI

33.5

Rank #241 Confirmed

Qwen3.5-9B Alibaba (Qwen)

33.8

Rank #236 Confirmed

Summary

  • They share 7 benchmarks with published results for both. GPT-5 Nano scores higher in 1 category and Qwen3.5-9B in 4 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in agentic & tool use, where GPT-5 Nano leads 25.8 to 14.5.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 81.1% for GPT-5 Nano and 61.7% for Qwen3.5-9B.
  • Qwen3.5-9B is cheaper at $0.10 / $0.15 per million input/output tokens, against $0.05 / $0.40 for GPT-5 Nano.
  • GPT-5 Nano accepts more context: 400K tokens versus 262K.
  • Qwen3.5-9B has downloadable open weights; the other is API-only.

Side by side

GPT-5 Nano and Qwen3.5-9B specifications
GPT-5 NanoQwen3.5-9B
ProviderOpenAIAlibaba (Qwen)
Noometry Index33.533.8
Released2025-08-072026-02-23
WeightsProprietaryOpen
Context window400K262K
Max output128K66K
Input $ / M tokens$0.05$0.10
Output $ / M tokens$0.40$0.15
Results tracked4910

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5-9B leads

GPT-5 Nano: 33.6 (#254), Qwen3.5-9B: 35.9 (#217)

Coding benchmarks
BenchmarkGPT-5 NanoQwen3.5-9B
SWE-bench Verified (bash only)34.8%—
SciCode—27.5%
WeirdML38.1%—
LMArena Coding1351—
ALE-Bench718.67—

Agentic & Tool Use GPT-5 Nano leads

GPT-5 Nano: 25.8 (#106), Qwen3.5-9B: 14.5 (#151)

Agentic & Tool Use benchmarks
BenchmarkGPT-5 NanoQwen3.5-9B
Terminal-Bench21.8%9.2%
Berkeley Function Calling Leaderboard51.5%—

Reasoning Qwen3.5-9B leads

GPT-5 Nano: 16.3 (#306), Qwen3.5-9B: 23.1 (#182)

Reasoning benchmarks
BenchmarkGPT-5 NanoQwen3.5-9B
Chess Puzzles27%12%
DTBench62.7%71.2%
LMCA7.9%24.5%
Epoch Capabilities Index139.38139.46
ARC-AGI-22.6%—
Kagi LLM Benchmark62.2%—
ARC-AGI-120.7%—
CritPt—0.3%
LMArena Hard Prompts1328—
Mystery Game Puzzles9%—
ForecastBench59.1—

Math Qwen3.5-9B leads

GPT-5 Nano: 29.4 (#241), Qwen3.5-9B: 34.8 (#192)

Knowledge Qwen3.5-9B leads

GPT-5 Nano: 35.9 (#178), Qwen3.5-9B: 46.0 (#84)

Knowledge benchmarks
BenchmarkGPT-5 NanoQwen3.5-9B
GPQA Diamond69.4%79%
SimpleQA Verified11.7%—
MMLU-Pro77.8%—
Vectara Hallucination Rate10.5%—
GPQA (HELM)67.9%—
LMArena Expert1321—

Multimodal Not comparable

GPT-5 Nano: 31.3 (#108), Qwen3.5-9B: —

Multimodal benchmarks
BenchmarkGPT-5 NanoQwen3.5-9B
LMArena Vision1159—
VPCT37.2%—

Multilingual Not comparable

GPT-5 Nano: 45.3 (#172), Qwen3.5-9B: —

Multilingual benchmarks
BenchmarkGPT-5 NanoQwen3.5-9B
LMArena Non-English1313—
LMArena Chinese1356—
LMArena German1327—
LMArena Japanese1226—
LMArena Korean1269—
LMArena Russian1296—
LMArena Spanish1360—

Instruction Following Not comparable

GPT-5 Nano: 75.0 (#79), Qwen3.5-9B: —

Instruction Following benchmarks
BenchmarkGPT-5 NanoQwen3.5-9B
IFEval93.2%—
LMArena Instruction Following1306—

Long Context Not comparable

GPT-5 Nano: 31.3 (#281), Qwen3.5-9B: —

Long Context benchmarks
BenchmarkGPT-5 NanoQwen3.5-9B
Fiction.LiveBench44.4%—
LMArena Longer Query1312—

Writing & Preference Not comparable

GPT-5 Nano: 39.1 (#249), Qwen3.5-9B: —

Writing & Preference benchmarks
BenchmarkGPT-5 NanoQwen3.5-9B
LMArena Text1320—
LMArena Creative Writing1249—
EQ-Bench Creative Writing705—
WildBench80.6%—
LMArena Multi-Turn1311—

Frequently asked questions

Is GPT-5 Nano better than Qwen3.5-9B?

GPT-5 Nano and Qwen3.5-9B score almost the same on the Noometry Index (33.5 vs 33.8), so choose on price, context window or the category you care about most.

Which is cheaper, GPT-5 Nano or Qwen3.5-9B?

Qwen3.5-9B is cheaper. It lists at $0.10 per million input tokens and $0.15 per million output tokens; GPT-5 Nano lists at $0.05 and $0.40.

Is GPT-5 Nano or Qwen3.5-9B better for coding?

Qwen3.5-9B scores higher on coding benchmarks: 35.9 versus 33.6 in the Noometry coding category.

Which has the bigger context window?

GPT-5 Nano does, with 400K tokens against 262K.

How many benchmarks do GPT-5 Nano and Qwen3.5-9B share?

7 benchmarks have published results for both models. GPT-5 Nano has 49 scored results on Noometry and Qwen3.5-9B has 10.

Related comparisons

Go deeper