Noometry

Model comparison

GPT-5.4 nano vs Qwen Plus

GPT-5.4 nano is the stronger model overall, scoring 41.9 to 36.7 on the Noometry Index.

Last verified . 19 shared benchmarks.

GPT-5.4 nano OpenAI

41.9

Rank #111 Confirmed

Qwen Plus Alibaba (Qwen)

36.7

Rank #204 Confirmed

Summary

  • They share 19 benchmarks with published results for both. GPT-5.4 nano scores higher in 7 categories and Qwen Plus in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.4 nano leads 40.7 to 22.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 87.8% for GPT-5.4 nano and 17.8% for Qwen Plus.
  • GPT-5.4 nano is cheaper at $0.20 / $1.25 per million input/output tokens, against $0.40 / $1.20 for Qwen Plus.
  • Qwen Plus accepts more context: 1M tokens versus 400K.

Side by side

GPT-5.4 nanoQwen Plus
ProviderOpenAIAlibaba (Qwen)
Noometry Index41.936.7
Released2026-03-172024-01-25
WeightsProprietaryProprietary
Context window400K1M
Max output128K33K
Input $ / M tokens$0.20$0.40
Output $ / M tokens$1.25$1.20
Results tracked4020

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.4 nano leads

GPT-5.4 nano: 43.1 (#82), Qwen Plus: 38.3 (#163)

BenchmarkGPT-5.4 nanoQwen Plus
LMArena Coding14041328
SciCode46.9%—
WeirdML49.2%—
ALE-Bench1,005—

Reasoning Qwen Plus leads

GPT-5.4 nano: 23.8 (#159), Qwen Plus: 27.6 (#101)

BenchmarkGPT-5.4 nanoQwen Plus
Kagi LLM Benchmark39.7%63.3%
LMArena Hard Prompts13801317
DTBench80.3%81.1%
LMCA36.9%24%
ARC-AGI-25.7%—
ARC-AGI-151.5%—
CritPt9.3%—
Chess Puzzles30%—
Mystery Game Puzzles9%—
Epoch Capabilities Index145.78—
ForecastBench57.3—

Math GPT-5.4 nano leads

GPT-5.4 nano: 40.7 (#76), Qwen Plus: 22.0 (#266)

BenchmarkGPT-5.4 nanoQwen Plus
OTIS Mock AIME 2024-202587.8%17.8%
LMArena Math14061326
FrontierMath (Feb 2025 set)25.9%1.7%
FrontierMath (Tiers 1-3)44.9%—
FrontierMath Tier 412.2%—
ProofBench5%—
MATH Level 5—65.3%
FrontierMath Tier 4 (v1)6.3%—

Knowledge GPT-5.4 nano leads

GPT-5.4 nano: 41.8 (#94), Qwen Plus: 27.4 (#245)

BenchmarkGPT-5.4 nanoQwen Plus
GPQA Diamond78.5%48.1%
LMArena Expert13971328
SimpleQA Verified11.7%—
Vectara Hallucination Rate3.1%—

Multimodal Not comparable

GPT-5.4 nano: 36.0 (#73), Qwen Plus: —

BenchmarkGPT-5.4 nanoQwen Plus
LMArena Vision1196—

Multilingual GPT-5.4 nano leads

GPT-5.4 nano: 48.8 (#136), Qwen Plus: 45.3 (#170)

BenchmarkGPT-5.4 nanoQwen Plus
LMArena Non-English13591310
LMArena Chinese13911347
LMArena Japanese13421251
LMArena Russian13631323
LMArena French1396—
LMArena German1368—
LMArena Korean1321—
LMArena Spanish1368—

Instruction Following GPT-5.4 nano leads

GPT-5.4 nano: 72.1 (#139), Qwen Plus: 69.0 (#176)

BenchmarkGPT-5.4 nanoQwen Plus
LMArena Instruction Following13621303

Long Context GPT-5.4 nano leads

GPT-5.4 nano: 41.6 (#131), Qwen Plus: 40.3 (#153)

BenchmarkGPT-5.4 nanoQwen Plus
LMArena Longer Query13651325

Writing & Preference GPT-5.4 nano leads

GPT-5.4 nano: 55.9 (#137), Qwen Plus: 52.4 (#171)

BenchmarkGPT-5.4 nanoQwen Plus
LMArena Text13721326
LMArena Creative Writing13131293
LMArena Multi-Turn13821336

Frequently asked questions

Is GPT-5.4 nano better than Qwen Plus?

GPT-5.4 nano is the stronger model overall, scoring 41.9 to 36.7 on the Noometry Index.

Which is cheaper, GPT-5.4 nano or Qwen Plus?

GPT-5.4 nano is cheaper. It lists at $0.20 per million input tokens and $1.25 per million output tokens; Qwen Plus lists at $0.40 and $1.20.

Is GPT-5.4 nano or Qwen Plus better for coding?

GPT-5.4 nano scores higher on coding benchmarks: 43.1 versus 38.3 in the Noometry coding category.

Which has the bigger context window?

Qwen Plus does, with 1M tokens against 400K.

How many benchmarks do GPT-5.4 nano and Qwen Plus share?

19 benchmarks have published results for both models. GPT-5.4 nano has 40 scored results on Noometry and Qwen Plus has 20.

Related comparisons

Go deeper