Noometry

Model comparison

GPT-5.4 nano vs Qwen3.6 Flash

GPT-5.4 nano is the stronger model overall, scoring 41.9 to 38.8 on the Noometry Index.

Last verified . 12 shared benchmarks.

GPT-5.4 nano OpenAI

41.9

Rank #125 Confirmed

Qwen3.6 Flash Alibaba (Qwen)

38.8

Rank #182 Confirmed

Summary

  • They share 12 benchmarks with published results for both. GPT-5.4 nano scores higher in 1 category and Qwen3.6 Flash in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Qwen3.6 Flash leads 29.0 to 23.7.
  • The biggest single-benchmark swing is FrontierMath (Tiers 1-3): 44.9% for GPT-5.4 nano and 22.5% for Qwen3.6 Flash.
  • Qwen3.6 Flash is cheaper at $0.19 / $1.13 per million input/output tokens, against $0.20 / $1.25 for GPT-5.4 nano.
  • Qwen3.6 Flash accepts more context: 1M tokens versus 400K.

Side by side

GPT-5.4 nanoQwen3.6 Flash
ProviderOpenAIAlibaba (Qwen)
Noometry Index41.938.8
Released2026-03-172026-04-27
WeightsProprietaryProprietary
Context window400K1M
Max output128K66K
Input $ / M tokens$0.20$0.19
Output $ / M tokens$1.25$1.13
Results tracked4013

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

GPT-5.4 nano: 43.6 (#84), Qwen3.6 Flash: —

BenchmarkGPT-5.4 nanoQwen3.6 Flash
ALE-Bench1,005326.4
SciCode46.9%—
WeirdML49.2%—
LMArena Coding1405—

Reasoning Qwen3.6 Flash leads

GPT-5.4 nano: 23.7 (#173), Qwen3.6 Flash: 29.0 (#96)

BenchmarkGPT-5.4 nanoQwen3.6 Flash
Chess Puzzles30%20%
Mystery Game Puzzles9%18%
DTBench80.3%77.1%
LMCA36.9%31%
Epoch Capabilities Index145.81143.26
ARC-AGI-25.7%—
SimpleBench—35.2%
Kagi LLM Benchmark39.7%—
ARC-AGI-151.5%—
CritPt9.3%—
LMArena Hard Prompts1381—
ForecastBench57.3—

Math GPT-5.4 nano leads

GPT-5.4 nano: 40.9 (#88), Qwen3.6 Flash: 39.0 (#117)

BenchmarkGPT-5.4 nanoQwen3.6 Flash
FrontierMath (Tiers 1-3)44.9%22.5%
OTIS Mock AIME 2024-202587.8%84.4%
FrontierMath (Feb 2025 set)25.9%10.3%
FrontierMath Tier 4 (v1)6.3%0%
FrontierMath Tier 412.2%—
ProofBench5%—
LMArena Math1406—

Knowledge Too close to call

GPT-5.4 nano: 41.9 (#103), Qwen3.6 Flash: 42.1 (#100)

BenchmarkGPT-5.4 nanoQwen3.6 Flash
GPQA Diamond78.5%83.3%
SimpleQA Verified11.7%15.9%
Vectara Hallucination Rate3.1%—
LMArena Expert1396—

Multimodal Not comparable

GPT-5.4 nano: 36.7 (#78), Qwen3.6 Flash: —

BenchmarkGPT-5.4 nanoQwen3.6 Flash
LMArena Vision1196—

Multilingual Not comparable

GPT-5.4 nano: 48.6 (#140), Qwen3.6 Flash: —

BenchmarkGPT-5.4 nanoQwen3.6 Flash
LMArena Non-English1359—
LMArena Chinese1392—
LMArena French1396—
LMArena German1367—
LMArena Japanese1343—
LMArena Korean1320—
LMArena Russian1363—
LMArena Spanish1371—

Instruction Following Not comparable

GPT-5.4 nano: 71.9 (#144), Qwen3.6 Flash: —

BenchmarkGPT-5.4 nanoQwen3.6 Flash
LMArena Instruction Following1362—

Long Context Not comparable

GPT-5.4 nano: 41.6 (#137), Qwen3.6 Flash: —

BenchmarkGPT-5.4 nanoQwen3.6 Flash
LMArena Longer Query1366—

Writing & Preference Not comparable

GPT-5.4 nano: 55.7 (#142), Qwen3.6 Flash: —

BenchmarkGPT-5.4 nanoQwen3.6 Flash
LMArena Text1372—
LMArena Creative Writing1314—
LMArena Multi-Turn1382—

Frequently asked questions

Is GPT-5.4 nano better than Qwen3.6 Flash?

GPT-5.4 nano is the stronger model overall, scoring 41.9 to 38.8 on the Noometry Index.

Which is cheaper, GPT-5.4 nano or Qwen3.6 Flash?

Qwen3.6 Flash is cheaper. It lists at $0.19 per million input tokens and $1.13 per million output tokens; GPT-5.4 nano lists at $0.20 and $1.25.

Which has the bigger context window?

Qwen3.6 Flash does, with 1M tokens against 400K.

How many benchmarks do GPT-5.4 nano and Qwen3.6 Flash share?

12 benchmarks have published results for both models. GPT-5.4 nano has 40 scored results on Noometry and Qwen3.6 Flash has 13.

Related comparisons

Go deeper