Model comparison

GPT-5.4 nano vs Qwen3.7 Plus

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 41.9 on the Noometry Index. GPT-5.4 nano costs 1.5× less per token, which makes it the better buy when Qwen3.7 Plus's lead doesn't matter for your workload.

Last verified October 12, 2026. 28 shared benchmarks.

GPT-5.4 nano OpenAI

41.9

Rank #125 Confirmed

Qwen3.7 Plus

Alibaba (Qwen)

45.3

Rank #72 Confirmed

Summary

They share 28 benchmarks with published results for both. GPT-5.4 nano scores higher in 1 category and Qwen3.7 Plus in 8 categories; 9 gaps are clear of the uncertainty.
The widest gap is in reasoning, where Qwen3.7 Plus leads 39.3 to 23.7.
The biggest single-benchmark swing is FrontierMath (Tiers 1-3): 44.9% for GPT-5.4 nano and 34.4% for Qwen3.7 Plus.
GPT-5.4 nano is cheaper at $0.20 / $1.25 per million input/output tokens, against $0.40 / $1.60 for Qwen3.7 Plus.
Qwen3.7 Plus accepts more context: 1M tokens versus 400K.

Side by side

GPT-5.4 nano and Qwen3.7 Plus specifications
	GPT-5.4 nano	Qwen3.7 Plus
Provider	OpenAI	Alibaba (Qwen)
Noometry Index	41.9	45.3
Released	2026-03-17	2026-06-02
Weights	Proprietary	Proprietary
Context window	400K	1M
Max output	128K	131K
Input $ / M tokens	$0.20	$0.40
Output $ / M tokens	$1.25	$1.60
Results tracked	40	32

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.4 nano leads

GPT-5.4 nano: 43.6 (#84), Qwen3.7 Plus: 36.6 (#206)

Coding benchmarks
Benchmark	GPT-5.4 nano	Qwen3.7 Plus
SciCode	46.9%	45.5%
LMArena Coding	1405	1473
FrontierCode	—	10.2%
WeirdML	49.2%	—
ALE-Bench	1,005	—

Agentic & Tool Use Not comparable

GPT-5.4 nano: —, Qwen3.7 Plus: 21.4 (#138)

Agentic & Tool Use benchmarks
Benchmark	GPT-5.4 nano	Qwen3.7 Plus
OSWorld 2.0	—	2.8%

Reasoning Qwen3.7 Plus leads

GPT-5.4 nano: 23.7 (#173), Qwen3.7 Plus: 39.3 (#59)

Reasoning benchmarks
Benchmark	GPT-5.4 nano	Qwen3.7 Plus
CritPt	9.3%	9.1%
Chess Puzzles	30%	24%
LMArena Hard Prompts	1381	1460
Mystery Game Puzzles	9%	17%
DTBench	80.3%	84%
LMCA	36.9%	37.6%
Epoch Capabilities Index	145.81	147.37
ARC-AGI-2	5.7%	—
Kagi LLM Benchmark	39.7%	—
NYT Connections (extended)	—	74.8%
ARC-AGI-1	51.5%	—
ForecastBench	57.3	—

Math Qwen3.7 Plus leads

GPT-5.4 nano: 40.9 (#88), Qwen3.7 Plus: 50.5 (#56)

Math benchmarks
Benchmark	GPT-5.4 nano	Qwen3.7 Plus
FrontierMath (Tiers 1-3)	44.9%	34.4%
OTIS Mock AIME 2024-2025	87.8%	93.3%
LMArena Math	1406	1466
FrontierMath Tier 4	12.2%	—
ProofBench	5%	—
FrontierMath (Feb 2025 set)	25.9%	—
FrontierMath Tier 4 (v1)	6.3%	—

Knowledge Qwen3.7 Plus leads

GPT-5.4 nano: 41.9 (#103), Qwen3.7 Plus: 54.9 (#51)

Knowledge benchmarks
Benchmark	GPT-5.4 nano	Qwen3.7 Plus
GPQA Diamond	78.5%	87.9%
LMArena Expert	1396	1467
SimpleQA Verified	11.7%	—
Vectara Hallucination Rate	3.1%	—

Multimodal Qwen3.7 Plus leads

GPT-5.4 nano: 36.7 (#78), Qwen3.7 Plus: 41.8 (#33)

Multimodal benchmarks
Benchmark	GPT-5.4 nano	Qwen3.7 Plus
LMArena Vision	1196	1279
LMArena Document	—	1444

Multilingual Qwen3.7 Plus leads

GPT-5.4 nano: 48.6 (#140), Qwen3.7 Plus: 54.8 (#38)

Multilingual benchmarks
Benchmark	GPT-5.4 nano	Qwen3.7 Plus
LMArena Non-English	1359	1445
LMArena Chinese	1392	1510
LMArena French	1396	1473
LMArena German	1367	1471
LMArena Japanese	1343	1413
LMArena Korean	1320	1415
LMArena Russian	1363	1457
LMArena Spanish	1371	1457

Instruction Following Qwen3.7 Plus leads

GPT-5.4 nano: 71.9 (#144), Qwen3.7 Plus: 75.8 (#52)

Instruction Following benchmarks
Benchmark	GPT-5.4 nano	Qwen3.7 Plus
LMArena Instruction Following	1362	1440

Long Context Qwen3.7 Plus leads

GPT-5.4 nano: 41.6 (#137), Qwen3.7 Plus: 44.5 (#65)

Long Context benchmarks
Benchmark	GPT-5.4 nano	Qwen3.7 Plus
LMArena Longer Query	1366	1455

Writing & Preference Qwen3.7 Plus leads

GPT-5.4 nano: 55.7 (#142), Qwen3.7 Plus: 64.3 (#56)

Writing & Preference benchmarks
Benchmark	GPT-5.4 nano	Qwen3.7 Plus
LMArena Text	1372	1455
LMArena Creative Writing	1314	1439
LMArena Multi-Turn	1382	1460

Frequently asked questions

Is GPT-5.4 nano better than Qwen3.7 Plus?

Which is cheaper, GPT-5.4 nano or Qwen3.7 Plus?

GPT-5.4 nano is cheaper. It lists at $0.20 per million input tokens and $1.25 per million output tokens; Qwen3.7 Plus lists at $0.40 and $1.60.

Is GPT-5.4 nano or Qwen3.7 Plus better for coding?

GPT-5.4 nano scores higher on coding benchmarks: 43.6 versus 36.6 in the Noometry coding category.

Which has the bigger context window?

Qwen3.7 Plus does, with 1M tokens against 400K.

How many benchmarks do GPT-5.4 nano and Qwen3.7 Plus share?

28 benchmarks have published results for both models. GPT-5.4 nano has 40 scored results on Noometry and Qwen3.7 Plus has 32.