Noometry

Model comparison

GPT-5.1 vs Qwen3 Max

GPT-5.1 is the stronger model overall, scoring 49.0 to 43.7 on the Noometry Index.

Last verified . 28 shared benchmarks.

GPT-5.1 OpenAI

49.0

Rank #53 Confirmed

Qwen3 Max Alibaba (Qwen)

43.7

Rank #87 Confirmed

Summary

  • They share 28 benchmarks with published results for both. GPT-5.1 scores higher in 8 categories and Qwen3 Max in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GPT-5.1 leads 39.8 to 22.6.
  • The biggest single-benchmark swing is Chess Puzzles: 32% for GPT-5.1 and 4% for Qwen3 Max.
  • Qwen3 Max is cheaper at $1.20 / $6 per million input/output tokens, against $1.25 / $10 for GPT-5.1.
  • GPT-5.1 accepts more context: 400K tokens versus 262K.

Side by side

GPT-5.1Qwen3 Max
ProviderOpenAIAlibaba (Qwen)
Noometry Index49.043.7
Released2025-11-132025-09-23
WeightsProprietaryProprietary
Context window400K262K
Max output128K66K
Input $ / M tokens$1.25$1.20
Output $ / M tokens$10$6
Results tracked6333

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.1 leads

GPT-5.1: 46.4 (#66), Qwen3 Max: 43.0 (#93)

BenchmarkGPT-5.1Qwen3 Max
LMArena Coding14541456
ALE-Bench1,192370.45
SWE-bench Verified68%—
SWE-bench Verified (bash only)66%—
LMArena WebDev1395—
SciCode43.3%—
GSO13.7%—
WeirdML60.8%—
LiveBench Coding72.5%—

Agentic & Tool Use Not comparable

GPT-5.1: 32.7 (#60), Qwen3 Max: —

BenchmarkGPT-5.1Qwen3 Max
Vending-Bench 21,47371.56
Terminal-Bench47.6%—
DeepResearch Bench42.8%—
LMArena Search1199—

Reasoning GPT-5.1 leads

GPT-5.1: 39.8 (#58), Qwen3 Max: 22.6 (#190)

BenchmarkGPT-5.1Qwen3 Max
Chess Puzzles32%4%
LMArena Hard Prompts14571448
Mystery Game Puzzles19%5%
DTBench90.1%82.1%
LMCA43.9%28.3%
Epoch Capabilities Index149.64142.38
ARC-AGI-217.6%—
SimpleBench53.2%—
Kagi LLM Benchmark—72.5%
NYT Connections (extended)—30.1%
ARC-AGI-172.8%—
CritPt4.9%—
EnigmaEval11.2%—
LiveBench Reasoning95.8%—
LiveBench Data Analysis72.1%—
ForecastBench58.1—
LiveBench78.8%—

Math GPT-5.1 leads

GPT-5.1: 52.2 (#51), Qwen3 Max: 38.7 (#131)

BenchmarkGPT-5.1Qwen3 Max
OTIS Mock AIME 2024-202588.6%73.3%
LMArena Math14471446
FrontierMath (Tiers 1-3)—18.9%
Omni-MATH46.4%—
LiveBench Math94.5%—
MATH Level 5—97.1%
FrontierMath (Feb 2025 set)31%—
FrontierMath Tier 4 (v1)12.5%—

Knowledge GPT-5.1 leads

GPT-5.1: 50.6 (#71), Qwen3 Max: 48.1 (#78)

BenchmarkGPT-5.1Qwen3 Max
GPQA Diamond87.6%72.6%
SimpleQA Verified48%48.7%
LMArena Expert14701455
Humanity's Last Exam23.7%—
MMLU-Pro57.9%—
Vectara Hallucination Rate10.9%—
GPQA (HELM)44.2%—

Multimodal Not comparable

GPT-5.1: 44.8 (#19), Qwen3 Max: —

BenchmarkGPT-5.1Qwen3 Max
LMArena Vision1250—
VPCT58.7%—
LMArena Document1403—

Multilingual Too close to call

GPT-5.1: 53.8 (#56), Qwen3 Max: 53.7 (#62)

BenchmarkGPT-5.1Qwen3 Max
LMArena Non-English14311429
LMArena Chinese14951478
LMArena French14501449
LMArena German14381463
LMArena Japanese14531397
LMArena Korean14011399
LMArena Russian14351428
LMArena Spanish14331462

Instruction Following GPT-5.1 leads

GPT-5.1: 83.9 (#1), Qwen3 Max: 74.8 (#87)

BenchmarkGPT-5.1Qwen3 Max
LMArena Instruction Following14431419
LiveBench Instruction Following93.3%—
IFEval93.5%—

Long Context GPT-5.1 leads

GPT-5.1: 47.6 (#14), Qwen3 Max: 41.6 (#134)

BenchmarkGPT-5.1Qwen3 Max
CL-bench23.7%14.5%
LMArena Longer Query14471438
Fiction.LiveBench—66.7%
CL-bench Life17.3%—

Writing & Preference GPT-5.1 leads

GPT-5.1: 64.5 (#55), Qwen3 Max: 62.4 (#76)

BenchmarkGPT-5.1Qwen3 Max
LMArena Text14431439
LMArena Creative Writing14271402
LMArena Multi-Turn14501446
WildBench86.3%—
LiveBench Language80.2%—

Frequently asked questions

Is GPT-5.1 better than Qwen3 Max?

GPT-5.1 is the stronger model overall, scoring 49.0 to 43.7 on the Noometry Index.

Which is cheaper, GPT-5.1 or Qwen3 Max?

Qwen3 Max is cheaper. It lists at $1.20 per million input tokens and $6 per million output tokens; GPT-5.1 lists at $1.25 and $10.

Is GPT-5.1 or Qwen3 Max better for coding?

GPT-5.1 scores higher on coding benchmarks: 46.4 versus 43.0 in the Noometry coding category.

Which has the bigger context window?

GPT-5.1 does, with 400K tokens against 262K.

How many benchmarks do GPT-5.1 and Qwen3 Max share?

28 benchmarks have published results for both models. GPT-5.1 has 63 scored results on Noometry and Qwen3 Max has 33.

Related comparisons

Go deeper