Model comparison

GPT-5.1-Codex vs Qwen Max

GPT-5.1-Codex is the stronger model overall, scoring 38.6 to 34.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

GPT-5.1-Codex OpenAI

38.6

Rank #186 Reported

Qwen Max Alibaba (Qwen)

34.7

Rank #230 Confirmed

Summary

  • The widest gap is in coding, where GPT-5.1-Codex leads 41.9 to 30.7.
  • Qwen Max is cheaper at $1.60 / $6.40 per million input/output tokens, against $1.25 / $10 for GPT-5.1-Codex.
  • GPT-5.1-Codex accepts more context: 400K tokens versus 33K.

Side by side

GPT-5.1-Codex and Qwen Max specifications
GPT-5.1-CodexQwen Max
ProviderOpenAIAlibaba (Qwen)
Noometry Index38.634.7
Released2025-11-122024-04-03
WeightsProprietaryProprietary
Context window400K33K
Max output128K8K
Input $ / M tokens$1.25$1.60
Output $ / M tokens$10$6.40
Results tracked623

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.1-Codex leads

GPT-5.1-Codex: 41.9 (#116), Qwen Max: 30.7 (#292)

Coding benchmarks
BenchmarkGPT-5.1-CodexQwen Max
SWE-bench Verified (bash only)66%—
Aider Polyglot—21.8%
LMArena WebDev1337—
LMArena Coding—1288
ALE-Bench1,245—

Agentic & Tool Use Not comparable

GPT-5.1-Codex: 38.0 (#33), Qwen Max: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.1-CodexQwen Max
Terminal-Bench60.4%—
METR Time Horizons70.8%—

Reasoning Not comparable

GPT-5.1-Codex: —, Qwen Max: 25.1 (#151)

Reasoning benchmarks
BenchmarkGPT-5.1-CodexQwen Max
LMArena Hard Prompts—1269

Math GPT-5.1-Codex leads

GPT-5.1-Codex: 30.3 (#235), Qwen Max: 22.3 (#276)

Math benchmarks
BenchmarkGPT-5.1-CodexQwen Max
OTIS Mock AIME 2024-2025—16.1%
ProofBench9%—
LMArena Math—1275
MATH Level 5—67.2%
FrontierMath (Feb 2025 set)—1%

Knowledge Not comparable

GPT-5.1-Codex: —, Qwen Max: 30.3 (#228)

Knowledge benchmarks
BenchmarkGPT-5.1-CodexQwen Max
GPQA Diamond—56.1%
LMArena Expert—1248

Multilingual Not comparable

GPT-5.1-Codex: —, Qwen Max: 41.8 (#202)

Multilingual benchmarks
BenchmarkGPT-5.1-CodexQwen Max
LMArena Non-English—1263
LMArena Chinese—1254
LMArena French—1330
LMArena German—1254
LMArena Japanese—1205
LMArena Korean—1142
LMArena Russian—1274
LMArena Spanish—1290

Instruction Following Not comparable

GPT-5.1-Codex: —, Qwen Max: 66.5 (#208)

Instruction Following benchmarks
BenchmarkGPT-5.1-CodexQwen Max
LMArena Instruction Following—1262

Long Context Not comparable

GPT-5.1-Codex: —, Qwen Max: 39.4 (#180)

Long Context benchmarks
BenchmarkGPT-5.1-CodexQwen Max
Fiction.LiveBench—66.7%
LMArena Longer Query—1288

Writing & Preference Not comparable

GPT-5.1-Codex: —, Qwen Max: 47.8 (#205)

Writing & Preference benchmarks
BenchmarkGPT-5.1-CodexQwen Max
LMArena Text—1282
LMArena Creative Writing—1248
LMArena Multi-Turn—1277

Frequently asked questions

Is GPT-5.1-Codex better than Qwen Max?

GPT-5.1-Codex is the stronger model overall, scoring 38.6 to 34.7 on the Noometry Index.

Which is cheaper, GPT-5.1-Codex or Qwen Max?

Qwen Max is cheaper. It lists at $1.60 per million input tokens and $6.40 per million output tokens; GPT-5.1-Codex lists at $1.25 and $10.

Is GPT-5.1-Codex or Qwen Max better for coding?

GPT-5.1-Codex scores higher on coding benchmarks: 41.9 versus 30.7 in the Noometry coding category.

Which has the bigger context window?

GPT-5.1-Codex does, with 400K tokens against 33K.

How many benchmarks do GPT-5.1-Codex and Qwen Max share?

0 benchmarks have published results for both models. GPT-5.1-Codex has 6 scored results on Noometry and Qwen Max has 23.

Related comparisons

Go deeper