Model comparison

GPT-5.1-Codex vs Qwen2.5-Max

Qwen2.5-Max is the stronger model overall, scoring 40.1 to 38.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

GPT-5.1-Codex OpenAI

38.2

Rank #178 Reported

Qwen2.5-Max Alibaba (Qwen)

40.1

Rank #142 Confirmed

Summary

  • The widest gap is in math, where Qwen2.5-Max leads 34.3 to 29.3.

Side by side

GPT-5.1-Codex and Qwen2.5-Max specifications
GPT-5.1-CodexQwen2.5-Max
ProviderOpenAIAlibaba (Qwen)
Noometry Index38.240.1
Released2025-11-122025-01-25
WeightsProprietaryProprietary
Context window400K—
Max output128K—
Input $ / M tokens$1.25—
Output $ / M tokens$10—
Results tracked627

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

GPT-5.1-Codex: 41.7 (#107), Qwen2.5-Max: 41.2 (#118)

Coding benchmarks
BenchmarkGPT-5.1-CodexQwen2.5-Max
SWE-bench Verified (bash only)66%—
LMArena WebDev1337—
LiveBench Coding—64.4%
LMArena Coding—1359
ALE-Bench1,245—

Agentic & Tool Use Not comparable

GPT-5.1-Codex: 37.8 (#32), Qwen2.5-Max: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.1-CodexQwen2.5-Max
Terminal-Bench60.4%—
METR Time Horizons70.8%—

Reasoning Not comparable

GPT-5.1-Codex: —, Qwen2.5-Max: 24.6 (#144)

Reasoning benchmarks
BenchmarkGPT-5.1-CodexQwen2.5-Max
LiveBench Reasoning—51.4%
LMArena Hard Prompts—1360
LiveBench Data Analysis—67.9%
Epoch Capabilities Index—132.54
LiveBench—62.3%

Math Qwen2.5-Max leads

GPT-5.1-Codex: 29.3 (#218), Qwen2.5-Max: 34.3 (#162)

Math benchmarks
BenchmarkGPT-5.1-CodexQwen2.5-Max
ProofBench9%—
LiveBench Math—58.4%
LMArena Math—1369

Knowledge Not comparable

GPT-5.1-Codex: —, Qwen2.5-Max: 34.8 (#181)

Knowledge benchmarks
BenchmarkGPT-5.1-CodexQwen2.5-Max
Confabulations—21.8%
LMArena Expert—1337

Multilingual Not comparable

GPT-5.1-Codex: —, Qwen2.5-Max: 48.3 (#140)

Multilingual benchmarks
BenchmarkGPT-5.1-CodexQwen2.5-Max
LMArena Non-English—1352
LMArena Chinese—1382
LMArena French—1396
LMArena German—1350
LMArena Japanese—1299
LMArena Korean—1304
LMArena Russian—1353
LMArena Spanish—1377

Instruction Following Not comparable

GPT-5.1-Codex: —, Qwen2.5-Max: 71.5 (#147)

Instruction Following benchmarks
BenchmarkGPT-5.1-CodexQwen2.5-Max
LiveBench Instruction Following—75.3%
LMArena Instruction Following—1335

Long Context Not comparable

GPT-5.1-Codex: —, Qwen2.5-Max: 41.3 (#137)

Long Context benchmarks
BenchmarkGPT-5.1-CodexQwen2.5-Max
LMArena Longer Query—1358

Writing & Preference Not comparable

GPT-5.1-Codex: —, Qwen2.5-Max: 55.6 (#141)

Writing & Preference benchmarks
BenchmarkGPT-5.1-CodexQwen2.5-Max
LMArena Text—1367
LMArena Creative Writing—1339
Short-Story Creative Writing—72.9%
LMArena Multi-Turn—1364
LiveBench Language—56.3%

Frequently asked questions

Is GPT-5.1-Codex better than Qwen2.5-Max?

Qwen2.5-Max is the stronger model overall, scoring 40.1 to 38.2 on the Noometry Index.

Is GPT-5.1-Codex or Qwen2.5-Max better for coding?

They score almost the same on coding (41.7 vs 41.2); test both on your own repository before choosing.

How many benchmarks do GPT-5.1-Codex and Qwen2.5-Max share?

0 benchmarks have published results for both models. GPT-5.1-Codex has 6 scored results on Noometry and Qwen2.5-Max has 27.

Related comparisons

Go deeper