Model comparison

GPT-5.2 vs Qwen2.5 14B Instruct

GPT-5.2 has enough public results to be ranked (#31); Qwen2.5 14B Instruct does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

GPT-5.2 OpenAI

54.1

Rank #31 Confirmed

Summary

  • The widest gap is in coding, where GPT-5.2 leads 52.2 to 37.1.
  • Qwen2.5 14B Instruct is cheaper at $0.35 / $1.40 per million input/output tokens, against $1.75 / $14 for GPT-5.2.
  • GPT-5.2 accepts more context: 400K tokens versus 131K.
  • Qwen2.5 14B Instruct has downloadable open weights; the other is API-only.

Side by side

GPT-5.2 and Qwen2.5 14B Instruct specifications
GPT-5.2Qwen2.5 14B Instruct
ProviderOpenAIAlibaba (Qwen)
Noometry Index54.138.2
Released2025-12-112024-09
WeightsProprietaryOpen
Context window400K131K
Max output128K8K
Input $ / M tokens$1.75$0.35
Output $ / M tokens$14$1.40
Results tracked673

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.2 leads

GPT-5.2: 52.2 (#32), Qwen2.5 14B Instruct: 37.1 (#187)

Coding benchmarks
BenchmarkGPT-5.2Qwen2.5 14B Instruct
SWE-bench Verified73.8%—
SWE-bench Verified (bash only)72.8%—
LMArena WebDev1415—
SWE-bench Multilingual66.7%—
GSO27.4%—
WeirdML72.2%—
BigCodeBench Instruct—39.8%
LMArena Coding1447—
BigCodeBench Complete—52.2%
ALE-Bench1,294—
AlgoTune2.05—

Agentic & Tool Use Not comparable

GPT-5.2: 40.0 (#24), Qwen2.5 14B Instruct: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.2Qwen2.5 14B Instruct
Terminal-Bench64.9%—
Berkeley Function Calling Leaderboard55.9%—
GDPval49.7%—
Remote Labor Index2.5%—
τ²-bench Airline83%—
τ²-bench Banking32.2%—
τ²-bench Retail81.6%—
τ²-bench Telecom89.7%—
DeepResearch Bench41.1%—
LMArena Search1207—
METR Time Horizons75.3%—
Vending-Bench 23,591—

Reasoning Not comparable

GPT-5.2: 50.1 (#33), Qwen2.5 14B Instruct: —

Reasoning benchmarks
BenchmarkGPT-5.2Qwen2.5 14B Instruct
ARC-AGI-252.9%—
SimpleBench45.8%—
Kagi LLM Benchmark73.3%—
NYT Connections (extended)83.6%—
ARC-AGI-186.2%—
Chess Puzzles49%—
EnigmaEval10.4%—
EBR-Bench23%—
LMArena Hard Prompts1445—
Mystery Game Puzzles23%—
DTBench90.9%—
LMCA43.9%—
Epoch Capabilities Index153.45—
ForecastBench60.1—

Math Not comparable

GPT-5.2: 59.8 (#32), Qwen2.5 14B Instruct: —

Knowledge Not comparable

GPT-5.2: 59.2 (#29), Qwen2.5 14B Instruct: —

Knowledge benchmarks
BenchmarkGPT-5.2Qwen2.5 14B Instruct
GPQA Diamond91.4%—
Humanity's Last Exam27.8%—
SimpleQA Verified37.1%—
Vectara Hallucination Rate8.4%—
LMArena Expert1445—
MMLU—79.9%

Multimodal Not comparable

GPT-5.2: 50.9 (#7), Qwen2.5 14B Instruct: —

Multimodal benchmarks
BenchmarkGPT-5.2Qwen2.5 14B Instruct
LMArena Vision1268—
VPCT84%—
Furniture Assembly38.3%—
LMArena Document1405—

Multilingual Not comparable

GPT-5.2: 53.6 (#63), Qwen2.5 14B Instruct: —

Multilingual benchmarks
BenchmarkGPT-5.2Qwen2.5 14B Instruct
LMArena Non-English1425—
LMArena Chinese1460—
LMArena French1456—
LMArena German1448—
LMArena Japanese1421—
LMArena Korean1390—
LMArena Russian1440—
LMArena Spanish1433—

Instruction Following Not comparable

GPT-5.2: 74.9 (#83), Qwen2.5 14B Instruct: —

Instruction Following benchmarks
BenchmarkGPT-5.2Qwen2.5 14B Instruct
LMArena Instruction Following1417—

Long Context Not comparable

GPT-5.2: 44.0 (#74), Qwen2.5 14B Instruct: —

Long Context benchmarks
BenchmarkGPT-5.2Qwen2.5 14B Instruct
CL-bench18.2%—
LMArena Longer Query1428—

Writing & Preference Not comparable

GPT-5.2: 67.0 (#30), Qwen2.5 14B Instruct: —

Writing & Preference benchmarks
BenchmarkGPT-5.2Qwen2.5 14B Instruct
LMArena Text1439—
LMArena Creative Writing1402—
EQ-Bench Creative Writing1703—
LMArena Multi-Turn1458—

Frequently asked questions

Is GPT-5.2 better than Qwen2.5 14B Instruct?

GPT-5.2 has enough public results to be ranked (#31); Qwen2.5 14B Instruct does not yet, so treat this comparison as directional.

Which is cheaper, GPT-5.2 or Qwen2.5 14B Instruct?

Qwen2.5 14B Instruct is cheaper. It lists at $0.35 per million input tokens and $1.40 per million output tokens; GPT-5.2 lists at $1.75 and $14.

Is GPT-5.2 or Qwen2.5 14B Instruct better for coding?

GPT-5.2 scores higher on coding benchmarks: 52.2 versus 37.1 in the Noometry coding category.

Which has the bigger context window?

GPT-5.2 does, with 400K tokens against 131K.

How many benchmarks do GPT-5.2 and Qwen2.5 14B Instruct share?

0 benchmarks have published results for both models. GPT-5.2 has 67 scored results on Noometry and Qwen2.5 14B Instruct has 3.

Related comparisons

Go deeper