Model comparison

GPT-5.6 Terra vs Qwen2.5 7B Instruct

GPT-5.6 Terra is the stronger model overall, scoring 59.2 to 29.0 on the Noometry Index. Qwen2.5 7B Instruct costs 15× less per token, which makes it the better buy when GPT-5.6 Terra's lead doesn't matter for your workload.

Last verified . 7 shared benchmarks.

GPT-5.6 Terra OpenAI

59.2

Rank #17 Confirmed

Qwen2.5 7B Instruct Alibaba (Qwen)

29.0

Rank #320 Confirmed

Summary

  • They share 7 benchmarks with published results for both. GPT-5.6 Terra scores higher in 7 categories and Qwen2.5 7B Instruct in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.6 Terra leads 81.6 to 12.6.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 99.7% for GPT-5.6 Terra and 2.5% for Qwen2.5 7B Instruct.
  • Qwen2.5 7B Instruct is cheaper at $0.17 / $0.70 per million input/output tokens, against $2 / $12 for GPT-5.6 Terra.
  • GPT-5.6 Terra accepts more context: 1.05M tokens versus 131K.
  • Qwen2.5 7B Instruct has downloadable open weights; the other is API-only.

Side by side

GPT-5.6 Terra and Qwen2.5 7B Instruct specifications
GPT-5.6 TerraQwen2.5 7B Instruct
ProviderOpenAIAlibaba (Qwen)
Noometry Index59.229.0
Released2026-07-092024-09
WeightsProprietaryOpen
Context window1.05M131K
Max output128K8K
Input $ / M tokens$2$0.17
Output $ / M tokens$12$0.70
Results tracked5215

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.6 Terra leads

GPT-5.6 Terra: 57.7 (#19), Qwen2.5 7B Instruct: 36.5 (#208)

Coding benchmarks
BenchmarkGPT-5.6 TerraQwen2.5 7B Instruct
DeepSWE69.6%—
FrontierCode41.3%—
CursorBench41.3%—
LMArena WebDev1522—
SciCode55%—
WeirdML78.3%—
BigCodeBench Instruct—37.6%
LMArena Coding1484—
BigCodeBench Complete—46.1%
ALE-Bench1,951—

Agentic & Tool Use GPT-5.6 Terra leads

GPT-5.6 Terra: 40.1 (#25), Qwen2.5 7B Instruct: 23.8 (#124)

Agentic & Tool Use benchmarks
BenchmarkGPT-5.6 TerraQwen2.5 7B Instruct
BALROG53.2%7.8%
APEX-Agents58.2%—
GDP.pdf24.7%—
Vending-Bench 27,343—

Reasoning GPT-5.6 Terra leads

GPT-5.6 Terra: 60.7 (#21), Qwen2.5 7B Instruct: 14.8 (#322)

Reasoning benchmarks
BenchmarkGPT-5.6 TerraQwen2.5 7B Instruct
Chess Puzzles54%0%
DTBench93.3%47.7%
LMCA55%6.4%
Epoch Capabilities Index159.62118.51
ARC-AGI-283.9%—
SimpleBench48.9%—
Kagi LLM Benchmark51.3%—
NYT Connections (extended)78.4%—
ARC-AGI-196.5%—
CritPt30%—
LMArena Hard Prompts1468—
Mystery Game Puzzles35%—
Surface Evolver Bench83.8%—

Math GPT-5.6 Terra leads

GPT-5.6 Terra: 81.6 (#12), Qwen2.5 7B Instruct: 12.6 (#306)

Math benchmarks
BenchmarkGPT-5.6 TerraQwen2.5 7B Instruct
OTIS Mock AIME 2024-202599.7%2.5%
FrontierMath (Tiers 1-3)86%—
FrontierMath Tier 470.7%—
ProofBench74%—
Omni-MATH—29.4%
LMArena Math1466—

Knowledge GPT-5.6 Terra leads

GPT-5.6 Terra: 61.2 (#30), Qwen2.5 7B Instruct: 17.0 (#286)

Knowledge benchmarks
BenchmarkGPT-5.6 TerraQwen2.5 7B Instruct
GPQA Diamond93.3%35.5%
SimpleQA Verified43.2%—
MMLU-Pro—53.9%
GPQA (HELM)—34.1%
LMArena Expert1492—
MMLU—72.9%

Multimodal Not comparable

GPT-5.6 Terra: 47.3 (#11), Qwen2.5 7B Instruct: —

Multimodal benchmarks
BenchmarkGPT-5.6 TerraQwen2.5 7B Instruct
LMArena Vision1271—
Blueprint-Bench 230.8%—
Furniture Assembly54.2%—
LMArena Document1472—

Multilingual Not comparable

GPT-5.6 Terra: 54.4 (#44), Qwen2.5 7B Instruct: —

Multilingual benchmarks
BenchmarkGPT-5.6 TerraQwen2.5 7B Instruct
LMArena Non-English1439—
LMArena Chinese1513—
LMArena French1471—
LMArena German1460—
LMArena Japanese1457—
LMArena Korean1425—
LMArena Russian1450—
LMArena Spanish1448—

Instruction Following GPT-5.6 Terra leads

GPT-5.6 Terra: 76.4 (#40), Qwen2.5 7B Instruct: 63.2 (#231)

Instruction Following benchmarks
BenchmarkGPT-5.6 TerraQwen2.5 7B Instruct
IFEval—74.1%
LMArena Instruction Following1454—

Long Context Not comparable

GPT-5.6 Terra: 44.4 (#68), Qwen2.5 7B Instruct: —

Long Context benchmarks
BenchmarkGPT-5.6 TerraQwen2.5 7B Instruct
LMArena Longer Query1451—

Writing & Preference GPT-5.6 Terra leads

GPT-5.6 Terra: 70.2 (#23), Qwen2.5 7B Instruct: 48.8 (#195)

Writing & Preference benchmarks
BenchmarkGPT-5.6 TerraQwen2.5 7B Instruct
LMArena Text1447—
LMArena Creative Writing1410—
EQ-Bench Creative Writing1855—
WildBench—73.1%
EQ-Bench 41234—
LMArena Multi-Turn1449—

Frequently asked questions

Is GPT-5.6 Terra better than Qwen2.5 7B Instruct?

GPT-5.6 Terra is the stronger model overall, scoring 59.2 to 29.0 on the Noometry Index. Qwen2.5 7B Instruct costs 15× less per token, which makes it the better buy when GPT-5.6 Terra's lead doesn't matter for your workload.

Which is cheaper, GPT-5.6 Terra or Qwen2.5 7B Instruct?

Qwen2.5 7B Instruct is cheaper. It lists at $0.17 per million input tokens and $0.70 per million output tokens; GPT-5.6 Terra lists at $2 and $12.

Is GPT-5.6 Terra or Qwen2.5 7B Instruct better for coding?

GPT-5.6 Terra scores higher on coding benchmarks: 57.7 versus 36.5 in the Noometry coding category.

Which has the bigger context window?

GPT-5.6 Terra does, with 1.05M tokens against 131K.

How many benchmarks do GPT-5.6 Terra and Qwen2.5 7B Instruct share?

7 benchmarks have published results for both models. GPT-5.6 Terra has 52 scored results on Noometry and Qwen2.5 7B Instruct has 15.

Related comparisons

Go deeper