Model comparison

Amazon Nova Pro vs Qwen3.5 27B

Qwen3.5 27B is the stronger model overall, scoring 41.4 to 30.5 on the Noometry Index.

Last verified . 19 shared benchmarks.

Amazon Nova Pro Amazon

30.5

Rank #278 Confirmed

Qwen3.5 27B Alibaba (Qwen)

41.4

Rank #127 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Amazon Nova Pro scores higher in 0 categories and Qwen3.5 27B in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3.5 27B leads 59.5 to 44.1.
  • The biggest single-benchmark swing is Vectara Hallucination Rate: 5.1% for Amazon Nova Pro and 12.1% for Qwen3.5 27B.
  • Qwen3.5 27B is cheaper at $0.30 / $2.40 per million input/output tokens, against $0.80 / $3.20 for Amazon Nova Pro.
  • Amazon Nova Pro accepts more context: 300K tokens versus 262K.
  • Qwen3.5 27B has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Pro and Qwen3.5 27B specifications
Amazon Nova ProQwen3.5 27B
ProviderAmazonAlibaba (Qwen)
Noometry Index30.541.4
Released2024-12-032026-02-23
WeightsProprietaryOpen
Context window300K262K
Max output10K66K
Input $ / M tokens$0.80$0.30
Output $ / M tokens$3.20$2.40
Results tracked3828

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5 27B leads

Amazon Nova Pro: 34.6 (#224), Qwen3.5 27B: 38.6 (#159)

Coding benchmarks
BenchmarkAmazon Nova ProQwen3.5 27B
LMArena Coding12701427
LMArena WebDev—1357
WeirdML—39.5%
LiveBench Coding38.1%—
ALE-Bench—349.45

Agentic & Tool Use Not comparable

Amazon Nova Pro: 16.6 (#139), Qwen3.5 27B: —

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova ProQwen3.5 27B
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—
Vending-Bench 2—201.98

Reasoning Qwen3.5 27B leads

Amazon Nova Pro: 19.2 (#240), Qwen3.5 27B: 26.6 (#116)

Reasoning benchmarks
BenchmarkAmazon Nova ProQwen3.5 27B
LMArena Hard Prompts12461414
NYT Connections (extended)—47.9%
Thematic Generalization—45.5%
LiveBench Reasoning32.6%—
DTBench—82.4%
LiveBench Data Analysis48.3%—
LMCA—34%
Epoch Capabilities Index123.75—
LiveBench43.5%—

Math Qwen3.5 27B leads

Amazon Nova Pro: 26.4 (#240), Qwen3.5 27B: 36.8 (#103)

Math benchmarks
BenchmarkAmazon Nova ProQwen3.5 27B
LMArena Math12521428
MathArena Final-Answer Competitions—56.7%
Omni-MATH24.2%—
LiveBench Math38%—

Knowledge Qwen3.5 27B leads

Amazon Nova Pro: 27.1 (#246), Qwen3.5 27B: 37.4 (#149)

Knowledge benchmarks
BenchmarkAmazon Nova ProQwen3.5 27B
Vectara Hallucination Rate5.1%12.1%
LMArena Expert12111428
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Confabulations30.1%—
GPQA (HELM)44.6%—
MMLU82%—

Multimodal Qwen3.5 27B leads

Amazon Nova Pro: 24.5 (#121), Qwen3.5 27B: 38.7 (#56)

Multimodal benchmarks
BenchmarkAmazon Nova ProQwen3.5 27B
LMArena Vision9801240

Multilingual Qwen3.5 27B leads

Amazon Nova Pro: 39.9 (#218), Qwen3.5 27B: 51.0 (#112)

Multilingual benchmarks
BenchmarkAmazon Nova ProQwen3.5 27B
LMArena Non-English12341390
LMArena Chinese12441478
LMArena French12701409
LMArena German12431393
LMArena Japanese12001345
LMArena Korean12031359
LMArena Russian12401389
LMArena Spanish11821408

Instruction Following Qwen3.5 27B leads

Amazon Nova Pro: 65.1 (#221), Qwen3.5 27B: 73.7 (#114)

Instruction Following benchmarks
BenchmarkAmazon Nova ProQwen3.5 27B
LMArena Instruction Following12351393
LiveBench Instruction Following67.1%—
IFEval81.5%—

Long Context Qwen3.5 27B leads

Amazon Nova Pro: 38.1 (#199), Qwen3.5 27B: 43.1 (#103)

Long Context benchmarks
BenchmarkAmazon Nova ProQwen3.5 27B
LMArena Longer Query12551413

Writing & Preference Qwen3.5 27B leads

Amazon Nova Pro: 44.1 (#221), Qwen3.5 27B: 59.5 (#106)

Writing & Preference benchmarks
BenchmarkAmazon Nova ProQwen3.5 27B
LMArena Text12591409
LMArena Creative Writing12121362
LMArena Multi-Turn12451410
Short-Story Creative Writing60.5%—
WildBench77.7%—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than Qwen3.5 27B?

Qwen3.5 27B is the stronger model overall, scoring 41.4 to 30.5 on the Noometry Index.

Which is cheaper, Amazon Nova Pro or Qwen3.5 27B?

Qwen3.5 27B is cheaper. It lists at $0.30 per million input tokens and $2.40 per million output tokens; Amazon Nova Pro lists at $0.80 and $3.20.

Is Amazon Nova Pro or Qwen3.5 27B better for coding?

Qwen3.5 27B scores higher on coding benchmarks: 38.6 versus 34.6 in the Noometry coding category.

Which has the bigger context window?

Amazon Nova Pro does, with 300K tokens against 262K.

How many benchmarks do Amazon Nova Pro and Qwen3.5 27B share?

19 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and Qwen3.5 27B has 28.

Related comparisons

Go deeper