Model comparison

Amazon Nova Lite vs Qwen2.5 14B Instruct

Amazon Nova Lite has enough public results to be ranked (#265); Qwen2.5 14B Instruct does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Amazon Nova Lite Amazon

31.9

Rank #265 Confirmed

Summary

  • They share 1 benchmark with published results for both. Amazon Nova Lite scores higher in 0 categories and Qwen2.5 14B Instruct in 1 category; one gap is clear of the uncertainty.
  • The widest gap is in coding, where Qwen2.5 14B Instruct leads 37.7 to 32.5.
  • Amazon Nova Lite is cheaper at $0.06 / $0.24 per million input/output tokens, against $0.35 / $1.40 for Qwen2.5 14B Instruct.
  • Amazon Nova Lite accepts more context: 300K tokens versus 131K.
  • Qwen2.5 14B Instruct has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Lite and Qwen2.5 14B Instruct specifications
Amazon Nova LiteQwen2.5 14B Instruct
ProviderAmazonAlibaba (Qwen)
Noometry Index31.938.7
Released2024-12-032024-09
WeightsProprietaryOpen
Context window300K131K
Max output10K8K
Input $ / M tokens$0.06$0.35
Output $ / M tokens$0.24$1.40
Results tracked343

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen2.5 14B Instruct leads

Amazon Nova Lite: 32.5 (#270), Qwen2.5 14B Instruct: 37.7 (#191)

Coding benchmarks
BenchmarkAmazon Nova LiteQwen2.5 14B Instruct
BigCodeBench Instruct—39.8%
LiveBench Coding27.5%—
LMArena Coding1239—
BigCodeBench Complete—52.2%
ALE-Bench236.25—

Reasoning Not comparable

Amazon Nova Lite: 19.3 (#260), Qwen2.5 14B Instruct: —

Reasoning benchmarks
BenchmarkAmazon Nova LiteQwen2.5 14B Instruct
LiveBench Reasoning36.7%—
LMArena Hard Prompts1220—
LiveBench Data Analysis37.2%—
LiveBench36.4%—

Math Not comparable

Amazon Nova Lite: 27.8 (#247), Qwen2.5 14B Instruct: —

Math benchmarks
BenchmarkAmazon Nova LiteQwen2.5 14B Instruct
Omni-MATH23.3%—
LiveBench Math36.7%—
LMArena Math1227—

Knowledge Not comparable

Amazon Nova Lite: 26.3 (#259), Qwen2.5 14B Instruct: —

Knowledge benchmarks
BenchmarkAmazon Nova LiteQwen2.5 14B Instruct
MMLU77%79.9%
Humanity's Last Exam3.6%—
MMLU-Pro60%—
Vectara Hallucination Rate6.1%—
GPQA (HELM)39.7%—
LMArena Expert1201—

Multimodal Not comparable

Amazon Nova Lite: 25.5 (#123), Qwen2.5 14B Instruct: —

Multimodal benchmarks
BenchmarkAmazon Nova LiteQwen2.5 14B Instruct
LMArena Vision990—

Multilingual Not comparable

Amazon Nova Lite: 38.0 (#232), Qwen2.5 14B Instruct: —

Multilingual benchmarks
BenchmarkAmazon Nova LiteQwen2.5 14B Instruct
LMArena Non-English1208—
LMArena Chinese1225—
LMArena French1237—
LMArena German1229—
LMArena Japanese1153—
LMArena Korean1153—
LMArena Russian1216—
LMArena Spanish1226—

Instruction Following Not comparable

Amazon Nova Lite: 59.3 (#255), Qwen2.5 14B Instruct: —

Instruction Following benchmarks
BenchmarkAmazon Nova LiteQwen2.5 14B Instruct
LiveBench Instruction Following54.1%—
IFEval77.6%—
LMArena Instruction Following1205—

Long Context Not comparable

Amazon Nova Lite: 37.4 (#217), Qwen2.5 14B Instruct: —

Long Context benchmarks
BenchmarkAmazon Nova LiteQwen2.5 14B Instruct
LMArena Longer Query1234—

Writing & Preference Not comparable

Amazon Nova Lite: 42.1 (#237), Qwen2.5 14B Instruct: —

Writing & Preference benchmarks
BenchmarkAmazon Nova LiteQwen2.5 14B Instruct
LMArena Text1229—
LMArena Creative Writing1197—
WildBench75%—
LMArena Multi-Turn1199—
LiveBench Language25.9%—

Frequently asked questions

Is Amazon Nova Lite better than Qwen2.5 14B Instruct?

Amazon Nova Lite has enough public results to be ranked (#265); Qwen2.5 14B Instruct does not yet, so treat this comparison as directional.

Which is cheaper, Amazon Nova Lite or Qwen2.5 14B Instruct?

Amazon Nova Lite is cheaper. It lists at $0.06 per million input tokens and $0.24 per million output tokens; Qwen2.5 14B Instruct lists at $0.35 and $1.40.

Is Amazon Nova Lite or Qwen2.5 14B Instruct better for coding?

Qwen2.5 14B Instruct scores higher on coding benchmarks: 37.7 versus 32.5 in the Noometry coding category.

Which has the bigger context window?

Amazon Nova Lite does, with 300K tokens against 131K.

How many benchmarks do Amazon Nova Lite and Qwen2.5 14B Instruct share?

1 benchmark has published results for both models. Amazon Nova Lite has 34 scored results on Noometry and Qwen2.5 14B Instruct has 3.

Related comparisons

Go deeper