Noometry

Model comparison

GPT-3.5-turbo vs Nova 2 Lite

Nova 2 Lite is the stronger model overall, scoring 39.7 to 23.2 on the Noometry Index.

Last verified . 17 shared benchmarks.

GPT-3.5-turbo OpenAI

23.2

Rank #350 Confirmed

Nova 2 Lite Amazon

39.7

Rank #161 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GPT-3.5-turbo scores higher in 0 categories and Nova 2 Lite in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Nova 2 Lite leads 43.0 to 10.0.
  • GPT-3.5-turbo is cheaper at $0.50 / $1.50 per million input/output tokens, against $0.30 / $2.50 for Nova 2 Lite.
  • Nova 2 Lite accepts more context: 1M tokens versus 16K.

Side by side

GPT-3.5-turboNova 2 Lite
ProviderOpenAIAmazon
Noometry Index23.239.7
Released2023-03-012025-12-01
WeightsProprietaryProprietary
Context window16K1M
Max output4K64K
Input $ / M tokens$0.50$0.30
Output $ / M tokens$1.50$2.50
Results tracked4419

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nova 2 Lite leads

GPT-3.5-turbo: 23.9 (#331), Nova 2 Lite: 40.7 (#134)

BenchmarkGPT-3.5-turboNova 2 Lite
LMArena Coding11361385
WeirdML3.5%—
BigCodeBench Instruct39.1%—
BigCodeBench Complete50.6%—
HumanEval+70.7%—
MBPP+69.7%—

Agentic & Tool Use Not comparable

GPT-3.5-turbo: —, Nova 2 Lite: 24.1 (#121)

BenchmarkGPT-3.5-turboNova 2 Lite
Berkeley Function Calling Leaderboard—27.1%
METR Time Horizons21.5%—

Reasoning Nova 2 Lite leads

GPT-3.5-turbo: 13.8 (#332), Nova 2 Lite: 27.5 (#118)

BenchmarkGPT-3.5-turboNova 2 Lite
LMArena Hard Prompts11081364
Chess Puzzles0%—
Mystery Game Puzzles3%—
DTBench48.5%—
LMCA9.7%—
Adversarial NLI58.1%—
BIG-Bench Hard61.6%—
CommonsenseQA 2.057%—
Epoch Capabilities Index118.55—
ForecastBench50.4—
WinoGrande81.6%—

Math Nova 2 Lite leads

GPT-3.5-turbo: 6.3 (#327), Nova 2 Lite: 37.5 (#156)

BenchmarkGPT-3.5-turboNova 2 Lite
LMArena Math11421359
FrontierMath (Tiers 1-3)0%—
OTIS Mock AIME 2024-20252.2%—
MATH Level 515.9%—
GSM8K57.8%—

Knowledge Nova 2 Lite leads

GPT-3.5-turbo: 10.0 (#303), Nova 2 Lite: 43.0 (#94)

BenchmarkGPT-3.5-turboNova 2 Lite
LMArena Expert10701358
GPQA Diamond28%—
Vectara Hallucination Rate—5.1%
ARC (AI2) Challenge87.4%—
BoolQ87%—
MMLU71.4%—
OpenBookQA86%—
TriviaQA85.8%—

Multilingual Nova 2 Lite leads

GPT-3.5-turbo: 31.5 (#258), Nova 2 Lite: 47.1 (#153)

BenchmarkGPT-3.5-turboNova 2 Lite
LMArena Non-English11081337
LMArena Chinese10751364
LMArena French11181381
LMArena German10901343
LMArena Japanese10431271
LMArena Korean10191284
LMArena Russian11231343
LMArena Spanish11211373

Instruction Following Nova 2 Lite leads

GPT-3.5-turbo: 57.9 (#262), Nova 2 Lite: 70.5 (#161)

BenchmarkGPT-3.5-turboNova 2 Lite
LMArena Instruction Following11191335

Long Context Nova 2 Lite leads

GPT-3.5-turbo: 34.0 (#254), Nova 2 Lite: 40.6 (#150)

BenchmarkGPT-3.5-turboNova 2 Lite
LMArena Longer Query11211335

Writing & Preference Nova 2 Lite leads

GPT-3.5-turbo: 25.3 (#305), Nova 2 Lite: 53.9 (#154)

BenchmarkGPT-3.5-turboNova 2 Lite
LMArena Text11251362
LMArena Creative Writing10921291
LMArena Multi-Turn11171338
EQ-Bench Creative Writing451—

Frequently asked questions

Is GPT-3.5-turbo better than Nova 2 Lite?

Nova 2 Lite is the stronger model overall, scoring 39.7 to 23.2 on the Noometry Index.

Which is cheaper, GPT-3.5-turbo or Nova 2 Lite?

GPT-3.5-turbo is cheaper. It lists at $0.50 per million input tokens and $1.50 per million output tokens; Nova 2 Lite lists at $0.30 and $2.50.

Is GPT-3.5-turbo or Nova 2 Lite better for coding?

Nova 2 Lite scores higher on coding benchmarks: 40.7 versus 23.9 in the Noometry coding category.

Which has the bigger context window?

Nova 2 Lite does, with 1M tokens against 16K.

How many benchmarks do GPT-3.5-turbo and Nova 2 Lite share?

17 benchmarks have published results for both models. GPT-3.5-turbo has 44 scored results on Noometry and Nova 2 Lite has 19.

Related comparisons

Go deeper