Noometry

Model comparison

GPT-4 vs Nova 2 Lite

Nova 2 Lite is the stronger model overall, scoring 39.7 to 29.1 on the Noometry Index.

Last verified . 17 shared benchmarks.

GPT-4 OpenAI

29.1

Rank #316 Confirmed

Nova 2 Lite Amazon

39.7

Rank #161 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GPT-4 scores higher in 0 categories and Nova 2 Lite in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Nova 2 Lite leads 37.5 to 10.8.
  • Nova 2 Lite is cheaper at $0.30 / $2.50 per million input/output tokens, against $30 / $60 for GPT-4.
  • Nova 2 Lite accepts more context: 1M tokens versus 8K.

Side by side

GPT-4Nova 2 Lite
ProviderOpenAIAmazon
Noometry Index29.139.7
Released2023-03-142025-12-01
WeightsProprietaryProprietary
Context window8K1M
Max output8K64K
Input $ / M tokens$30$0.30
Output $ / M tokens$60$2.50
Results tracked3819

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nova 2 Lite leads

GPT-4: 31.6 (#283), Nova 2 Lite: 40.7 (#134)

BenchmarkGPT-4Nova 2 Lite
LMArena Coding12541385
WeirdML12.4%—
BigCodeBench Instruct46%—
BigCodeBench Complete57.2%—
HumanEval+79.3%—

Agentic & Tool Use Not comparable

GPT-4: —, Nova 2 Lite: 24.1 (#121)

BenchmarkGPT-4Nova 2 Lite
Berkeley Function Calling Leaderboard—27.1%
METR Time Horizons36.1%—

Reasoning Nova 2 Lite leads

GPT-4: 17.8 (#289), Nova 2 Lite: 27.5 (#118)

BenchmarkGPT-4Nova 2 Lite
LMArena Hard Prompts12411364
Chess Puzzles4%—
Mystery Game Puzzles12%—
DTBench62.7%—
LMCA17.1%—
BIG-Bench Hard75.1%—
Epoch Capabilities Index125.89—
ForecastBench57.8—
HellaSwag95.3%—
WinoGrande87.5%—

Math Nova 2 Lite leads

GPT-4: 10.8 (#309), Nova 2 Lite: 37.5 (#156)

BenchmarkGPT-4Nova 2 Lite
LMArena Math12691359
OTIS Mock AIME 2024-20251.1%—
MATH Level 523%—
GSM8K92%—

Knowledge Nova 2 Lite leads

GPT-4: 18.4 (#282), Nova 2 Lite: 43.0 (#94)

BenchmarkGPT-4Nova 2 Lite
LMArena Expert12111358
GPQA Diamond35.7%—
Vectara Hallucination Rate—5.1%
MMLU86.4%—
TriviaQA84.8%—

Multilingual Nova 2 Lite leads

GPT-4: 40.6 (#215), Nova 2 Lite: 47.1 (#153)

BenchmarkGPT-4Nova 2 Lite
LMArena Non-English12461337
LMArena Chinese12421364
LMArena French12831381
LMArena German12511343
LMArena Japanese12091271
LMArena Korean11841284
LMArena Russian12511343
LMArena Spanish12611373

Instruction Following Nova 2 Lite leads

GPT-4: 65.3 (#222), Nova 2 Lite: 70.5 (#161)

BenchmarkGPT-4Nova 2 Lite
LMArena Instruction Following12411335

Long Context Nova 2 Lite leads

GPT-4: 37.7 (#212), Nova 2 Lite: 40.6 (#150)

BenchmarkGPT-4Nova 2 Lite
LMArena Longer Query12441335

Writing & Preference Nova 2 Lite leads

GPT-4: 34.9 (#268), Nova 2 Lite: 53.9 (#154)

BenchmarkGPT-4Nova 2 Lite
LMArena Text12631362
LMArena Creative Writing12441291
LMArena Multi-Turn12571338
EQ-Bench Creative Writing752—

Frequently asked questions

Is GPT-4 better than Nova 2 Lite?

Nova 2 Lite is the stronger model overall, scoring 39.7 to 29.1 on the Noometry Index.

Which is cheaper, GPT-4 or Nova 2 Lite?

Nova 2 Lite is cheaper. It lists at $0.30 per million input tokens and $2.50 per million output tokens; GPT-4 lists at $30 and $60.

Is GPT-4 or Nova 2 Lite better for coding?

Nova 2 Lite scores higher on coding benchmarks: 40.7 versus 31.6 in the Noometry coding category.

Which has the bigger context window?

Nova 2 Lite does, with 1M tokens against 8K.

How many benchmarks do GPT-4 and Nova 2 Lite share?

17 benchmarks have published results for both models. GPT-4 has 38 scored results on Noometry and Nova 2 Lite has 19.

Related comparisons

Go deeper