Noometry

Model comparison

Amazon Nova Lite vs Codestral

Amazon Nova Lite is the stronger model overall, scoring 31.4 to 30.1 on the Noometry Index.

Last verified . 1 shared benchmarks.

Amazon Nova Lite Amazon

31.4

Rank #262 Confirmed

Codestral Mistral AI

30.1

Rank #287 Reported

Summary

  • They share 1 benchmark with published results for both. Amazon Nova Lite scores higher in 1 category and Codestral in 1 category; one gap is clear of the uncertainty.
  • The widest gap is in coding, where Amazon Nova Lite leads 32.0 to 26.9.
  • Amazon Nova Lite is cheaper at $0.06 / $0.24 per million input/output tokens, against $0.30 / $0.90 for Codestral.
  • Amazon Nova Lite accepts more context: 300K tokens versus 256K.
  • Codestral has downloadable open weights; the other is API-only.

Side by side

Amazon Nova LiteCodestral
ProviderAmazonMistral AI
Noometry Index31.430.1
Released2024-12-032024-05-29
WeightsProprietaryOpen
Context window300K256K
Max output10K4K
Input $ / M tokens$0.06$0.30
Output $ / M tokens$0.24$0.90
Results tracked347

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Lite leads

Amazon Nova Lite: 32.0 (#266), Codestral: 26.9 (#316)

BenchmarkAmazon Nova LiteCodestral
ALE-Bench236.25137.78
Aider Polyglot—11.1%
BigCodeBench Instruct—41.8%
LiveBench Coding27.5%—
LMArena Coding1239—
BigCodeBench Complete—52.5%
HumanEval+—73.8%
MBPP+—61.9%

Reasoning Too close to call

Amazon Nova Lite: 18.5 (#257), Codestral: 19.1 (#244)

BenchmarkAmazon Nova LiteCodestral
Kagi LLM Benchmark—32.5%
LiveBench Reasoning36.7%—
LMArena Hard Prompts1220—
LiveBench Data Analysis37.2%—
LiveBench36.4%—

Math Not comparable

Amazon Nova Lite: 25.8 (#243), Codestral: —

BenchmarkAmazon Nova LiteCodestral
Omni-MATH23.3%—
LiveBench Math36.7%—
LMArena Math1227—

Knowledge Not comparable

Amazon Nova Lite: 26.0 (#254), Codestral: —

BenchmarkAmazon Nova LiteCodestral
Humanity's Last Exam3.6%—
MMLU-Pro60%—
Vectara Hallucination Rate6.1%—
GPQA (HELM)39.7%—
LMArena Expert1201—
MMLU77%—

Multimodal Not comparable

Amazon Nova Lite: 25.0 (#118), Codestral: —

BenchmarkAmazon Nova LiteCodestral
LMArena Vision990—

Multilingual Not comparable

Amazon Nova Lite: 38.2 (#227), Codestral: —

BenchmarkAmazon Nova LiteCodestral
LMArena Non-English1208—
LMArena Chinese1225—
LMArena French1237—
LMArena German1229—
LMArena Japanese1153—
LMArena Korean1153—
LMArena Russian1216—
LMArena Spanish1225—

Instruction Following Not comparable

Amazon Nova Lite: 59.6 (#250), Codestral: —

BenchmarkAmazon Nova LiteCodestral
LiveBench Instruction Following54.1%—
IFEval77.6%—
LMArena Instruction Following1205—

Long Context Not comparable

Amazon Nova Lite: 37.4 (#212), Codestral: —

BenchmarkAmazon Nova LiteCodestral
LMArena Longer Query1234—

Writing & Preference Not comparable

Amazon Nova Lite: 42.3 (#232), Codestral: —

BenchmarkAmazon Nova LiteCodestral
LMArena Text1229—
LMArena Creative Writing1197—
WildBench75%—
LMArena Multi-Turn1199—
LiveBench Language25.9%—

Frequently asked questions

Is Amazon Nova Lite better than Codestral?

Amazon Nova Lite is the stronger model overall, scoring 31.4 to 30.1 on the Noometry Index.

Which is cheaper, Amazon Nova Lite or Codestral?

Amazon Nova Lite is cheaper. It lists at $0.06 per million input tokens and $0.24 per million output tokens; Codestral lists at $0.30 and $0.90.

Is Amazon Nova Lite or Codestral better for coding?

Amazon Nova Lite scores higher on coding benchmarks: 32.0 versus 26.9 in the Noometry coding category.

Which has the bigger context window?

Amazon Nova Lite does, with 300K tokens against 256K.

How many benchmarks do Amazon Nova Lite and Codestral share?

1 benchmark has published results for both models. Amazon Nova Lite has 34 scored results on Noometry and Codestral has 7.

Related comparisons

Go deeper