Noometry

Model comparison

Amazon Nova Lite vs OLMo 2 Furious 13B

Amazon Nova Lite is the stronger model overall, scoring 31.9 to 29.7 on the Noometry Index.

Last verified . 12 shared benchmarks.

Amazon Nova Lite Amazon

31.9

Rank #265 Confirmed

OLMo 2 Furious 13B Allen Institute for AI (Ai2)

29.7

Rank #304 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Amazon Nova Lite scores higher in 4 categories and OLMo 2 Furious 13B in 2 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Amazon Nova Lite leads 26.3 to 18.3.
  • The biggest single-benchmark swing is MMLU-Pro: 60% for Amazon Nova Lite and 31% for OLMo 2 Furious 13B.
  • OLMo 2 Furious 13B has downloadable open weights; the other is API-only.

Side by side

Amazon Nova LiteOLMo 2 Furious 13B
ProviderAmazonAllen Institute for AI (Ai2)
Noometry Index31.929.7
Released2024-12-032024-12-31
WeightsProprietaryOpen
Context window300K—
Max output10K—
Input $ / M tokens$0.06—
Output $ / M tokens$0.24—
Results tracked3412

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Lite leads

Amazon Nova Lite: 32.5 (#270), OLMo 2 Furious 13B: 28.6 (#313)

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
LiveBench Coding27.5%10.4%
LMArena Coding1239—
ALE-Bench236.25—

Reasoning Amazon Nova Lite leads

Amazon Nova Lite: 19.3 (#260), OLMo 2 Furious 13B: 15.5 (#314)

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
LiveBench Reasoning36.7%16.3%
LiveBench Data Analysis37.2%20.6%
LiveBench36.4%22.1%
LMArena Hard Prompts1220—

Math Amazon Nova Lite leads

Amazon Nova Lite: 27.8 (#247), OLMo 2 Furious 13B: 23.1 (#273)

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
Omni-MATH23.3%15.6%
LiveBench Math36.7%13.6%
LMArena Math1227—

Knowledge Amazon Nova Lite leads

Amazon Nova Lite: 26.3 (#259), OLMo 2 Furious 13B: 18.3 (#283)

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
MMLU-Pro60%31%
GPQA (HELM)39.7%31.6%
Humanity's Last Exam3.6%—
Vectara Hallucination Rate6.1%—
LMArena Expert1201—
MMLU77%—

Multimodal Not comparable

Amazon Nova Lite: 25.5 (#123), OLMo 2 Furious 13B: —

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
LMArena Vision990—

Multilingual Not comparable

Amazon Nova Lite: 38.0 (#232), OLMo 2 Furious 13B: —

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
LMArena Non-English1208—
LMArena Chinese1225—
LMArena French1237—
LMArena German1229—
LMArena Japanese1153—
LMArena Korean1153—
LMArena Russian1216—
LMArena Spanish1226—

Instruction Following OLMo 2 Furious 13B leads

Amazon Nova Lite: 59.3 (#255), OLMo 2 Furious 13B: 60.9 (#248)

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
LiveBench Instruction Following54.1%60.6%
IFEval77.6%73%
LMArena Instruction Following1205—

Long Context Not comparable

Amazon Nova Lite: 37.4 (#217), OLMo 2 Furious 13B: —

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
LMArena Longer Query1234—

Writing & Preference Too close to call

Amazon Nova Lite: 42.1 (#237), OLMo 2 Furious 13B: 42.9 (#230)

BenchmarkAmazon Nova LiteOLMo 2 Furious 13B
WildBench75%68.9%
LiveBench Language25.9%11.2%
LMArena Text1229—
LMArena Creative Writing1197—
LMArena Multi-Turn1199—

Frequently asked questions

Is Amazon Nova Lite better than OLMo 2 Furious 13B?

Amazon Nova Lite is the stronger model overall, scoring 31.9 to 29.7 on the Noometry Index.

Is Amazon Nova Lite or OLMo 2 Furious 13B better for coding?

Amazon Nova Lite scores higher on coding benchmarks: 32.5 versus 28.6 in the Noometry coding category.

How many benchmarks do Amazon Nova Lite and OLMo 2 Furious 13B share?

12 benchmarks have published results for both models. Amazon Nova Lite has 34 scored results on Noometry and OLMo 2 Furious 13B has 12.

Related comparisons

Go deeper