Meta, unknown

Llama 2-34B

Llama 2-34B by Meta has 10 published benchmark results on Noometry, not yet enough to be ranked.

Last verified

Specifications

Noometry rank
Unranked
Index score
Not ranked
Evidence
10 results
Provider
Meta
Released
July 18, 2023
Weights
Unknown
Reasoning
Unknown
Context window
—
Max output
—
Input price
Not listed
Output price
Not listed
Blended price
Not listed
Output speed
Not measured
Value
Not ranked
Knowledge cutoff
Unknown

Sponsored placements are available on pages like this one. Advertise on Noometry

Benchmark results

Every published result we track, with its source. Bold rows are the ones used for ranking; where several exist we prefer independent runs over self-reported numbers.

Reasoning

Llama 2-34B Reasoning benchmark results
BenchmarkScorePositionSettingSourceDate
BIG-Bench Hard44.1%#21 of 27, top 78%Epoch AI
Epoch Capabilities Index105.2#197 of 213, top 93%Epoch AI2023-07-18
PIQA81.9%#16 of 27, top 60%Epoch AI
WinoGrande76.7%#21 of 43, top 49%Epoch AI

Math

Llama 2-34B Math benchmark results
BenchmarkScorePositionSettingSourceDate
GSM8K42.2%#26 of 38, top 69%Epoch AI

Knowledge

Llama 2-34B Knowledge benchmark results
BenchmarkScorePositionSettingSourceDate
ARC (AI2) Challenge54.5%#26 of 39, top 67%Epoch AI
BoolQ83.7%#10 of 23, top 44%Epoch AI
MMLU62.6%#58 of 81, top 72%Epoch AI
OpenBookQA58.2%#13 of 19, top 69%Epoch AI
TriviaQA84.6%#6 of 25, top 24%Epoch AI

Compare Llama 2-34B

Other Meta models

Frequently asked questions

How good is Llama 2-34B?

Llama 2-34B by Meta has 10 published benchmark results on Noometry, not yet enough to be ranked.

Is Llama 2-34B open source?

Meta has not published downloadable weights for Llama 2-34B that we can confirm.