Model comparison

Llama 3.1-70B vs Llama-3.3-70B-Instruct

Llama 3.1-70B and Llama-3.3-70B-Instruct score almost the same on the Noometry Index (29.4 vs 30.3), so choose on price, context window or the category you care about most.

Last verified . 28 shared benchmarks.

Llama 3.1-70B Meta

29.4

Rank #299 Confirmed

Llama-3.3-70B-Instruct Meta

30.3

Rank #283 Confirmed

Summary

  • They share 28 benchmarks with published results for both. Llama 3.1-70B scores higher in 2 categories and Llama-3.3-70B-Instruct in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Llama-3.3-70B-Instruct leads 47.8 to 35.6.
  • The biggest single-benchmark swing is WeirdML: 9% for Llama 3.1-70B and 14.4% for Llama-3.3-70B-Instruct.
  • Llama-3.3-70B-Instruct is cheaper at $0.10 / $0.32 per million input/output tokens, against $0.40 / $0.40 for Llama 3.1-70B.

Side by side

Llama 3.1-70B and Llama-3.3-70B-Instruct specifications
Llama 3.1-70BLlama-3.3-70B-Instruct
ProviderMetaMeta
Noometry Index29.430.3
Released2024-07-232024-12-06
WeightsOpenOpen
Context window128K128K
Max output4K4K
Input $ / M tokens$0.40$0.10
Output $ / M tokens$0.40$0.32
Results tracked3543

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Llama 3.1-70B: 29.8 (#292), Llama-3.3-70B-Instruct: 30.6 (#284)

Coding benchmarks
BenchmarkLlama 3.1-70BLlama-3.3-70B-Instruct
WeirdML9%14.4%
BigCodeBench Instruct46.1%46.9%
LMArena Coding12601268
BigCodeBench Complete54.8%57.5%
SciCode—26%
LiveBench Coding—36.6%

Agentic & Tool Use Too close to call

Llama 3.1-70B: 24.9 (#104), Llama-3.3-70B-Instruct: 25.6 (#100)

Agentic & Tool Use benchmarks
BenchmarkLlama 3.1-70BLlama-3.3-70B-Instruct
BALROG27.9%23%
Berkeley Function Calling Leaderboard—31.9%
TheAgentCompany6.9%—

Reasoning Llama 3.1-70B leads

Llama 3.1-70B: 20.8 (#215), Llama-3.3-70B-Instruct: 13.7 (#325)

Reasoning benchmarks
BenchmarkLlama 3.1-70BLlama-3.3-70B-Instruct
LMArena Hard Prompts12411257
DTBench60%59.5%
LMCA14.8%17.5%
Epoch Capabilities Index125.91127.32
SimpleBench—19.9%
CritPt—0%
LiveBench Reasoning—50.8%
LiveBench Data Analysis—49.5%
ForecastBench—58.6
LiveBench—50.2%

Math Llama-3.3-70B-Instruct leads

Llama 3.1-70B: 12.7 (#298), Llama-3.3-70B-Instruct: 14.3 (#292)

Math benchmarks
BenchmarkLlama 3.1-70BLlama-3.3-70B-Instruct
OTIS Mock AIME 2024-20253.6%5.1%
LMArena Math12521268
MATH Level 536.7%41.6%
Omni-MATH21%—
LiveBench Math—42.2%

Knowledge Llama-3.3-70B-Instruct leads

Llama 3.1-70B: 24.1 (#264), Llama-3.3-70B-Instruct: 30.5 (#220)

Knowledge benchmarks
BenchmarkLlama 3.1-70BLlama-3.3-70B-Instruct
GPQA Diamond44.2%47.4%
LMArena Expert12091225
MMLU80.1%86.3%
MMLU-Pro65.3%—
Confabulations—22.8%
Vectara Hallucination Rate—4.1%
GPQA (HELM)42.6%—

Multilingual Llama-3.3-70B-Instruct leads

Llama 3.1-70B: 38.9 (#220), Llama-3.3-70B-Instruct: 40.1 (#215)

Multilingual benchmarks
BenchmarkLlama 3.1-70BLlama-3.3-70B-Instruct
LMArena Non-English12191236
LMArena Chinese12151217
LMArena French12601280
LMArena German12221251
LMArena Japanese11321149
LMArena Korean11401142
LMArena Russian12341252
LMArena Spanish12531269

Instruction Following Llama-3.3-70B-Instruct leads

Llama 3.1-70B: 65.5 (#218), Llama-3.3-70B-Instruct: 71.3 (#152)

Instruction Following benchmarks
BenchmarkLlama 3.1-70BLlama-3.3-70B-Instruct
LMArena Instruction Following12311242
LiveBench Instruction Following—82.7%
IFEval82.1%—

Long Context Llama 3.1-70B leads

Llama 3.1-70B: 37.6 (#208), Llama-3.3-70B-Instruct: 26.4 (#290)

Long Context benchmarks
BenchmarkLlama 3.1-70BLlama-3.3-70B-Instruct
LMArena Longer Query12411256
Fiction.LiveBench—33.3%

Writing & Preference Llama-3.3-70B-Instruct leads

Llama 3.1-70B: 35.6 (#262), Llama-3.3-70B-Instruct: 47.8 (#203)

Writing & Preference benchmarks
BenchmarkLlama 3.1-70BLlama-3.3-70B-Instruct
LMArena Text12611274
LMArena Creative Writing12321250
LMArena Multi-Turn12561279
EQ-Bench Creative Writing784—
WildBench75.8%—
LiveBench Language—39.2%

Frequently asked questions

Is Llama 3.1-70B better than Llama-3.3-70B-Instruct?

Llama 3.1-70B and Llama-3.3-70B-Instruct score almost the same on the Noometry Index (29.4 vs 30.3), so choose on price, context window or the category you care about most.

Which is cheaper, Llama 3.1-70B or Llama-3.3-70B-Instruct?

Llama-3.3-70B-Instruct is cheaper. It lists at $0.10 per million input tokens and $0.32 per million output tokens; Llama 3.1-70B lists at $0.40 and $0.40.

Is Llama 3.1-70B or Llama-3.3-70B-Instruct better for coding?

They score almost the same on coding (29.8 vs 30.6); test both on your own repository before choosing.

Which has the bigger context window?

Both accept 128K tokens.

How many benchmarks do Llama 3.1-70B and Llama-3.3-70B-Instruct share?

28 benchmarks have published results for both models. Llama 3.1-70B has 35 scored results on Noometry and Llama-3.3-70B-Instruct has 43.

Related comparisons

Go deeper