Model comparison

Llama-3.3-70B-Instruct vs o3-pro

o3-pro is the stronger model overall, scoring 42.9 to 30.6 on the Noometry Index. Llama-3.3-70B-Instruct costs 226× less per token, which makes it the better buy when o3-pro's lead doesn't matter for your workload.

Last verified . 7 shared benchmarks.

Llama-3.3-70B-Instruct Meta

30.6

Rank #291 Confirmed

o3-pro OpenAI

42.9

Rank #105 Confirmed

Summary

  • They share 7 benchmarks with published results for both. Llama-3.3-70B-Instruct scores higher in 1 category and o3-pro in 4 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in long context, where o3-pro leads 72.2 to 26.4.
  • The biggest single-benchmark swing is Fiction.LiveBench: 33.3% for Llama-3.3-70B-Instruct and 97.2% for o3-pro.
  • Llama-3.3-70B-Instruct is cheaper at $0.10 / $0.32 per million input/output tokens, against $20 / $80 for o3-pro.
  • o3-pro accepts more context: 200K tokens versus 128K.
  • Llama-3.3-70B-Instruct has downloadable open weights; the other is API-only.

Side by side

Llama-3.3-70B-Instruct and o3-pro specifications
Llama-3.3-70B-Instructo3-pro
ProviderMetaOpenAI
Noometry Index30.642.9
Released2024-12-062025-06-10
WeightsOpenProprietary
Context window128K200K
Max output4K100K
Input $ / M tokens$0.10$20
Output $ / M tokens$0.32$80
Results tracked4312

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding o3-pro leads

Llama-3.3-70B-Instruct: 31.0 (#290), o3-pro: 55.5 (#24)

Coding benchmarks
BenchmarkLlama-3.3-70B-Instructo3-pro
WeirdML14.4%58.2%
Aider Polyglot—84.9%
SciCode26%—
BigCodeBench Instruct46.9%—
LiveBench Coding36.6%—
LMArena Coding1268—
BigCodeBench Complete57.5%—

Agentic & Tool Use Not comparable

Llama-3.3-70B-Instruct: 25.8 (#105), o3-pro: —

Agentic & Tool Use benchmarks
BenchmarkLlama-3.3-70B-Instructo3-pro
Berkeley Function Calling Leaderboard31.9%—
BALROG23%—

Reasoning o3-pro leads

Llama-3.3-70B-Instruct: 14.1 (#327), o3-pro: 23.8 (#171)

Reasoning benchmarks
BenchmarkLlama-3.3-70B-Instructo3-pro
DTBench59.5%86.9%
LMCA17.5%38.5%
Epoch Capabilities Index127.33147.42
ARC-AGI-2—4.9%
SimpleBench19.9%—
Kagi LLM Benchmark—72.1%
ARC-AGI-1—59.3%
CritPt0%—
LiveBench Reasoning50.8%—
LMArena Hard Prompts1257—
LiveBench Data Analysis49.5%—
ForecastBench58.6—
LiveBench50.2%—

Math Not comparable

Llama-3.3-70B-Instruct: 15.3 (#298), o3-pro: —

Math benchmarks
BenchmarkLlama-3.3-70B-Instructo3-pro
OTIS Mock AIME 2024-20255.1%—
LiveBench Math42.2%—
LMArena Math1267—
MATH Level 541.6%—

Knowledge Llama-3.3-70B-Instruct leads

Llama-3.3-70B-Instruct: 30.6 (#226), o3-pro: 29.5 (#238)

Knowledge benchmarks
BenchmarkLlama-3.3-70B-Instructo3-pro
Confabulations22.8%14.2%
Vectara Hallucination Rate4.1%23.3%
GPQA Diamond47.4%—
LMArena Expert1225—
MMLU86.3%—

Multilingual Not comparable

Llama-3.3-70B-Instruct: 39.9 (#220), o3-pro: —

Multilingual benchmarks
BenchmarkLlama-3.3-70B-Instructo3-pro
LMArena Non-English1236—
LMArena Chinese1217—
LMArena French1281—
LMArena German1251—
LMArena Japanese1150—
LMArena Korean1143—
LMArena Russian1252—
LMArena Spanish1270—

Instruction Following Not comparable

Llama-3.3-70B-Instruct: 71.1 (#157), o3-pro: —

Instruction Following benchmarks
BenchmarkLlama-3.3-70B-Instructo3-pro
LiveBench Instruction Following82.7%—
LMArena Instruction Following1242—

Long Context o3-pro leads

Llama-3.3-70B-Instruct: 26.4 (#295), o3-pro: 72.2 (#1)

Long Context benchmarks
BenchmarkLlama-3.3-70B-Instructo3-pro
Fiction.LiveBench33.3%97.2%
LMArena Longer Query1256—

Writing & Preference o3-pro leads

Llama-3.3-70B-Instruct: 47.6 (#207), o3-pro: 57.1 (#133)

Writing & Preference benchmarks
BenchmarkLlama-3.3-70B-Instructo3-pro
LMArena Text1274—
LMArena Creative Writing1250—
Short-Story Creative Writing—84.4%
LMArena Multi-Turn1280—
LiveBench Language39.2%—

Frequently asked questions

Is Llama-3.3-70B-Instruct better than o3-pro?

o3-pro is the stronger model overall, scoring 42.9 to 30.6 on the Noometry Index. Llama-3.3-70B-Instruct costs 226× less per token, which makes it the better buy when o3-pro's lead doesn't matter for your workload.

Which is cheaper, Llama-3.3-70B-Instruct or o3-pro?

Llama-3.3-70B-Instruct is cheaper. It lists at $0.10 per million input tokens and $0.32 per million output tokens; o3-pro lists at $20 and $80.

Is Llama-3.3-70B-Instruct or o3-pro better for coding?

o3-pro scores higher on coding benchmarks: 55.5 versus 31.0 in the Noometry coding category.

Which has the bigger context window?

o3-pro does, with 200K tokens against 128K.

How many benchmarks do Llama-3.3-70B-Instruct and o3-pro share?

7 benchmarks have published results for both models. Llama-3.3-70B-Instruct has 43 scored results on Noometry and o3-pro has 12.

Related comparisons

Go deeper