Noometry

Model comparison

GPT-5.5 Instant vs Llama 2-7B

GPT-5.5 Instant is the stronger model overall, scoring 42.5 to 28.6 on the Noometry Index.

Last verified . 17 shared benchmarks.

GPT-5.5 Instant OpenAI

42.5

Rank #99 Confirmed

Llama 2-7B Meta

28.6

Rank #315 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GPT-5.5 Instant scores higher in 7 categories and Llama 2-7B in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GPT-5.5 Instant leads 62.0 to 28.1.
  • The biggest single-benchmark swing is Chess Puzzles: 12% for GPT-5.5 Instant and 0% for Llama 2-7B.
  • Llama 2-7B has downloadable open weights; the other is API-only.

Side by side

GPT-5.5 InstantLlama 2-7B
ProviderOpenAIMeta
Noometry Index42.528.6
Released2026-05-052023-07-18
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2729

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.5 Instant leads

GPT-5.5 Instant: 43.7 (#73), Llama 2-7B: 28.7 (#302)

BenchmarkGPT-5.5 InstantLlama 2-7B
LMArena Coding14331002
SciCode48.6%—

Reasoning GPT-5.5 Instant leads

GPT-5.5 Instant: 24.2 (#149), Llama 2-7B: 15.1 (#309)

BenchmarkGPT-5.5 InstantLlama 2-7B
Chess Puzzles12%0%
LMArena Hard Prompts14261009
Epoch Capabilities Index142.4898.54
CritPt0%—
BIG-Bench Hard—39.2%
HellaSwag—77.2%
LAMBADA—73.3%
PIQA—78.8%
WinoGrande—69.2%

Math Llama 2-7B leads

GPT-5.5 Instant: 26.1 (#241), Llama 2-7B: 28.2 (#231)

BenchmarkGPT-5.5 InstantLlama 2-7B
LMArena Math14201042
FrontierMath (Tiers 1-3)26.3%—
FrontierMath Tier 42.4%—
OTIS Mock AIME 2024-202568.1%—
GSM8K—16.7%

Knowledge GPT-5.5 Instant leads

GPT-5.5 Instant: 48.9 (#68), Llama 2-7B: 27.7 (#243)

BenchmarkGPT-5.5 InstantLlama 2-7B
LMArena Expert14091036
GPQA Diamond82.5%—
ARC (AI2) Challenge—45.9%
BoolQ—77.9%
MMLU—45.8%
OpenBookQA—58.6%
TriviaQA—73.7%

Multimodal Not comparable

GPT-5.5 Instant: 39.3 (#48), Llama 2-7B: —

BenchmarkGPT-5.5 InstantLlama 2-7B
LMArena Vision1250—
LMArena Document1403—
ScienceQA—43.1%

Multilingual GPT-5.5 Instant leads

GPT-5.5 Instant: 53.0 (#76), Llama 2-7B: 23.9 (#288)

BenchmarkGPT-5.5 InstantLlama 2-7B
LMArena Non-English1417973
LMArena Chinese1457973
LMArena French1428969
LMArena German1410978
LMArena Russian1430995
LMArena Spanish14301007
LMArena Japanese1408—
LMArena Korean1393—

Instruction Following GPT-5.5 Instant leads

GPT-5.5 Instant: 74.4 (#94), Llama 2-7B: 51.0 (#293)

BenchmarkGPT-5.5 InstantLlama 2-7B
LMArena Instruction Following14071006

Long Context GPT-5.5 Instant leads

GPT-5.5 Instant: 43.4 (#92), Llama 2-7B: 30.4 (#282)

BenchmarkGPT-5.5 InstantLlama 2-7B
LMArena Longer Query1422999

Writing & Preference GPT-5.5 Instant leads

GPT-5.5 Instant: 62.0 (#81), Llama 2-7B: 28.1 (#293)

BenchmarkGPT-5.5 InstantLlama 2-7B
LMArena Text14191053
LMArena Creative Writing14201033
LMArena Multi-Turn14341029

Frequently asked questions

Is GPT-5.5 Instant better than Llama 2-7B?

GPT-5.5 Instant is the stronger model overall, scoring 42.5 to 28.6 on the Noometry Index.

Is GPT-5.5 Instant or Llama 2-7B better for coding?

GPT-5.5 Instant scores higher on coding benchmarks: 43.7 versus 28.7 in the Noometry coding category.

How many benchmarks do GPT-5.5 Instant and Llama 2-7B share?

17 benchmarks have published results for both models. GPT-5.5 Instant has 27 scored results on Noometry and Llama 2-7B has 29.

Related comparisons

Go deeper