Model comparison
Claude 2.1 vs Llama 3.2 90B
Llama 3.2 90B is the stronger model overall, scoring 27.5 to 25.2 on the Noometry Index.
Last verified . 4 shared benchmarks.
MetaSummary
- They share 4 benchmarks with published results for both. Claude 2.1 scores higher in 0 categories and Llama 3.2 90B in 3 categories; one gap is clear of the uncertainty.
- The widest gap is in knowledge, where Llama 3.2 90B leads 21.7 to 15.4.
- The biggest single-benchmark swing is GPQA Diamond: 33% for Claude 2.1 and 41% for Llama 3.2 90B.
- Llama 3.2 90B has downloadable open weights; the other is API-only.
Side by side
| Claude 2.1 | Llama 3.2 90B | |
|---|---|---|
| Provider | Anthropic | Meta |
| Noometry Index | 25.2 | 27.5 |
| Released | 2023-11-21 | 2024-09-24 |
| Weights | Proprietary | Open |
| Context window | — | — |
| Max output | — | — |
| Input $ / M tokens | — | — |
| Output $ / M tokens | — | — |
| Results tracked | 7 | 9 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Not comparable
Claude 2.1: 26.2 (#327), Llama 3.2 90B: —
| Benchmark | Claude 2.1 | Llama 3.2 90B |
|---|---|---|
| WeirdML | 7.1% | — |
Agentic & Tool Use Not comparable
Claude 2.1: —, Llama 3.2 90B: 30.0 (#80)
| Benchmark | Claude 2.1 | Llama 3.2 90B |
|---|---|---|
| BALROG | — | 27.3% |
Reasoning Too close to call
Claude 2.1: 21.4 (#221), Llama 3.2 90B: 21.7 (#217)
| Benchmark | Claude 2.1 | Llama 3.2 90B |
|---|---|---|
| Epoch Capabilities Index | 119.27 | 125.5 |
| EnigmaEval | — | 0.4% |
| DTBench | 51% | — |
| ForecastBench | 54.2 | — |
Math Too close to call
Claude 2.1: 10.2 (#315), Llama 3.2 90B: 11.1 (#308)
| Benchmark | Claude 2.1 | Llama 3.2 90B |
|---|---|---|
| OTIS Mock AIME 2024-2025 | 1.9% | 2.6% |
| MATH Level 5 | — | 39.4% |
Knowledge Llama 3.2 90B leads
Claude 2.1: 15.4 (#292), Llama 3.2 90B: 21.7 (#274)
| Benchmark | Claude 2.1 | Llama 3.2 90B |
|---|---|---|
| GPQA Diamond | 33% | 41% |
| MMLU | 73.5% | 80.3% |
Multimodal Not comparable
Claude 2.1: —, Llama 3.2 90B: 25.4 (#124)
| Benchmark | Claude 2.1 | Llama 3.2 90B |
|---|---|---|
| LMArena Vision | — | 1000 |
| GeoBench | — | 52% |
Frequently asked questions
Is Claude 2.1 better than Llama 3.2 90B?
Llama 3.2 90B is the stronger model overall, scoring 27.5 to 25.2 on the Noometry Index.
How many benchmarks do Claude 2.1 and Llama 3.2 90B share?
4 benchmarks have published results for both models. Claude 2.1 has 7 scored results on Noometry and Llama 3.2 90B has 9.