Noometry

Model comparison

Gemini 3.1 Flash Lite vs Llama 13b

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.8 to 24.4 on the Noometry Index.

Last verified . 9 shared benchmarks.

Gemini 3.1 Flash Lite Google

40.8

Rank #144 Confirmed

Llama 13b Meta

24.4

Rank #348 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Gemini 3.1 Flash Lite scores higher in 6 categories and Llama 13b in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemini 3.1 Flash Lite leads 60.9 to 13.8.
  • Llama 13b has downloadable open weights; the other is API-only.

Side by side

Gemini 3.1 Flash LiteLlama 13b
ProviderGoogleMeta
Noometry Index40.824.4
Released2026-03-032023-02-24
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$0.25—
Output $ / M tokens$1.50—
Results tracked3821

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 37.8 (#188), Llama 13b: 21.4 (#337)

BenchmarkGemini 3.1 Flash LiteLlama 13b
LMArena Coding1400683
LMArena WebDev1256—
SciCode41.9%—
WeirdML52.2%—
ALE-Bench797.73—

Agentic & Tool Use Not comparable

Gemini 3.1 Flash Lite: 30.2 (#79), Llama 13b: —

BenchmarkGemini 3.1 Flash LiteLlama 13b
DeepResearch Bench37.3%—

Reasoning Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 22.9 (#186), Llama 13b: 14.0 (#329)

BenchmarkGemini 3.1 Flash LiteLlama 13b
LMArena Hard Prompts1407728
Epoch Capabilities Index144.47100.58
Kagi LLM Benchmark67.2%—
NYT Connections (extended)8.2%—
CritPt1.1%—
Chess Puzzles25%—
EnigmaEval3%—
Thematic Generalization63.3%—
DTBench76.8%—
LMCA35%—
BIG-Bench Hard—37.9%
ForecastBench54.4—
HellaSwag—79.2%
LAMBADA—75.2%
PIQA—80.1%
WinoGrande—73%

Math Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 40.7 (#90), Llama 13b: 26.7 (#256)

BenchmarkGemini 3.1 Flash LiteLlama 13b
LMArena Math1428838
FrontierMath (Tiers 1-3)27.7%—
OTIS Mock AIME 2024-202580%—
GSM8K—20.6%

Knowledge Not comparable

Gemini 3.1 Flash Lite: 41.9 (#104), Llama 13b: —

BenchmarkGemini 3.1 Flash LiteLlama 13b
GPQA Diamond81.8%—
Humanity's Last Exam8.6%—
Vectara Hallucination Rate8.2%—
LMArena Expert1398—
ARC (AI2) Challenge—52.7%
BoolQ—78.7%
MMLU—47.7%
OpenBookQA—56.4%
TriviaQA—77.9%

Multimodal Not comparable

Gemini 3.1 Flash Lite: 39.4 (#60), Llama 13b: —

BenchmarkGemini 3.1 Flash LiteLlama 13b
LMArena Vision1240—
ScienceQA—43.3%

Multilingual Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 52.3 (#86), Llama 13b: 16.6 (#297)

BenchmarkGemini 3.1 Flash LiteLlama 13b
LMArena Non-English1411819
LMArena Chinese1461—
LMArena French1424—
LMArena German1429—
LMArena Japanese1413—
LMArena Korean1392—
LMArena Russian1420—
LMArena Spanish1421—

Instruction Following Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 72.7 (#131), Llama 13b: 36.7 (#305)

BenchmarkGemini 3.1 Flash LiteLlama 13b
LMArena Instruction Following1377781

Long Context Not comparable

Gemini 3.1 Flash Lite: 42.5 (#122), Llama 13b: —

BenchmarkGemini 3.1 Flash LiteLlama 13b
LMArena Longer Query1394—

Writing & Preference Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 60.9 (#94), Llama 13b: 13.8 (#312)

BenchmarkGemini 3.1 Flash LiteLlama 13b
LMArena Text1416834
LMArena Creative Writing1401794
LMArena Multi-Turn1417753

Frequently asked questions

Is Gemini 3.1 Flash Lite better than Llama 13b?

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.8 to 24.4 on the Noometry Index.

Is Gemini 3.1 Flash Lite or Llama 13b better for coding?

Gemini 3.1 Flash Lite scores higher on coding benchmarks: 37.8 versus 21.4 in the Noometry coding category.

How many benchmarks do Gemini 3.1 Flash Lite and Llama 13b share?

9 benchmarks have published results for both models. Gemini 3.1 Flash Lite has 38 scored results on Noometry and Llama 13b has 21.

Related comparisons

Go deeper