Noometry

Model comparison

Gemini 2.5 Flash-Lite vs Granite 3.1 8b Instruct

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 37.0 to 32.4 on the Noometry Index.

Last verified . 13 shared benchmarks.

Gemini 2.5 Flash-Lite Google

37.0

Rank #211 Confirmed

Granite 3.1 8b Instruct IBM

32.4

Rank #258 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Gemini 2.5 Flash-Lite scores higher in 8 categories and Granite 3.1 8b Instruct in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemini 2.5 Flash-Lite leads 56.8 to 35.5.
  • The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 36.9% for Gemini 2.5 Flash-Lite and 27.1% for Granite 3.1 8b Instruct.
  • Granite 3.1 8b Instruct has downloadable open weights; the other is API-only.

Side by side

Gemini 2.5 Flash-LiteGranite 3.1 8b Instruct
ProviderGoogleIBM
Noometry Index37.032.4
Released2025-06-17—
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.40—
Results tracked3313

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 38.5 (#173), Granite 3.1 8b Instruct: 34.5 (#233)

BenchmarkGemini 2.5 Flash-LiteGranite 3.1 8b Instruct
LMArena Coding13731186
WeirdML35.2%—
ALE-Bench325.9—

Agentic & Tool Use Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 28.0 (#96), Granite 3.1 8b Instruct: 24.1 (#120)

BenchmarkGemini 2.5 Flash-LiteGranite 3.1 8b Instruct
Berkeley Function Calling Leaderboard36.9%27.1%

Reasoning Too close to call

Gemini 2.5 Flash-Lite: 22.2 (#205), Granite 3.1 8b Instruct: 22.1 (#207)

BenchmarkGemini 2.5 Flash-LiteGranite 3.1 8b Instruct
LMArena Hard Prompts13771145
Kagi LLM Benchmark40.5%—
DTBench62.8%—
LMCA18.1%—
Epoch Capabilities Index133.94—

Math Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 38.0 (#144), Granite 3.1 8b Instruct: 33.0 (#209)

BenchmarkGemini 2.5 Flash-LiteGranite 3.1 8b Instruct
LMArena Math13731152
Omni-MATH48%—

Knowledge Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 32.5 (#210), Granite 3.1 8b Instruct: 31.1 (#220)

BenchmarkGemini 2.5 Flash-LiteGranite 3.1 8b Instruct
LMArena Expert13731142
MMLU-Pro53.7%—
Vectara Hallucination Rate3.3%—
GPQA (HELM)30.9%—

Multimodal Not comparable

Gemini 2.5 Flash-Lite: 29.1 (#114), Granite 3.1 8b Instruct: —

BenchmarkGemini 2.5 Flash-LiteGranite 3.1 8b Instruct
LMArena Vision1198—
VPCT30%—

Multilingual Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 49.3 (#134), Granite 3.1 8b Instruct: 30.9 (#260)

BenchmarkGemini 2.5 Flash-LiteGranite 3.1 8b Instruct
LMArena Non-English13691099
LMArena Chinese14041145
LMArena Russian13731092
LMArena French1388—
LMArena German1389—
LMArena Japanese1359—
LMArena Korean1360—
LMArena Spanish1396—

Instruction Following Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 70.0 (#168), Granite 3.1 8b Instruct: 58.6 (#259)

BenchmarkGemini 2.5 Flash-LiteGranite 3.1 8b Instruct
LMArena Instruction Following13671131
IFEval81%—

Long Context Granite 3.1 8b Instruct leads

Gemini 2.5 Flash-Lite: 33.3 (#262), Granite 3.1 8b Instruct: 35.2 (#241)

BenchmarkGemini 2.5 Flash-LiteGranite 3.1 8b Instruct
LMArena Longer Query13731162
Fiction.LiveBench47.2%—

Writing & Preference Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 56.8 (#135), Granite 3.1 8b Instruct: 35.5 (#266)

BenchmarkGemini 2.5 Flash-LiteGranite 3.1 8b Instruct
LMArena Text13791150
LMArena Creative Writing13671129
LMArena Multi-Turn13661108
WildBench81.8%—

Frequently asked questions

Is Gemini 2.5 Flash-Lite better than Granite 3.1 8b Instruct?

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 37.0 to 32.4 on the Noometry Index.

Is Gemini 2.5 Flash-Lite or Granite 3.1 8b Instruct better for coding?

Gemini 2.5 Flash-Lite scores higher on coding benchmarks: 38.5 versus 34.5 in the Noometry coding category.

How many benchmarks do Gemini 2.5 Flash-Lite and Granite 3.1 8b Instruct share?

13 benchmarks have published results for both models. Gemini 2.5 Flash-Lite has 33 scored results on Noometry and Granite 3.1 8b Instruct has 13.

Related comparisons

Go deeper