Noometry

Model comparison

Gemini 2.5 Flash-Lite vs StarCoder 2 7B

Gemini 2.5 Flash-Lite has enough public results to be ranked (#208); StarCoder 2 7B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Gemini 2.5 Flash-Lite Google

36.4

Rank #208 Confirmed

StarCoder 2 7B NVIDIA

36.5

Unranked Sparse

Summary

  • They share 1 benchmark with published results for both. Gemini 2.5 Flash-Lite scores higher in 1 category and StarCoder 2 7B in 0 categories; one gap is clear of the uncertainty.
  • The widest gap is in coding, where Gemini 2.5 Flash-Lite leads 38.0 to 34.2.
  • StarCoder 2 7B has downloadable open weights; the other is API-only.

Side by side

Gemini 2.5 Flash-LiteStarCoder 2 7B
ProviderGoogleNVIDIA
Noometry Index36.436.5
Released2025-06-172024-02-20
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.40—
Results tracked337

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 38.0 (#167), StarCoder 2 7B: 34.2

BenchmarkGemini 2.5 Flash-LiteStarCoder 2 7B
WeirdML35.2%—
LMArena Coding1373—
BigCodeBench Complete—27.7%
ALE-Bench325.9—
HumanEval+—29.9%

Agentic & Tool Use Not comparable

Gemini 2.5 Flash-Lite: 27.8 (#89), StarCoder 2 7B: —

BenchmarkGemini 2.5 Flash-LiteStarCoder 2 7B
Berkeley Function Calling Leaderboard36.9%—

Reasoning Not comparable

Gemini 2.5 Flash-Lite: 21.5 (#196), StarCoder 2 7B: —

BenchmarkGemini 2.5 Flash-LiteStarCoder 2 7B
Epoch Capabilities Index133.9392.92
Kagi LLM Benchmark40.5%—
LMArena Hard Prompts1377—
DTBench62.8%—
LMCA18.1%—
WinoGrande—57.1%

Math Not comparable

Gemini 2.5 Flash-Lite: 35.5 (#144), StarCoder 2 7B: —

BenchmarkGemini 2.5 Flash-LiteStarCoder 2 7B
Omni-MATH48%—
LMArena Math1373—
GSM8K—32.7%

Knowledge Not comparable

Gemini 2.5 Flash-Lite: 32.1 (#206), StarCoder 2 7B: —

BenchmarkGemini 2.5 Flash-LiteStarCoder 2 7B
MMLU-Pro53.7%—
Vectara Hallucination Rate3.3%—
GPQA (HELM)30.9%—
LMArena Expert1373—
ARC (AI2) Challenge—38.7%
MMLU—38.8%

Multimodal Not comparable

Gemini 2.5 Flash-Lite: 28.6 (#109), StarCoder 2 7B: —

BenchmarkGemini 2.5 Flash-LiteStarCoder 2 7B
LMArena Vision1198—
VPCT30%—

Multilingual Not comparable

Gemini 2.5 Flash-Lite: 49.5 (#129), StarCoder 2 7B: —

BenchmarkGemini 2.5 Flash-LiteStarCoder 2 7B
LMArena Non-English1369—
LMArena Chinese1404—
LMArena French1388—
LMArena German1390—
LMArena Japanese1359—
LMArena Korean1358—
LMArena Russian1373—
LMArena Spanish1396—

Instruction Following Not comparable

Gemini 2.5 Flash-Lite: 70.2 (#163), StarCoder 2 7B: —

BenchmarkGemini 2.5 Flash-LiteStarCoder 2 7B
IFEval81%—
LMArena Instruction Following1366—

Long Context Not comparable

Gemini 2.5 Flash-Lite: 33.3 (#257), StarCoder 2 7B: —

BenchmarkGemini 2.5 Flash-LiteStarCoder 2 7B
Fiction.LiveBench47.2%—
LMArena Longer Query1373—

Writing & Preference Not comparable

Gemini 2.5 Flash-Lite: 57.0 (#130), StarCoder 2 7B: —

BenchmarkGemini 2.5 Flash-LiteStarCoder 2 7B
LMArena Text1379—
LMArena Creative Writing1366—
WildBench81.8%—
LMArena Multi-Turn1367—

Frequently asked questions

Is Gemini 2.5 Flash-Lite better than StarCoder 2 7B?

Gemini 2.5 Flash-Lite has enough public results to be ranked (#208); StarCoder 2 7B does not yet, so treat this comparison as directional.

Is Gemini 2.5 Flash-Lite or StarCoder 2 7B better for coding?

Gemini 2.5 Flash-Lite scores higher on coding benchmarks: 38.0 versus 34.2 in the Noometry coding category.

How many benchmarks do Gemini 2.5 Flash-Lite and StarCoder 2 7B share?

1 benchmark has published results for both models. Gemini 2.5 Flash-Lite has 33 scored results on Noometry and StarCoder 2 7B has 7.

Related comparisons

Go deeper