Noometry

Model comparison

Dolly 2.0-12b vs Gemini 3.5 Flash Lite

Gemini 3.5 Flash Lite is the stronger model overall, scoring 41.8 to 24.9 on the Noometry Index.

Last verified . 10 shared benchmarks.

Dolly 2.0-12b Databricks

24.9

Rank #339 Confirmed

Gemini 3.5 Flash Lite Google

41.8

Rank #113 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Dolly 2.0-12b scores higher in 0 categories and Gemini 3.5 Flash Lite in 6 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemini 3.5 Flash Lite leads 64.4 to 15.3.
  • Dolly 2.0-12b has downloadable open weights; the other is API-only.

Side by side

Dolly 2.0-12bGemini 3.5 Flash Lite
ProviderDatabricksGoogle
Noometry Index24.941.8
Released2023-04-112026-07-21
WeightsOpenProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$0.30
Output $ / M tokens—$2.50
Results tracked1738

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.5 Flash Lite leads

Dolly 2.0-12b: 23.0 (#327), Gemini 3.5 Flash Lite: 42.1 (#96)

BenchmarkDolly 2.0-12bGemini 3.5 Flash Lite
LMArena Coding7761455
LMArena WebDev—1440
SciCode—41.3%
WeirdML—39%
ALE-Bench—765.27

Agentic & Tool Use Not comparable

Dolly 2.0-12b: —, Gemini 3.5 Flash Lite: 28.6 (#82)

BenchmarkDolly 2.0-12bGemini 3.5 Flash Lite
GDP.pdf—10%

Reasoning Gemini 3.5 Flash Lite leads

Dolly 2.0-12b: 14.6 (#315), Gemini 3.5 Flash Lite: 27.8 (#95)

BenchmarkDolly 2.0-12bGemini 3.5 Flash Lite
LMArena Hard Prompts8041441
Epoch Capabilities Index88.94145.12
ARC-AGI-2—10.3%
NYT Connections (extended)—60.4%
ARC-AGI-1—53.5%
CritPt—0%
Chess Puzzles—22%
Mystery Game Puzzles—19%
DTBench—83.5%
LMCA—37.6%
HellaSwag70.8%—
PIQA75.4%—
WinoGrande61.8%—

Math Too close to call

Dolly 2.0-12b: 25.0 (#250), Gemini 3.5 Flash Lite: 25.7 (#245)

BenchmarkDolly 2.0-12bGemini 3.5 Flash Lite
LMArena Math8711431
FrontierMath (Tiers 1-3)—26%
FrontierMath Tier 4—0%
OTIS Mock AIME 2024-2025—71.1%
ProofBench—13%

Knowledge Not comparable

Dolly 2.0-12b: —, Gemini 3.5 Flash Lite: 50.0 (#66)

BenchmarkDolly 2.0-12bGemini 3.5 Flash Lite
GPQA Diamond—83.3%
LMArena Expert—1430
ARC (AI2) Challenge39.6%—
BoolQ56.3%—
MMLU26.2%—
OpenBookQA39.2%—

Multimodal Not comparable

Dolly 2.0-12b: —, Gemini 3.5 Flash Lite: 40.3 (#38)

BenchmarkDolly 2.0-12bGemini 3.5 Flash Lite
LMArena Vision—1266

Multilingual Gemini 3.5 Flash Lite leads

Dolly 2.0-12b: 17.4 (#291), Gemini 3.5 Flash Lite: 53.8 (#59)

BenchmarkDolly 2.0-12bGemini 3.5 Flash Lite
LMArena Non-English8361428
LMArena Chinese8361467
LMArena French—1452
LMArena German—1454
LMArena Japanese—1428
LMArena Korean—1406
LMArena Russian—1443
LMArena Spanish—1440

Instruction Following Gemini 3.5 Flash Lite leads

Dolly 2.0-12b: 38.9 (#299), Gemini 3.5 Flash Lite: 75.0 (#77)

BenchmarkDolly 2.0-12bGemini 3.5 Flash Lite
LMArena Instruction Following8141420

Long Context Not comparable

Dolly 2.0-12b: —, Gemini 3.5 Flash Lite: 43.8 (#80)

BenchmarkDolly 2.0-12bGemini 3.5 Flash Lite
LMArena Longer Query—1435

Writing & Preference Gemini 3.5 Flash Lite leads

Dolly 2.0-12b: 15.3 (#306), Gemini 3.5 Flash Lite: 64.4 (#55)

BenchmarkDolly 2.0-12bGemini 3.5 Flash Lite
LMArena Text8511436
LMArena Creative Writing8641419
LMArena Multi-Turn7401445
EQ-Bench Creative Writing—1559

Frequently asked questions

Is Dolly 2.0-12b better than Gemini 3.5 Flash Lite?

Gemini 3.5 Flash Lite is the stronger model overall, scoring 41.8 to 24.9 on the Noometry Index.

Is Dolly 2.0-12b or Gemini 3.5 Flash Lite better for coding?

Gemini 3.5 Flash Lite scores higher on coding benchmarks: 42.1 versus 23.0 in the Noometry coding category.

How many benchmarks do Dolly 2.0-12b and Gemini 3.5 Flash Lite share?

10 benchmarks have published results for both models. Dolly 2.0-12b has 17 scored results on Noometry and Gemini 3.5 Flash Lite has 38.

Related comparisons

Go deeper