Noometry

Model comparison

Gemini 3.5 Flash Lite vs Tulu 3 (Tülu 3) 70B

Gemini 3.5 Flash Lite is the stronger model overall, scoring 41.8 to 32.6 on the Noometry Index.

Last verified . 13 shared benchmarks.

Gemini 3.5 Flash Lite Google

41.8

Rank #113 Confirmed

Tulu 3 (Tülu 3) 70B Allen Institute for AI (Ai2)

32.6

Rank #242 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Gemini 3.5 Flash Lite scores higher in 8 categories and Tulu 3 (Tülu 3) 70B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 3.5 Flash Lite leads 50.0 to 25.1.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 71.1% for Gemini 3.5 Flash Lite and 4.4% for Tulu 3 (Tülu 3) 70B.
  • Tulu 3 (Tülu 3) 70B has downloadable open weights; the other is API-only.

Side by side

Gemini 3.5 Flash LiteTulu 3 (Tülu 3) 70B
ProviderGoogleAllen Institute for AI (Ai2)
Noometry Index41.832.6
Released2026-07-212024-11-21
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$0.30—
Output $ / M tokens$2.50—
Results tracked3814

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 42.1 (#96), Tulu 3 (Tülu 3) 70B: 35.4 (#211)

BenchmarkGemini 3.5 Flash LiteTulu 3 (Tülu 3) 70B
LMArena Coding14551236
LMArena WebDev1440—
SciCode41.3%—
WeirdML39%—
ALE-Bench765.27—

Agentic & Tool Use Not comparable

Gemini 3.5 Flash Lite: 28.6 (#82), Tulu 3 (Tülu 3) 70B: —

BenchmarkGemini 3.5 Flash LiteTulu 3 (Tülu 3) 70B
GDP.pdf10%—

Reasoning Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 27.8 (#95), Tulu 3 (Tülu 3) 70B: 22.9 (#172)

BenchmarkGemini 3.5 Flash LiteTulu 3 (Tülu 3) 70B
LMArena Hard Prompts14411220
ARC-AGI-210.3%—
NYT Connections (extended)60.4%—
ARC-AGI-153.5%—
CritPt0%—
Chess Puzzles22%—
Mystery Game Puzzles19%—
DTBench83.5%—
LMCA37.6%—
Epoch Capabilities Index145.12—

Math Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 25.7 (#245), Tulu 3 (Tülu 3) 70B: 13.3 (#297)

BenchmarkGemini 3.5 Flash LiteTulu 3 (Tülu 3) 70B
OTIS Mock AIME 2024-202571.1%4.4%
LMArena Math14311242
FrontierMath (Tiers 1-3)26%—
FrontierMath Tier 40%—
ProofBench13%—
MATH Level 5—42.7%

Knowledge Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 50.0 (#66), Tulu 3 (Tülu 3) 70B: 25.1 (#257)

BenchmarkGemini 3.5 Flash LiteTulu 3 (Tülu 3) 70B
GPQA Diamond83.3%46.3%
LMArena Expert1430—

Multimodal Not comparable

Gemini 3.5 Flash Lite: 40.3 (#38), Tulu 3 (Tülu 3) 70B: —

BenchmarkGemini 3.5 Flash LiteTulu 3 (Tülu 3) 70B
LMArena Vision1266—

Multilingual Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 53.8 (#59), Tulu 3 (Tülu 3) 70B: 40.1 (#217)

BenchmarkGemini 3.5 Flash LiteTulu 3 (Tülu 3) 70B
LMArena Non-English14281236
LMArena Chinese14671249
LMArena Russian14431246
LMArena French1452—
LMArena German1454—
LMArena Japanese1428—
LMArena Korean1406—
LMArena Spanish1440—

Instruction Following Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 75.0 (#77), Tulu 3 (Tülu 3) 70B: 65.0 (#222)

BenchmarkGemini 3.5 Flash LiteTulu 3 (Tülu 3) 70B
LMArena Instruction Following14201233

Long Context Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 43.8 (#80), Tulu 3 (Tülu 3) 70B: 37.1 (#217)

BenchmarkGemini 3.5 Flash LiteTulu 3 (Tülu 3) 70B
LMArena Longer Query14351224

Writing & Preference Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 64.4 (#55), Tulu 3 (Tülu 3) 70B: 45.8 (#218)

BenchmarkGemini 3.5 Flash LiteTulu 3 (Tülu 3) 70B
LMArena Text14361256
LMArena Creative Writing14191231
LMArena Multi-Turn14451252
EQ-Bench Creative Writing1559—

Frequently asked questions

Is Gemini 3.5 Flash Lite better than Tulu 3 (Tülu 3) 70B?

Gemini 3.5 Flash Lite is the stronger model overall, scoring 41.8 to 32.6 on the Noometry Index.

Is Gemini 3.5 Flash Lite or Tulu 3 (Tülu 3) 70B better for coding?

Gemini 3.5 Flash Lite scores higher on coding benchmarks: 42.1 versus 35.4 in the Noometry coding category.

How many benchmarks do Gemini 3.5 Flash Lite and Tulu 3 (Tülu 3) 70B share?

13 benchmarks have published results for both models. Gemini 3.5 Flash Lite has 38 scored results on Noometry and Tulu 3 (Tülu 3) 70B has 14.

Related comparisons

Go deeper