Noometry

Model comparison

Gemini 1.5 Flash 8B vs Inkling

Inkling is the stronger model overall, scoring 44.1 to 29.9 on the Noometry Index.

Last verified . 20 shared benchmarks.

Gemini 1.5 Flash 8B Google

29.9

Rank #301 Confirmed

Inkling Thinking Machines Lab

44.1

Rank #80 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 1 category and Inkling in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Inkling leads 55.1 to 16.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.6% for Gemini 1.5 Flash 8B and 88.9% for Inkling.
  • Inkling has downloadable open weights; the other is API-only.

Side by side

Gemini 1.5 Flash 8BInkling
ProviderGoogleThinking Machines Lab
Noometry Index29.944.1
Released2024-10-032026-07-15
WeightsProprietaryOpen
Context window—66K
Max output—66K
Input $ / M tokens—$1.87
Output $ / M tokens—$4.68
Results tracked2141

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Gemini 1.5 Flash 8B: 35.5 (#225), Inkling: 34.5 (#234)

BenchmarkGemini 1.5 Flash 8BInkling
LMArena Coding12181464
FrontierCode—14%
LMArena WebDev—1413
FrontierSWE—4.1%
SciCode—47%
WeirdML—32.3%
ALE-Bench—946

Agentic & Tool Use Not comparable

Gemini 1.5 Flash 8B: —, Inkling: 29.6 (#85)

BenchmarkGemini 1.5 Flash 8BInkling
APEX-Agents—33.8%
τ²-bench Banking—25%

Reasoning Inkling leads

Gemini 1.5 Flash 8B: 20.0 (#244), Inkling: 40.4 (#56)

BenchmarkGemini 1.5 Flash 8BInkling
LMArena Hard Prompts12091451
DTBench50%87.5%
ARC-AGI-2—36.5%
SimpleBench—50%
ARC-AGI-1—79.5%
CritPt—5.4%
Chess Puzzles—21%
LMCA—37.6%
Epoch Capabilities Index—148.54

Math Inkling leads

Gemini 1.5 Flash 8B: 14.2 (#302), Inkling: 31.3 (#225)

BenchmarkGemini 1.5 Flash 8BInkling
OTIS Mock AIME 2024-20254.6%88.9%
LMArena Math12071479
FrontierMath (Tiers 1-3)—33.3%
FrontierMath Tier 4—4.9%
ProofBench—0%

Knowledge Inkling leads

Gemini 1.5 Flash 8B: 16.0 (#289), Inkling: 55.1 (#49)

BenchmarkGemini 1.5 Flash 8BInkling
GPQA Diamond33%88.3%
LMArena Expert11851465
SimpleQA Verified—40.3%

Multimodal Not comparable

Gemini 1.5 Flash 8B: 28.2 (#115), Inkling: —

BenchmarkGemini 1.5 Flash 8BInkling
LMArena Vision1044—

Multilingual Inkling leads

Gemini 1.5 Flash 8B: 38.5 (#229), Inkling: 54.0 (#52)

BenchmarkGemini 1.5 Flash 8BInkling
LMArena Non-English12151434
LMArena Chinese12311490
LMArena French12341458
LMArena German12061446
LMArena Japanese11501429
LMArena Korean11401404
LMArena Russian12361429
LMArena Spanish12121448

Instruction Following Inkling leads

Gemini 1.5 Flash 8B: 62.8 (#236), Inkling: 75.1 (#71)

BenchmarkGemini 1.5 Flash 8BInkling
LMArena Instruction Following11991426

Long Context Inkling leads

Gemini 1.5 Flash 8B: 37.0 (#225), Inkling: 43.8 (#86)

BenchmarkGemini 1.5 Flash 8BInkling
LMArena Longer Query12191434

Writing & Preference Inkling leads

Gemini 1.5 Flash 8B: 42.8 (#232), Inkling: 65.2 (#51)

BenchmarkGemini 1.5 Flash 8BInkling
LMArena Text12261441
LMArena Creative Writing12181387
LMArena Multi-Turn11851436
EQ-Bench Creative Writing—1611
EQ-Bench 4—1226

Frequently asked questions

Is Gemini 1.5 Flash 8B better than Inkling?

Inkling is the stronger model overall, scoring 44.1 to 29.9 on the Noometry Index.

Is Gemini 1.5 Flash 8B or Inkling better for coding?

They score almost the same on coding (35.5 vs 34.5); test both on your own repository before choosing.

How many benchmarks do Gemini 1.5 Flash 8B and Inkling share?

20 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and Inkling has 41.

Related comparisons

Go deeper