# Gemini 1.5 Flash 8B vs Inkling

> Inkling is the stronger model overall, scoring 44.1 to 29.9 on the Noometry Index.

- Canonical page: https://noometry.com/compare/gemini-1-5-flash-8b-vs-inkling
- Last updated: 2026-10-10
- Shared benchmarks: 20

## Summary

- They share 20 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 1 category and Inkling in 7 categories; 7 gaps are clear of the uncertainty.
- The widest gap is in knowledge, where Inkling leads 55.1 to 16.0.
- The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.6% for Gemini 1.5 Flash 8B and 88.9% for Inkling.
- Inkling has downloadable open weights; the other is API-only.

## Snapshot

| | Gemini 1.5 Flash 8B | Inkling |
|---|---|---|
| Provider | Google | Thinking Machines Lab |
| Noometry Index | 29.9 | 44.1 |
| Rank | 301 | 80 |
| Context | — | 66K |
| Input $/M | — | $1.87 |
| Output $/M | — | $4.68 |
| Weights | Proprietary | Open |

## Coding

- Gemini 1.5 Flash 8B: 35.5 (#225)
- Inkling: 34.5 (#234)

| Benchmark | Gemini 1.5 Flash 8B | Inkling |
|---|---|---|
| LMArena Coding | 1218 | 1464 |
| FrontierCode | — | 14% |
| LMArena WebDev | — | 1413 |
| FrontierSWE | — | 4.1% |
| SciCode | — | 47% |
| WeirdML | — | 32.3% |
| ALE-Bench | — | 946 |

## Agentic & Tool Use

- Gemini 1.5 Flash 8B: —
- Inkling: 29.6 (#85)

| Benchmark | Gemini 1.5 Flash 8B | Inkling |
|---|---|---|
| APEX-Agents | — | 33.8% |
| τ²-bench Banking | — | 25% |

## Reasoning

- Gemini 1.5 Flash 8B: 20.0 (#244)
- Inkling: 40.4 (#56)

| Benchmark | Gemini 1.5 Flash 8B | Inkling |
|---|---|---|
| LMArena Hard Prompts | 1209 | 1451 |
| DTBench | 50% | 87.5% |
| ARC-AGI-2 | — | 36.5% |
| SimpleBench | — | 50% |
| ARC-AGI-1 | — | 79.5% |
| CritPt | — | 5.4% |
| Chess Puzzles | — | 21% |
| LMCA | — | 37.6% |
| Epoch Capabilities Index | — | 148.54 |

## Math

- Gemini 1.5 Flash 8B: 14.2 (#302)
- Inkling: 31.3 (#225)

| Benchmark | Gemini 1.5 Flash 8B | Inkling |
|---|---|---|
| OTIS Mock AIME 2024-2025 | 4.6% | 88.9% |
| LMArena Math | 1207 | 1479 |
| FrontierMath (Tiers 1-3) | — | 33.3% |
| FrontierMath Tier 4 | — | 4.9% |
| ProofBench | — | 0% |

## Knowledge

- Gemini 1.5 Flash 8B: 16.0 (#289)
- Inkling: 55.1 (#49)

| Benchmark | Gemini 1.5 Flash 8B | Inkling |
|---|---|---|
| GPQA Diamond | 33% | 88.3% |
| LMArena Expert | 1185 | 1465 |
| SimpleQA Verified | — | 40.3% |

## Multimodal

- Gemini 1.5 Flash 8B: 28.2 (#115)
- Inkling: —

| Benchmark | Gemini 1.5 Flash 8B | Inkling |
|---|---|---|
| LMArena Vision | 1044 | — |

## Multilingual

- Gemini 1.5 Flash 8B: 38.5 (#229)
- Inkling: 54.0 (#52)

| Benchmark | Gemini 1.5 Flash 8B | Inkling |
|---|---|---|
| LMArena Non-English | 1215 | 1434 |
| LMArena Chinese | 1231 | 1490 |
| LMArena French | 1234 | 1458 |
| LMArena German | 1206 | 1446 |
| LMArena Japanese | 1150 | 1429 |
| LMArena Korean | 1140 | 1404 |
| LMArena Russian | 1236 | 1429 |
| LMArena Spanish | 1212 | 1448 |

## Instruction Following

- Gemini 1.5 Flash 8B: 62.8 (#236)
- Inkling: 75.1 (#71)

| Benchmark | Gemini 1.5 Flash 8B | Inkling |
|---|---|---|
| LMArena Instruction Following | 1199 | 1426 |

## Long Context

- Gemini 1.5 Flash 8B: 37.0 (#225)
- Inkling: 43.8 (#86)

| Benchmark | Gemini 1.5 Flash 8B | Inkling |
|---|---|---|
| LMArena Longer Query | 1219 | 1434 |

## Writing & Preference

- Gemini 1.5 Flash 8B: 42.8 (#232)
- Inkling: 65.2 (#51)

| Benchmark | Gemini 1.5 Flash 8B | Inkling |
|---|---|---|
| LMArena Text | 1226 | 1441 |
| LMArena Creative Writing | 1218 | 1387 |
| LMArena Multi-Turn | 1185 | 1436 |
| EQ-Bench Creative Writing | — | 1611 |
| EQ-Bench 4 | — | 1226 |

## FAQ

### Is Gemini 1.5 Flash 8B better than Inkling?

Inkling is the stronger model overall, scoring 44.1 to 29.9 on the Noometry Index.

### Is Gemini 1.5 Flash 8B or Inkling better for coding?

They score almost the same on coding (35.5 vs 34.5); test both on your own repository before choosing.

### How many benchmarks do Gemini 1.5 Flash 8B and Inkling share?

20 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and Inkling has 41.