Noometry

Model comparison

Gemini 3.5 Flash vs Inkling

Gemini 3.5 Flash is the stronger model overall, scoring 54.2 to 44.1 on the Noometry Index.

Last verified . 37 shared benchmarks.

Gemini 3.5 Flash Google

54.2

Rank #32 Confirmed

Inkling Thinking Machines Lab

44.1

Rank #80 Confirmed

Summary

  • They share 37 benchmarks with published results for both. Gemini 3.5 Flash scores higher in 8 categories and Inkling in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 3.5 Flash leads 60.7 to 31.3.
  • The biggest single-benchmark swing is ARC-AGI-2: 72.1% for Gemini 3.5 Flash and 36.5% for Inkling.
  • Inkling is cheaper at $1.87 / $4.68 per million input/output tokens, against $1.50 / $9 for Gemini 3.5 Flash.
  • Gemini 3.5 Flash accepts more context: 1.05M tokens versus 66K.
  • Inkling has downloadable open weights; the other is API-only.

Side by side

Gemini 3.5 FlashInkling
ProviderGoogleThinking Machines Lab
Noometry Index54.244.1
Released2026-05-192026-07-15
WeightsProprietaryOpen
Context window1.05M66K
Max output66K66K
Input $ / M tokens$1.50$1.87
Output $ / M tokens$9$4.68
Results tracked5441

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.5 Flash leads

Gemini 3.5 Flash: 49.4 (#49), Inkling: 34.5 (#234)

BenchmarkGemini 3.5 FlashInkling
LMArena WebDev14991413
SciCode53.1%47%
WeirdML62.6%32.3%
LMArena Coding14921464
ALE-Bench911.02946
SWE-bench Verified79.3%—
DeepSWE37.4%—
FrontierCode—14%
FrontierSWE—4.1%

Agentic & Tool Use Inkling leads

Gemini 3.5 Flash: 24.7 (#114), Inkling: 29.6 (#85)

BenchmarkGemini 3.5 FlashInkling
APEX-Agents27.5%33.8%
τ²-bench Banking—25%
GBAEval6.7%—
GDP.pdf14%—
Vending-Bench 25,396—

Reasoning Gemini 3.5 Flash leads

Gemini 3.5 Flash: 62.8 (#18), Inkling: 40.4 (#56)

BenchmarkGemini 3.5 FlashInkling
ARC-AGI-272.1%36.5%
SimpleBench76.7%50%
ARC-AGI-192.5%79.5%
CritPt13.1%5.4%
Chess Puzzles50%21%
LMArena Hard Prompts14881451
DTBench94.7%87.5%
LMCA47.1%37.6%
Epoch Capabilities Index154.46148.54
NYT Connections (extended)92.6%—
EnigmaEval25.4%—
EBR-Bench4.8%—
Mystery Game Puzzles32%—
Surface Evolver Bench58.1%—
ForecastBench59—

Math Gemini 3.5 Flash leads

Gemini 3.5 Flash: 60.7 (#36), Inkling: 31.3 (#225)

BenchmarkGemini 3.5 FlashInkling
FrontierMath (Tiers 1-3)62.8%33.3%
FrontierMath Tier 426.8%4.9%
OTIS Mock AIME 2024-202595.6%88.9%
ProofBench31%0%
LMArena Math15041479
MathArena Final-Answer Competitions76.3%—
FrontierMath (Feb 2025 set)39%—
FrontierMath Tier 4 (v1)14.6%—

Knowledge Gemini 3.5 Flash leads

Gemini 3.5 Flash: 66.3 (#11), Inkling: 55.1 (#49)

BenchmarkGemini 3.5 FlashInkling
GPQA Diamond92.8%88.3%
SimpleQA Verified66.2%40.3%
LMArena Expert14951465

Multimodal Not comparable

Gemini 3.5 Flash: 45.7 (#15), Inkling: —

BenchmarkGemini 3.5 FlashInkling
LMArena Vision1310—
Blueprint-Bench 233.6%—
LMArena Document1463—

Multilingual Gemini 3.5 Flash leads

Gemini 3.5 Flash: 57.0 (#13), Inkling: 54.0 (#52)

BenchmarkGemini 3.5 FlashInkling
LMArena Non-English14761434
LMArena Chinese15261490
LMArena French14901458
LMArena German14921446
LMArena Japanese14861429
LMArena Korean14511404
LMArena Russian14931429
LMArena Spanish14801448

Instruction Following Gemini 3.5 Flash leads

Gemini 3.5 Flash: 77.0 (#30), Inkling: 75.1 (#71)

BenchmarkGemini 3.5 FlashInkling
LMArena Instruction Following14671426

Long Context Gemini 3.5 Flash leads

Gemini 3.5 Flash: 45.4 (#38), Inkling: 43.8 (#86)

BenchmarkGemini 3.5 FlashInkling
LMArena Longer Query14821434

Writing & Preference Too close to call

Gemini 3.5 Flash: 65.5 (#47), Inkling: 65.2 (#51)

BenchmarkGemini 3.5 FlashInkling
LMArena Text14821441
LMArena Creative Writing14701387
EQ-Bench 410871226
LMArena Multi-Turn14811436
EQ-Bench Creative Writing—1611

Frequently asked questions

Is Gemini 3.5 Flash better than Inkling?

Gemini 3.5 Flash is the stronger model overall, scoring 54.2 to 44.1 on the Noometry Index.

Which is cheaper, Gemini 3.5 Flash or Inkling?

Inkling is cheaper. It lists at $1.87 per million input tokens and $4.68 per million output tokens; Gemini 3.5 Flash lists at $1.50 and $9.

Is Gemini 3.5 Flash or Inkling better for coding?

Gemini 3.5 Flash scores higher on coding benchmarks: 49.4 versus 34.5 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.5 Flash does, with 1.05M tokens against 66K.

How many benchmarks do Gemini 3.5 Flash and Inkling share?

37 benchmarks have published results for both models. Gemini 3.5 Flash has 54 scored results on Noometry and Inkling has 41.

Related comparisons

Go deeper