Noometry

Model comparison

Gemma 4 31B IT vs Inkling

Gemma 4 31B IT and Inkling score almost the same on the Noometry Index (43.2 vs 44.1), so choose on price, context window or the category you care about most.

Last verified . 28 shared benchmarks.

Gemma 4 31B IT Google

43.2

Rank #85 Confirmed

Inkling Thinking Machines Lab

44.1

Rank #75 Confirmed

Summary

  • They share 28 benchmarks with published results for both. Gemma 4 31B IT scores higher in 4 categories and Inkling in 4 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Inkling leads 55.2 to 37.9.
  • The biggest single-benchmark swing is SimpleQA Verified: 10.4% for Gemma 4 31B IT and 40.3% for Inkling.
  • Gemma 4 31B IT is cheaper at $0.09 / $0.34 per million input/output tokens, against $1.87 / $4.68 for Inkling.
  • Gemma 4 31B IT accepts more context: 262K tokens versus 66K.

Side by side

Gemma 4 31B ITInkling
ProviderGoogleThinking Machines Lab
Noometry Index43.244.1
Released2026-04-022026-07-15
WeightsOpenOpen
Context window262K66K
Max output33K66K
Input $ / M tokens$0.09$1.87
Output $ / M tokens$0.34$4.68
Results tracked3541

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemma 4 31B IT leads

Gemma 4 31B IT: 41.9 (#98), Inkling: 34.1 (#229)

BenchmarkGemma 4 31B ITInkling
LMArena WebDev13641412
SciCode43.4%47%
WeirdML52.3%32.3%
LMArena Coding14591463
ALE-Bench925.5946
FrontierCode—14%
FrontierSWE—4.1%

Agentic & Tool Use Not comparable

Gemma 4 31B IT: —, Inkling: 29.5 (#76)

BenchmarkGemma 4 31B ITInkling
APEX-Agents—33.8%
τ²-bench Banking—25%

Reasoning Inkling leads

Gemma 4 31B IT: 26.4 (#119), Inkling: 40.6 (#48)

BenchmarkGemma 4 31B ITInkling
CritPt1.4%5.4%
Chess Puzzles5%21%
LMArena Hard Prompts14481452
DTBench82.7%87.5%
LMCA39.3%37.6%
Epoch Capabilities Index142.74148.6
ARC-AGI-2—36.5%
SimpleBench—50%
Kagi LLM Benchmark63.5%—
NYT Connections (extended)70.6%—
ARC-AGI-1—79.5%
Thematic Generalization53%—
Surface Evolver Bench30.6%—

Math Gemma 4 31B IT leads

Gemma 4 31B IT: 41.3 (#72), Inkling: 31.2 (#198)

BenchmarkGemma 4 31B ITInkling
OTIS Mock AIME 2024-202573.3%88.9%
LMArena Math14641482
FrontierMath (Tiers 1-3)—33.3%
FrontierMath Tier 4—4.9%
ProofBench—0%

Knowledge Inkling leads

Gemma 4 31B IT: 37.9 (#141), Inkling: 55.2 (#44)

BenchmarkGemma 4 31B ITInkling
GPQA Diamond75.8%88.3%
SimpleQA Verified10.4%40.3%
LMArena Expert14651468
Vectara Hallucination Rate7.4%—

Multimodal Not comparable

Gemma 4 31B IT: 41.0 (#32), Inkling: —

BenchmarkGemma 4 31B ITInkling
LMArena Vision1278—
LMArena Document1425—

Multilingual Too close to call

Gemma 4 31B IT: 54.0 (#52), Inkling: 54.2 (#49)

BenchmarkGemma 4 31B ITInkling
LMArena Non-English14311434
LMArena Chinese14781495
LMArena French14361453
LMArena Russian14621430
LMArena Spanish14431442
LMArena German—1456
LMArena Japanese—1428
LMArena Korean—1401

Instruction Following Too close to call

Gemma 4 31B IT: 75.6 (#58), Inkling: 75.3 (#65)

BenchmarkGemma 4 31B ITInkling
LMArena Instruction Following14331427

Long Context Too close to call

Gemma 4 31B IT: 44.2 (#67), Inkling: 43.9 (#79)

BenchmarkGemma 4 31B ITInkling
LMArena Longer Query14461436

Writing & Preference Inkling leads

Gemma 4 31B IT: 60.7 (#92), Inkling: 65.5 (#48)

BenchmarkGemma 4 31B ITInkling
LMArena Text14431443
LMArena Creative Writing14161390
EQ-Bench Creative Writing13681611
EQ-Bench 411201226
LMArena Multi-Turn14521436

Frequently asked questions

Is Gemma 4 31B IT better than Inkling?

Gemma 4 31B IT and Inkling score almost the same on the Noometry Index (43.2 vs 44.1), so choose on price, context window or the category you care about most.

Which is cheaper, Gemma 4 31B IT or Inkling?

Gemma 4 31B IT is cheaper. It lists at $0.09 per million input tokens and $0.34 per million output tokens; Inkling lists at $1.87 and $4.68.

Is Gemma 4 31B IT or Inkling better for coding?

Gemma 4 31B IT scores higher on coding benchmarks: 41.9 versus 34.1 in the Noometry coding category.

Which has the bigger context window?

Gemma 4 31B IT does, with 262K tokens against 66K.

How many benchmarks do Gemma 4 31B IT and Inkling share?

28 benchmarks have published results for both models. Gemma 4 31B IT has 35 scored results on Noometry and Inkling has 41.

Related comparisons

Go deeper