Model comparison

Inkling-Small vs Llama 3.2 1B

Inkling-Small is the stronger model overall, scoring 46.5 to 19.9 on the Noometry Index. Llama 3.2 1B costs 9.0× less per token, which makes it the better buy when Inkling-Small's lead doesn't matter for your workload.

Last verified . 18 shared benchmarks.

Inkling-Small Thinking Machines Lab

46.5

Rank #57 Confirmed

Llama 3.2 1B Meta

19.9

Rank #349 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Inkling-Small scores higher in 8 categories and Llama 3.2 1B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Inkling-Small leads 48.3 to 7.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 90% for Inkling-Small and 0.6% for Llama 3.2 1B.
  • Llama 3.2 1B is cheaper at $0.027 / $0.20 per million input/output tokens, against $0.45 / $1.20 for Inkling-Small.
  • Inkling-Small accepts more context: 524K tokens versus 60K.

Side by side

Inkling-Small and Llama 3.2 1B specifications
Inkling-SmallLlama 3.2 1B
ProviderThinking Machines LabMeta
Noometry Index46.519.9
Released2026-07-152024-09-24
WeightsOpenOpen
Context window524K60K
Max output1.05M54K
Input $ / M tokens$0.45$0.027
Output $ / M tokens$1.20$0.20
Results tracked3322

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Inkling-Small leads

Inkling-Small: 43.3 (#80), Llama 3.2 1B: 20.6 (#333)

Coding benchmarks
BenchmarkInkling-SmallLlama 3.2 1B
LMArena Coding14511071
LMArena WebDev1408—
SciCode48.7%—
BigCodeBench Instruct—8.2%
BigCodeBench Complete—11.3%

Agentic & Tool Use Not comparable

Inkling-Small: —, Llama 3.2 1B: 14.5 (#142)

Agentic & Tool Use benchmarks
BenchmarkInkling-SmallLlama 3.2 1B
Berkeley Function Calling Leaderboard—10.8%
BALROG—6.6%

Reasoning Inkling-Small leads

Inkling-Small: 39.0 (#53), Llama 3.2 1B: 15.6 (#304)

Reasoning benchmarks
BenchmarkInkling-SmallLlama 3.2 1B
Chess Puzzles18%0%
LMArena Hard Prompts14241044
Epoch Capabilities Index150.13101.95
ARC-AGI-240.1%—
ARC-AGI-184%—
CritPt8.3%—
Mystery Game Puzzles6%—

Math Inkling-Small leads

Inkling-Small: 44.9 (#65), Llama 3.2 1B: 9.7 (#308)

Math benchmarks
BenchmarkInkling-SmallLlama 3.2 1B
OTIS Mock AIME 2024-202590%0.6%
LMArena Math14531086
FrontierMath (Tiers 1-3)46.3%—
FrontierMath Tier 417.1%—
ProofBench6%—

Knowledge Inkling-Small leads

Inkling-Small: 48.3 (#71), Llama 3.2 1B: 7.2 (#307)

Knowledge benchmarks
BenchmarkInkling-SmallLlama 3.2 1B
GPQA Diamond88.5%23.9%
LMArena Expert14421007
SimpleQA Verified19.1%—

Multimodal Not comparable

Inkling-Small: 38.4 (#59), Llama 3.2 1B: —

Multimodal benchmarks
BenchmarkInkling-SmallLlama 3.2 1B
LMArena Vision1235—

Multilingual Inkling-Small leads

Inkling-Small: 51.7 (#102), Llama 3.2 1B: 23.9 (#287)

Multilingual benchmarks
BenchmarkInkling-SmallLlama 3.2 1B
LMArena Non-English1400973
LMArena Chinese1458958
LMArena German14121014
LMArena Russian1392941
LMArena French1438—
LMArena Japanese1399—
LMArena Korean1355—
LMArena Spanish1426—

Instruction Following Inkling-Small leads

Inkling-Small: 73.9 (#112), Llama 3.2 1B: 52.6 (#285)

Instruction Following benchmarks
BenchmarkInkling-SmallLlama 3.2 1B
LMArena Instruction Following13971031

Long Context Inkling-Small leads

Inkling-Small: 42.7 (#113), Llama 3.2 1B: 31.9 (#269)

Long Context benchmarks
BenchmarkInkling-SmallLlama 3.2 1B
LMArena Longer Query14011050

Writing & Preference Inkling-Small leads

Inkling-Small: 59.8 (#102), Llama 3.2 1B: 21.4 (#305)

Writing & Preference benchmarks
BenchmarkInkling-SmallLlama 3.2 1B
LMArena Text14131055
LMArena Creative Writing13301033
EQ-Bench Creative Writing1491200
LMArena Multi-Turn14201030

Frequently asked questions

Is Inkling-Small better than Llama 3.2 1B?

Inkling-Small is the stronger model overall, scoring 46.5 to 19.9 on the Noometry Index. Llama 3.2 1B costs 9.0× less per token, which makes it the better buy when Inkling-Small's lead doesn't matter for your workload.

Which is cheaper, Inkling-Small or Llama 3.2 1B?

Llama 3.2 1B is cheaper. It lists at $0.027 per million input tokens and $0.20 per million output tokens; Inkling-Small lists at $0.45 and $1.20.

Is Inkling-Small or Llama 3.2 1B better for coding?

Inkling-Small scores higher on coding benchmarks: 43.3 versus 20.6 in the Noometry coding category.

Which has the bigger context window?

Inkling-Small does, with 524K tokens against 60K.

How many benchmarks do Inkling-Small and Llama 3.2 1B share?

18 benchmarks have published results for both models. Inkling-Small has 33 scored results on Noometry and Llama 3.2 1B has 22.

Related comparisons

Go deeper