Noometry

Model comparison

Codellama 34b Instruct vs Inkling-Small

Inkling-Small is the stronger model overall, scoring 46.5 to 30.8 on the Noometry Index.

Last verified . 10 shared benchmarks.

Codellama 34b Instruct Meta

30.8

Rank #287 Confirmed

Inkling-Small Thinking Machines Lab

46.5

Rank #63 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Codellama 34b Instruct scores higher in 0 categories and Inkling-Small in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Inkling-Small leads 59.6 to 28.2.

Side by side

Codellama 34b InstructInkling-Small
ProviderMetaThinking Machines Lab
Noometry Index30.846.5
Released—2026-07-15
WeightsOpenOpen
Context window—524K
Max output—1.05M
Input $ / M tokens—$0.45
Output $ / M tokens—$1.20
Results tracked1433

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Inkling-Small leads

Codellama 34b Instruct: 28.5 (#314), Inkling-Small: 43.6 (#85)

BenchmarkCodellama 34b InstructInkling-Small
LMArena Coding10461451
LMArena WebDev—1409
SciCode—48.7%
BigCodeBench Instruct29%—
BigCodeBench Complete37.1%—
HumanEval+43.9%—
MBPP+56.3%—

Reasoning Inkling-Small leads

Codellama 34b Instruct: 19.6 (#255), Inkling-Small: 38.6 (#63)

BenchmarkCodellama 34b InstructInkling-Small
LMArena Hard Prompts10321423
ARC-AGI-2—40.1%
ARC-AGI-1—84%
CritPt—8.3%
Chess Puzzles—18%
Mystery Game Puzzles—6%
Epoch Capabilities Index—150.15

Math Inkling-Small leads

Codellama 34b Instruct: 31.0 (#230), Inkling-Small: 45.1 (#77)

BenchmarkCodellama 34b InstructInkling-Small
LMArena Math10561459
FrontierMath (Tiers 1-3)—46.3%
FrontierMath Tier 4—17.1%
OTIS Mock AIME 2024-2025—90%
ProofBench—6%

Knowledge Not comparable

Codellama 34b Instruct: —, Inkling-Small: 48.2 (#77)

BenchmarkCodellama 34b InstructInkling-Small
GPQA Diamond—88.5%
SimpleQA Verified—19.1%
LMArena Expert—1442

Multimodal Not comparable

Codellama 34b Instruct: —, Inkling-Small: 39.1 (#62)

BenchmarkCodellama 34b InstructInkling-Small
LMArena Vision—1235

Multilingual Inkling-Small leads

Codellama 34b Instruct: 25.8 (#284), Inkling-Small: 51.7 (#104)

BenchmarkCodellama 34b InstructInkling-Small
LMArena Non-English10111402
LMArena Chinese9761465
LMArena French—1436
LMArena German—1405
LMArena Japanese—1405
LMArena Korean—1363
LMArena Russian—1391
LMArena Spanish—1428

Instruction Following Inkling-Small leads

Codellama 34b Instruct: 52.2 (#291), Inkling-Small: 73.8 (#114)

BenchmarkCodellama 34b InstructInkling-Small
LMArena Instruction Following10281399

Long Context Inkling-Small leads

Codellama 34b Instruct: 30.9 (#284), Inkling-Small: 42.7 (#118)

BenchmarkCodellama 34b InstructInkling-Small
LMArena Longer Query10131401

Writing & Preference Inkling-Small leads

Codellama 34b Instruct: 28.2 (#297), Inkling-Small: 59.6 (#107)

BenchmarkCodellama 34b InstructInkling-Small
LMArena Text10661414
LMArena Creative Writing10321331
LMArena Multi-Turn10151418
EQ-Bench Creative Writing—1491

Frequently asked questions

Is Codellama 34b Instruct better than Inkling-Small?

Inkling-Small is the stronger model overall, scoring 46.5 to 30.8 on the Noometry Index.

Is Codellama 34b Instruct or Inkling-Small better for coding?

Inkling-Small scores higher on coding benchmarks: 43.6 versus 28.5 in the Noometry coding category.

How many benchmarks do Codellama 34b Instruct and Inkling-Small share?

10 benchmarks have published results for both models. Codellama 34b Instruct has 14 scored results on Noometry and Inkling-Small has 33.

Related comparisons

Go deeper