Noometry

Model comparison

Inkling vs Mixtral 8x22B

Inkling is the stronger model overall, scoring 44.1 to 27.1 on the Noometry Index.

Last verified . 21 shared benchmarks.

Inkling Thinking Machines Lab

44.1

Rank #80 Confirmed

Mixtral 8x22B Mistral AI

27.1

Rank #333 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Inkling scores higher in 9 categories and Mixtral 8x22B in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Inkling leads 55.1 to 15.1.
  • The biggest single-benchmark swing is GPQA Diamond: 88.3% for Inkling and 34.1% for Mixtral 8x22B.
  • Inkling is cheaper at $1.87 / $4.68 per million input/output tokens, against $2 / $6 for Mixtral 8x22B.
  • Inkling accepts more context: 66K tokens versus 64K.

Side by side

InklingMixtral 8x22B
ProviderThinking Machines LabMistral AI
Noometry Index44.127.1
Released2026-07-152024-04-17
WeightsOpenOpen
Context window66K64K
Max output66K64K
Input $ / M tokens$1.87$2
Output $ / M tokens$4.68$6
Results tracked4134

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Inkling leads

Inkling: 34.5 (#234), Mixtral 8x22B: 24.2 (#329)

BenchmarkInklingMixtral 8x22B
WeirdML32.3%3.2%
LMArena Coding14641166
FrontierCode14%—
LMArena WebDev1413—
FrontierSWE4.1%—
SciCode47%—
BigCodeBench Instruct—40.6%
BigCodeBench Complete—50.2%
ALE-Bench946—
HumanEval+—72%
MBPP+—64.3%

Agentic & Tool Use Inkling leads

Inkling: 29.6 (#85), Mixtral 8x22B: 23.1 (#127)

BenchmarkInklingMixtral 8x22B
APEX-Agents33.8%—
τ²-bench Banking25%—
Cybench—7.5%

Reasoning Inkling leads

Inkling: 40.4 (#56), Mixtral 8x22B: 19.9 (#248)

BenchmarkInklingMixtral 8x22B
LMArena Hard Prompts14511150
DTBench87.5%55.1%
Epoch Capabilities Index148.54122.03
ARC-AGI-236.5%—
SimpleBench50%—
ARC-AGI-179.5%—
CritPt5.4%—
Chess Puzzles21%—
LMCA37.6%—
ForecastBench—56.3

Math Inkling leads

Inkling: 31.3 (#225), Mixtral 8x22B: 22.9 (#275)

BenchmarkInklingMixtral 8x22B
LMArena Math14791184
FrontierMath (Tiers 1-3)33.3%—
FrontierMath Tier 44.9%—
OTIS Mock AIME 2024-202588.9%—
ProofBench0%—
Omni-MATH—16.3%
MATH Level 5—24.2%

Knowledge Inkling leads

Inkling: 55.1 (#49), Mixtral 8x22B: 15.1 (#293)

BenchmarkInklingMixtral 8x22B
GPQA Diamond88.3%34.1%
LMArena Expert14651113
SimpleQA Verified40.3%—
MMLU-Pro—46%
GPQA (HELM)—33.4%
MMLU—77.8%

Multilingual Inkling leads

Inkling: 54.0 (#52), Mixtral 8x22B: 32.8 (#255)

BenchmarkInklingMixtral 8x22B
LMArena Non-English14341128
LMArena Chinese14901116
LMArena French14581166
LMArena German14461141
LMArena Japanese14291037
LMArena Korean14041057
LMArena Russian14291158
LMArena Spanish14481151

Instruction Following Inkling leads

Inkling: 75.1 (#71), Mixtral 8x22B: 57.7 (#266)

BenchmarkInklingMixtral 8x22B
LMArena Instruction Following14261147
IFEval—72.4%

Long Context Inkling leads

Inkling: 43.8 (#86), Mixtral 8x22B: 34.7 (#247)

BenchmarkInklingMixtral 8x22B
LMArena Longer Query14341144

Writing & Preference Inkling leads

Inkling: 65.2 (#51), Mixtral 8x22B: 36.9 (#262)

BenchmarkInklingMixtral 8x22B
LMArena Text14411162
LMArena Creative Writing13871141
LMArena Multi-Turn14361130
EQ-Bench Creative Writing1611—
WildBench—71.1%
EQ-Bench 41226—

Frequently asked questions

Is Inkling better than Mixtral 8x22B?

Inkling is the stronger model overall, scoring 44.1 to 27.1 on the Noometry Index.

Which is cheaper, Inkling or Mixtral 8x22B?

Inkling is cheaper. It lists at $1.87 per million input tokens and $4.68 per million output tokens; Mixtral 8x22B lists at $2 and $6.

Is Inkling or Mixtral 8x22B better for coding?

Inkling scores higher on coding benchmarks: 34.5 versus 24.2 in the Noometry coding category.

Which has the bigger context window?

Inkling does, with 66K tokens against 64K.

How many benchmarks do Inkling and Mixtral 8x22B share?

21 benchmarks have published results for both models. Inkling has 41 scored results on Noometry and Mixtral 8x22B has 34.

Related comparisons

Go deeper