Model comparison

Codestral vs Gemini 3.1 Flash Lite

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.8 to 30.6 on the Noometry Index.

Last verified . 2 shared benchmarks.

Codestral Mistral AI

30.6

Rank #290 Reported

Gemini 3.1 Flash Lite Google

40.8

Rank #144 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Codestral scores higher in 0 categories and Gemini 3.1 Flash Lite in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Gemini 3.1 Flash Lite leads 37.8 to 27.3.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 32.5% for Codestral and 67.2% for Gemini 3.1 Flash Lite.
  • Codestral is cheaper at $0.30 / $0.90 per million input/output tokens, against $0.25 / $1.50 for Gemini 3.1 Flash Lite.
  • Gemini 3.1 Flash Lite accepts more context: 1.05M tokens versus 256K.

Side by side

Codestral and Gemini 3.1 Flash Lite specifications
CodestralGemini 3.1 Flash Lite
ProviderMistral AIGoogle
Noometry Index30.640.8
Released2024-05-292026-03-03
WeightsProprietaryProprietary
Context window256K1.05M
Max output8K66K
Input $ / M tokens$0.30$0.25
Output $ / M tokens$0.90$1.50
Results tracked738

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.1 Flash Lite leads

Codestral: 27.3 (#321), Gemini 3.1 Flash Lite: 37.8 (#188)

Coding benchmarks
BenchmarkCodestralGemini 3.1 Flash Lite
ALE-Bench137.78797.73
Aider Polyglot11.1%—
LMArena WebDev—1256
SciCode—41.9%
WeirdML—52.2%
BigCodeBench Instruct41.8%—
LMArena Coding—1400
BigCodeBench Complete52.5%—
HumanEval+73.8%—
MBPP+61.9%—

Agentic & Tool Use Not comparable

Codestral: —, Gemini 3.1 Flash Lite: 30.2 (#79)

Agentic & Tool Use benchmarks
BenchmarkCodestralGemini 3.1 Flash Lite
DeepResearch Bench—37.3%

Reasoning Gemini 3.1 Flash Lite leads

Codestral: 19.8 (#251), Gemini 3.1 Flash Lite: 22.9 (#186)

Reasoning benchmarks
BenchmarkCodestralGemini 3.1 Flash Lite
Kagi LLM Benchmark32.5%67.2%
NYT Connections (extended)—8.2%
CritPt—1.1%
Chess Puzzles—25%
EnigmaEval—3%
Thematic Generalization—63.3%
LMArena Hard Prompts—1407
DTBench—76.8%
LMCA—35%
Epoch Capabilities Index—144.47
ForecastBench—54.4

Math Not comparable

Codestral: —, Gemini 3.1 Flash Lite: 40.7 (#90)

Math benchmarks
BenchmarkCodestralGemini 3.1 Flash Lite
FrontierMath (Tiers 1-3)—27.7%
OTIS Mock AIME 2024-2025—80%
LMArena Math—1428

Knowledge Not comparable

Codestral: —, Gemini 3.1 Flash Lite: 41.9 (#104)

Knowledge benchmarks
BenchmarkCodestralGemini 3.1 Flash Lite
GPQA Diamond—81.8%
Humanity's Last Exam—8.6%
Vectara Hallucination Rate—8.2%
LMArena Expert—1398

Multimodal Not comparable

Codestral: —, Gemini 3.1 Flash Lite: 39.4 (#60)

Multimodal benchmarks
BenchmarkCodestralGemini 3.1 Flash Lite
LMArena Vision—1240

Multilingual Not comparable

Codestral: —, Gemini 3.1 Flash Lite: 52.3 (#86)

Multilingual benchmarks
BenchmarkCodestralGemini 3.1 Flash Lite
LMArena Non-English—1411
LMArena Chinese—1461
LMArena French—1424
LMArena German—1429
LMArena Japanese—1413
LMArena Korean—1392
LMArena Russian—1420
LMArena Spanish—1421

Instruction Following Not comparable

Codestral: —, Gemini 3.1 Flash Lite: 72.7 (#131)

Instruction Following benchmarks
BenchmarkCodestralGemini 3.1 Flash Lite
LMArena Instruction Following—1377

Long Context Not comparable

Codestral: —, Gemini 3.1 Flash Lite: 42.5 (#122)

Long Context benchmarks
BenchmarkCodestralGemini 3.1 Flash Lite
LMArena Longer Query—1394

Writing & Preference Not comparable

Codestral: —, Gemini 3.1 Flash Lite: 60.9 (#94)

Writing & Preference benchmarks
BenchmarkCodestralGemini 3.1 Flash Lite
LMArena Text—1416
LMArena Creative Writing—1401
LMArena Multi-Turn—1417

Frequently asked questions

Is Codestral better than Gemini 3.1 Flash Lite?

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.8 to 30.6 on the Noometry Index.

Which is cheaper, Codestral or Gemini 3.1 Flash Lite?

Codestral is cheaper. It lists at $0.30 per million input tokens and $0.90 per million output tokens; Gemini 3.1 Flash Lite lists at $0.25 and $1.50.

Is Codestral or Gemini 3.1 Flash Lite better for coding?

Gemini 3.1 Flash Lite scores higher on coding benchmarks: 37.8 versus 27.3 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.1 Flash Lite does, with 1.05M tokens against 256K.

How many benchmarks do Codestral and Gemini 3.1 Flash Lite share?

2 benchmarks have published results for both models. Codestral has 7 scored results on Noometry and Gemini 3.1 Flash Lite has 38.

Related comparisons

Go deeper