Noometry

Model comparison

Gemini 1.5 Flash 8B vs MiniMax-M3

MiniMax-M3 is the stronger model overall, scoring 43.5 to 29.7 on the Noometry Index.

Last verified . 21 shared benchmarks.

Gemini 1.5 Flash 8B Google

29.7

Rank #292 Confirmed

MiniMax-M3 MiniMax

43.5

Rank #81 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 0 categories and MiniMax-M3 in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where MiniMax-M3 leads 58.4 to 16.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.6% for Gemini 1.5 Flash 8B and 71.1% for MiniMax-M3.
  • MiniMax-M3 has downloadable open weights; the other is API-only.

Side by side

Gemini 1.5 Flash 8BMiniMax-M3
ProviderGoogleMiniMax
Noometry Index29.743.5
Released2024-10-032026-06-01
WeightsProprietaryOpen
Context window—1M
Max output—512K
Input $ / M tokens—$0.30
Output $ / M tokens—$1.20
Results tracked2141

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax-M3 leads

Gemini 1.5 Flash 8B: 34.9 (#221), MiniMax-M3: 41.5 (#111)

BenchmarkGemini 1.5 Flash 8BMiniMax-M3
LMArena Coding12181470
FrontierCode—14.7%
LMArena WebDev—1482
SciCode—47.1%
ALE-Bench—640.02

Agentic & Tool Use Not comparable

Gemini 1.5 Flash 8B: —, MiniMax-M3: 22.5 (#121)

BenchmarkGemini 1.5 Flash 8BMiniMax-M3
APEX-Agents—37.7%
OSWorld 2.0—4.6%
GBAEval—0.9%
Vending-Bench 2—2,158

Reasoning MiniMax-M3 leads

Gemini 1.5 Flash 8B: 19.2 (#242), MiniMax-M3: 29.3 (#83)

BenchmarkGemini 1.5 Flash 8BMiniMax-M3
LMArena Hard Prompts12101447
DTBench50%78.9%
SimpleBench—45.8%
NYT Connections (extended)—65.1%
CritPt—3.7%
Chess Puzzles—14%
Mystery Game Puzzles—8%
LMCA—33.7%
Surface Evolver Bench—55%
Epoch Capabilities Index—147
ForecastBench—61.4

Math MiniMax-M3 leads

Gemini 1.5 Flash 8B: 13.3 (#296), MiniMax-M3: 39.1 (#83)

BenchmarkGemini 1.5 Flash 8BMiniMax-M3
OTIS Mock AIME 2024-20254.6%71.1%
LMArena Math12071432
ProofBench—18%

Knowledge MiniMax-M3 leads

Gemini 1.5 Flash 8B: 16.0 (#285), MiniMax-M3: 58.4 (#32)

BenchmarkGemini 1.5 Flash 8BMiniMax-M3
GPQA Diamond33%90.9%
LMArena Expert11851462

Multimodal MiniMax-M3 leads

Gemini 1.5 Flash 8B: 27.6 (#110), MiniMax-M3: 39.5 (#45)

BenchmarkGemini 1.5 Flash 8BMiniMax-M3
LMArena Vision10441254
LMArena Document—1435

Multilingual MiniMax-M3 leads

Gemini 1.5 Flash 8B: 38.6 (#224), MiniMax-M3: 53.2 (#70)

BenchmarkGemini 1.5 Flash 8BMiniMax-M3
LMArena Non-English12151420
LMArena Chinese12311465
LMArena French12331445
LMArena German12061424
LMArena Japanese11501381
LMArena Korean11401372
LMArena Russian12361430
LMArena Spanish12121431

Instruction Following MiniMax-M3 leads

Gemini 1.5 Flash 8B: 63.1 (#231), MiniMax-M3: 75.7 (#56)

BenchmarkGemini 1.5 Flash 8BMiniMax-M3
LMArena Instruction Following11991433

Long Context MiniMax-M3 leads

Gemini 1.5 Flash 8B: 36.9 (#220), MiniMax-M3: 44.2 (#68)

BenchmarkGemini 1.5 Flash 8BMiniMax-M3
LMArena Longer Query12191445

Writing & Preference MiniMax-M3 leads

Gemini 1.5 Flash 8B: 43.0 (#227), MiniMax-M3: 62.3 (#79)

BenchmarkGemini 1.5 Flash 8BMiniMax-M3
LMArena Text12261433
LMArena Creative Writing12181405
LMArena Multi-Turn11851441
EQ-Bench 4—1150

Frequently asked questions

Is Gemini 1.5 Flash 8B better than MiniMax-M3?

MiniMax-M3 is the stronger model overall, scoring 43.5 to 29.7 on the Noometry Index.

Is Gemini 1.5 Flash 8B or MiniMax-M3 better for coding?

MiniMax-M3 scores higher on coding benchmarks: 41.5 versus 34.9 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash 8B and MiniMax-M3 share?

21 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and MiniMax-M3 has 41.

Related comparisons

Go deeper