Model comparison

Llama 3-70B vs MiMo-V2-Flash

MiMo-V2-Flash is the stronger model overall, scoring 41.3 to 28.8 on the Noometry Index.

Last verified . 17 shared benchmarks.

Llama 3-70B Meta

28.8

Rank #323 Confirmed

MiMo-V2-Flash Xiaomi

41.3

Rank #138 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Llama 3-70B scores higher in 0 categories and MiMo-V2-Flash in 8 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where MiMo-V2-Flash leads 38.3 to 12.8.

Side by side

Llama 3-70B and MiMo-V2-Flash specifications
Llama 3-70BMiMo-V2-Flash
ProviderMetaXiaomi
Noometry Index28.841.3
Released2024-04-182025-12-16
WeightsOpenOpen
Context window—262K
Max output—66K
Input $ / M tokens—$0.14
Output $ / M tokens—$0.28
Results tracked3121

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Llama 3-70B: 35.8 (#218), MiMo-V2-Flash: 36.1 (#211)

Coding benchmarks
BenchmarkLlama 3-70BMiMo-V2-Flash
LMArena Coding12061443
LMArena WebDev—1330
SciCode—25.9%
BigCodeBench Instruct43.6%—
BigCodeBench Complete54.5%—
ALE-Bench—737.95
HumanEval+72%—
MBPP+69%—

Agentic & Tool Use Not comparable

Llama 3-70B: 21.1 (#139), MiMo-V2-Flash: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3-70BMiMo-V2-Flash
Cybench5%—

Reasoning MiMo-V2-Flash leads

Llama 3-70B: 18.0 (#288), MiMo-V2-Flash: 24.9 (#157)

Reasoning benchmarks
BenchmarkLlama 3-70BMiMo-V2-Flash
LMArena Hard Prompts11951420
Kagi LLM Benchmark35.1%—
CritPt—0%
DTBench54.2%—
Epoch Capabilities Index122.93—
ForecastBench57.1—
WinoGrande83.5%—

Math MiMo-V2-Flash leads

Llama 3-70B: 12.8 (#305), MiMo-V2-Flash: 38.3 (#139)

Math benchmarks
BenchmarkLlama 3-70BMiMo-V2-Flash
LMArena Math12181396
OTIS Mock AIME 2024-20254.3%—
MATH Level 522.6%—

Knowledge MiMo-V2-Flash leads

Llama 3-70B: 20.8 (#277), MiMo-V2-Flash: 39.7 (#131)

Knowledge benchmarks
BenchmarkLlama 3-70BMiMo-V2-Flash
LMArena Expert11491425
GPQA Diamond40.6%—
MMLU79.3%—

Multilingual MiMo-V2-Flash leads

Llama 3-70B: 33.6 (#251), MiMo-V2-Flash: 51.0 (#113)

Multilingual benchmarks
BenchmarkLlama 3-70BMiMo-V2-Flash
LMArena Non-English11421392
LMArena Chinese11141462
LMArena French12321429
LMArena German11691395
LMArena Japanese10171325
LMArena Korean10171358
LMArena Russian11591387
LMArena Spanish12411420

Instruction Following MiMo-V2-Flash leads

Llama 3-70B: 62.5 (#238), MiMo-V2-Flash: 73.5 (#120)

Instruction Following benchmarks
BenchmarkLlama 3-70BMiMo-V2-Flash
LMArena Instruction Following11941392

Long Context MiMo-V2-Flash leads

Llama 3-70B: 35.6 (#240), MiMo-V2-Flash: 43.0 (#110)

Long Context benchmarks
BenchmarkLlama 3-70BMiMo-V2-Flash
LMArena Longer Query11741409

Writing & Preference MiMo-V2-Flash leads

Llama 3-70B: 42.8 (#231), MiMo-V2-Flash: 59.7 (#106)

Writing & Preference benchmarks
BenchmarkLlama 3-70BMiMo-V2-Flash
LMArena Text12211411
LMArena Creative Writing12101375
LMArena Multi-Turn12231404

Frequently asked questions

Is Llama 3-70B better than MiMo-V2-Flash?

MiMo-V2-Flash is the stronger model overall, scoring 41.3 to 28.8 on the Noometry Index.

Is Llama 3-70B or MiMo-V2-Flash better for coding?

They score almost the same on coding (35.8 vs 36.1); test both on your own repository before choosing.

How many benchmarks do Llama 3-70B and MiMo-V2-Flash share?

17 benchmarks have published results for both models. Llama 3-70B has 31 scored results on Noometry and MiMo-V2-Flash has 21.

Related comparisons

Go deeper