Model comparison

Llama 2-70B vs MiMo-V2.6-Flash

MiMo-V2.6-Flash is the stronger model overall, scoring 44.4 to 24.1 on the Noometry Index.

Last verified . 12 shared benchmarks.

Llama 2-70B Meta

24.1

Rank #343 Confirmed

MiMo-V2.6-Flash Xiaomi

44.4

Rank #74 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Llama 2-70B scores higher in 0 categories and MiMo-V2.6-Flash in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where MiMo-V2.6-Flash leads 42.0 to 7.4.

Side by side

Llama 2-70B and MiMo-V2.6-Flash specifications
Llama 2-70BMiMo-V2.6-Flash
ProviderMetaXiaomi
Noometry Index24.144.4
Released2023-07-182026-09-22
WeightsOpenOpen
Context window—1.05M
Max output—131K
Input $ / M tokens—$0.14
Output $ / M tokens—$0.28
Results tracked3513

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiMo-V2.6-Flash leads

Llama 2-70B: 30.8 (#281), MiMo-V2.6-Flash: 44.3 (#68)

Coding benchmarks
BenchmarkLlama 2-70BMiMo-V2.6-Flash
LMArena Coding10791516

Reasoning MiMo-V2.6-Flash leads

Llama 2-70B: 13.7 (#324), MiMo-V2.6-Flash: 29.6 (#82)

Reasoning benchmarks
BenchmarkLlama 2-70BMiMo-V2.6-Flash
LMArena Hard Prompts10731481
DTBench41.6%—
BIG-Bench Hard64.9%—
CommonsenseQA 2.050%—
Epoch Capabilities Index113.59—
ForecastBench51.4—
HellaSwag85.3%—
LAMBADA78.9%—
PIQA82.8%—
WinoGrande80.2%—

Math MiMo-V2.6-Flash leads

Llama 2-70B: 7.5 (#320), MiMo-V2.6-Flash: 37.4 (#97)

Math benchmarks
BenchmarkLlama 2-70BMiMo-V2.6-Flash
LMArena Math10911477
OTIS Mock AIME 2024-20250%—
MATH Level 53.3%—
GSM8K69.6%—

Knowledge MiMo-V2.6-Flash leads

Llama 2-70B: 7.4 (#305), MiMo-V2.6-Flash: 42.0 (#91)

Knowledge benchmarks
BenchmarkLlama 2-70BMiMo-V2.6-Flash
LMArena Expert10391516
GPQA Diamond26.3%—
ARC (AI2) Challenge78.3%—
BoolQ88.6%—
MMLU69.9%—
OpenBookQA60.2%—
TriviaQA87.6%—

Multimodal Not comparable

Llama 2-70B: —, MiMo-V2.6-Flash: 40.2 (#39)

Multimodal benchmarks
BenchmarkLlama 2-70BMiMo-V2.6-Flash
LMArena Vision—1266

Multilingual MiMo-V2.6-Flash leads

Llama 2-70B: 27.9 (#269), MiMo-V2.6-Flash: 54.6 (#41)

Multilingual benchmarks
BenchmarkLlama 2-70BMiMo-V2.6-Flash
LMArena Non-English10451439
LMArena Chinese9941501
LMArena Russian10831424
LMArena French1089—
LMArena German1041—
LMArena Japanese927—
LMArena Korean964—
LMArena Spanish1142—

Instruction Following MiMo-V2.6-Flash leads

Llama 2-70B: 55.1 (#273), MiMo-V2.6-Flash: 77.0 (#33)

Instruction Following benchmarks
BenchmarkLlama 2-70BMiMo-V2.6-Flash
LMArena Instruction Following10711463

Long Context MiMo-V2.6-Flash leads

Llama 2-70B: 32.2 (#265), MiMo-V2.6-Flash: 44.8 (#52)

Long Context benchmarks
BenchmarkLlama 2-70BMiMo-V2.6-Flash
LMArena Longer Query10621465

Writing & Preference MiMo-V2.6-Flash leads

Llama 2-70B: 32.5 (#274), MiMo-V2.6-Flash: 63.9 (#61)

Writing & Preference benchmarks
BenchmarkLlama 2-70BMiMo-V2.6-Flash
LMArena Text11151459
LMArena Creative Writing10751408
LMArena Multi-Turn10881460

Frequently asked questions

Is Llama 2-70B better than MiMo-V2.6-Flash?

MiMo-V2.6-Flash is the stronger model overall, scoring 44.4 to 24.1 on the Noometry Index.

Is Llama 2-70B or MiMo-V2.6-Flash better for coding?

MiMo-V2.6-Flash scores higher on coding benchmarks: 44.3 versus 30.8 in the Noometry coding category.

How many benchmarks do Llama 2-70B and MiMo-V2.6-Flash share?

12 benchmarks have published results for both models. Llama 2-70B has 35 scored results on Noometry and MiMo-V2.6-Flash has 13.

Related comparisons

Go deeper