Model comparison

Gemini 2.5 Flash vs Wizardlm 70b

Gemini 2.5 Flash is the stronger model overall, scoring 39.3 to 33.0 on the Noometry Index.

Last verified . 12 shared benchmarks.

Gemini 2.5 Flash Google

39.3

Rank #170 Confirmed

Wizardlm 70b Microsoft

33.0

Rank #249 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Gemini 2.5 Flash scores higher in 6 categories and Wizardlm 70b in 1 category; 7 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where Gemini 2.5 Flash leads 52.3 to 29.6.
  • Wizardlm 70b has downloadable open weights; the other is API-only.

Side by side

Gemini 2.5 Flash and Wizardlm 70b specifications
Gemini 2.5 FlashWizardlm 70b
ProviderGoogleMicrosoft
Noometry Index39.333.0
Released2025-04-17—
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$0.30—
Output $ / M tokens$2.50—
Results tracked5412

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash leads

Gemini 2.5 Flash: 35.8 (#220), Wizardlm 70b: 31.4 (#285)

Coding benchmarks
BenchmarkGemini 2.5 FlashWizardlm 70b
LMArena Coding14241081
SWE-bench Verified (bash only)28.7%—
Aider Polyglot55.1%—
WeirdML41.9%—
ALE-Bench661.88—

Agentic & Tool Use Not comparable

Gemini 2.5 Flash: 30.8 (#74), Wizardlm 70b: —

Agentic & Tool Use benchmarks
BenchmarkGemini 2.5 FlashWizardlm 70b
Terminal-Bench17.1%—
Berkeley Function Calling Leaderboard56.2%—
TheAgentCompany41.1%—
BALROG33.5%—
Vending-Bench 2548.84—

Reasoning Wizardlm 70b leads

Gemini 2.5 Flash: 18.1 (#286), Wizardlm 70b: 20.7 (#234)

Reasoning benchmarks
BenchmarkGemini 2.5 FlashWizardlm 70b
LMArena Hard Prompts14221079
ARC-AGI-22.5%—
SimpleBench41.2%—
Kagi LLM Benchmark56.8%—
ARC-AGI-133.3%—
CritPt1.1%—
EnigmaEval2.7%—
DTBench76.5%—
LMCA27.5%—
Epoch Capabilities Index143.03—
ForecastBench60.6—

Math Gemini 2.5 Flash leads

Gemini 2.5 Flash: 39.9 (#98), Wizardlm 70b: 32.2 (#218)

Math benchmarks
BenchmarkGemini 2.5 FlashWizardlm 70b
LMArena Math14151116
OTIS Mock AIME 2024-202573.1%—
Omni-MATH38.5%—
FrontierMath (Feb 2025 set)4.8%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Not comparable

Gemini 2.5 Flash: 36.4 (#168), Wizardlm 70b: —

Knowledge benchmarks
BenchmarkGemini 2.5 FlashWizardlm 70b
Humanity's Last Exam12.1%—
MMLU-Pro63.9%—
Confabulations16.8%—
Vectara Hallucination Rate7.8%—
GPQA (HELM)39%—
LMArena Expert1426—

Multimodal Not comparable

Gemini 2.5 Flash: 41.8 (#32), Wizardlm 70b: —

Multimodal benchmarks
BenchmarkGemini 2.5 FlashWizardlm 70b
LMArena Vision1253—
GeoBench76%—
VPCT46.2%—
SpatialViz-Bench36.9%—

Multilingual Gemini 2.5 Flash leads

Gemini 2.5 Flash: 52.3 (#88), Wizardlm 70b: 29.6 (#265)

Multilingual benchmarks
BenchmarkGemini 2.5 FlashWizardlm 70b
LMArena Non-English14091078
LMArena Chinese14501052
LMArena German14181083
LMArena Russian14151155
LMArena French1433—
LMArena Japanese1405—
LMArena Korean1385—
LMArena Spanish1421—

Instruction Following Gemini 2.5 Flash leads

Gemini 2.5 Flash: 75.7 (#54), Wizardlm 70b: 56.3 (#273)

Instruction Following benchmarks
BenchmarkGemini 2.5 FlashWizardlm 70b
LMArena Instruction Following14051093
IFEval89.8%—

Long Context Gemini 2.5 Flash leads

Gemini 2.5 Flash: 47.5 (#17), Wizardlm 70b: 33.3 (#263)

Long Context benchmarks
BenchmarkGemini 2.5 FlashWizardlm 70b
LMArena Longer Query14191097
Fiction.LiveBench77.8%—

Writing & Preference Gemini 2.5 Flash leads

Gemini 2.5 Flash: 53.8 (#157), Wizardlm 70b: 34.8 (#269)

Writing & Preference benchmarks
BenchmarkGemini 2.5 FlashWizardlm 70b
LMArena Text14171120
LMArena Creative Writing14001149
LMArena Multi-Turn14081108
Short-Story Creative Writing76.5%—
EQ-Bench Creative Writing1137—
WildBench81.7%—

Frequently asked questions

Is Gemini 2.5 Flash better than Wizardlm 70b?

Gemini 2.5 Flash is the stronger model overall, scoring 39.3 to 33.0 on the Noometry Index.

Is Gemini 2.5 Flash or Wizardlm 70b better for coding?

Gemini 2.5 Flash scores higher on coding benchmarks: 35.8 versus 31.4 in the Noometry coding category.

How many benchmarks do Gemini 2.5 Flash and Wizardlm 70b share?

12 benchmarks have published results for both models. Gemini 2.5 Flash has 54 scored results on Noometry and Wizardlm 70b has 12.

Related comparisons

Go deeper