Model comparison

Qwen2.5 7B Instruct vs Wizardlm 70b

Wizardlm 70b is the stronger model overall, scoring 33.0 to 29.0 on the Noometry Index.

Last verified . 0 shared benchmarks.

Qwen2.5 7B Instruct Alibaba (Qwen)

29.0

Rank #320 Confirmed

Wizardlm 70b Microsoft

33.0

Rank #249 Confirmed

Summary

  • The widest gap is in math, where Wizardlm 70b leads 32.2 to 12.6.

Side by side

Qwen2.5 7B Instruct and Wizardlm 70b specifications
Qwen2.5 7B InstructWizardlm 70b
ProviderAlibaba (Qwen)Microsoft
Noometry Index29.033.0
Released2024-09—
WeightsOpenOpen
Context window131K—
Max output8K—
Input $ / M tokens$0.17—
Output $ / M tokens$0.70—
Results tracked1512

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen2.5 7B Instruct leads

Qwen2.5 7B Instruct: 36.5 (#208), Wizardlm 70b: 31.4 (#285)

Coding benchmarks
BenchmarkQwen2.5 7B InstructWizardlm 70b
BigCodeBench Instruct37.6%—
LMArena Coding—1081
BigCodeBench Complete46.1%—

Agentic & Tool Use Not comparable

Qwen2.5 7B Instruct: 23.8 (#124), Wizardlm 70b: —

Agentic & Tool Use benchmarks
BenchmarkQwen2.5 7B InstructWizardlm 70b
BALROG7.8%—

Reasoning Wizardlm 70b leads

Qwen2.5 7B Instruct: 14.8 (#322), Wizardlm 70b: 20.7 (#234)

Reasoning benchmarks
BenchmarkQwen2.5 7B InstructWizardlm 70b
Chess Puzzles0%—
LMArena Hard Prompts—1079
DTBench47.7%—
LMCA6.4%—
Epoch Capabilities Index118.51—

Math Wizardlm 70b leads

Qwen2.5 7B Instruct: 12.6 (#306), Wizardlm 70b: 32.2 (#218)

Math benchmarks
BenchmarkQwen2.5 7B InstructWizardlm 70b
OTIS Mock AIME 2024-20252.5%—
Omni-MATH29.4%—
LMArena Math—1116

Knowledge Not comparable

Qwen2.5 7B Instruct: 17.0 (#286), Wizardlm 70b: —

Knowledge benchmarks
BenchmarkQwen2.5 7B InstructWizardlm 70b
GPQA Diamond35.5%—
MMLU-Pro53.9%—
GPQA (HELM)34.1%—
MMLU72.9%—

Multilingual Not comparable

Qwen2.5 7B Instruct: —, Wizardlm 70b: 29.6 (#265)

Multilingual benchmarks
BenchmarkQwen2.5 7B InstructWizardlm 70b
LMArena Non-English—1078
LMArena Chinese—1052
LMArena German—1083
LMArena Russian—1155

Instruction Following Qwen2.5 7B Instruct leads

Qwen2.5 7B Instruct: 63.2 (#231), Wizardlm 70b: 56.3 (#273)

Instruction Following benchmarks
BenchmarkQwen2.5 7B InstructWizardlm 70b
IFEval74.1%—
LMArena Instruction Following—1093

Long Context Not comparable

Qwen2.5 7B Instruct: —, Wizardlm 70b: 33.3 (#263)

Long Context benchmarks
BenchmarkQwen2.5 7B InstructWizardlm 70b
LMArena Longer Query—1097

Writing & Preference Qwen2.5 7B Instruct leads

Qwen2.5 7B Instruct: 48.8 (#195), Wizardlm 70b: 34.8 (#269)

Writing & Preference benchmarks
BenchmarkQwen2.5 7B InstructWizardlm 70b
LMArena Text—1120
LMArena Creative Writing—1149
WildBench73.1%—
LMArena Multi-Turn—1108

Frequently asked questions

Is Qwen2.5 7B Instruct better than Wizardlm 70b?

Wizardlm 70b is the stronger model overall, scoring 33.0 to 29.0 on the Noometry Index.

Is Qwen2.5 7B Instruct or Wizardlm 70b better for coding?

Qwen2.5 7B Instruct scores higher on coding benchmarks: 36.5 versus 31.4 in the Noometry coding category.

How many benchmarks do Qwen2.5 7B Instruct and Wizardlm 70b share?

0 benchmarks have published results for both models. Qwen2.5 7B Instruct has 15 scored results on Noometry and Wizardlm 70b has 12.

Related comparisons

Go deeper