Model comparison

INTELLECT-1 vs Wizardlm 13b

Wizardlm 13b has enough public results to be ranked (#272); INTELLECT-1 does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Wizardlm 13b Microsoft

30.8

Rank #272 Confirmed

Summary

  • Wizardlm 13b has downloadable open weights; the other is API-only.

Side by side

INTELLECT-1 and Wizardlm 13b specifications
INTELLECT-1Wizardlm 13b
ProviderHugging FaceMicrosoft
Noometry Index—30.8
Released2024-11-29—
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked710

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

INTELLECT-1: —, Wizardlm 13b: 29.6 (#293)

Coding benchmarks
BenchmarkINTELLECT-1Wizardlm 13b
LMArena Coding—1035

Reasoning Not comparable

INTELLECT-1: —, Wizardlm 13b: 18.5 (#265)

Reasoning benchmarks
BenchmarkINTELLECT-1Wizardlm 13b
LMArena Hard Prompts—1018
BIG-Bench Hard34.9%—
Epoch Capabilities Index100.38—
HellaSwag71.4%—
WinoGrande65.8%—

Math Not comparable

INTELLECT-1: —, Wizardlm 13b: 27.8 (#235)

Math benchmarks
BenchmarkINTELLECT-1Wizardlm 13b
LMArena Math—1017
GSM8K38.6%—

Knowledge Not comparable

INTELLECT-1: —, Wizardlm 13b: —

Knowledge benchmarks
BenchmarkINTELLECT-1Wizardlm 13b
ARC (AI2) Challenge54.5%—
MMLU49.9%—

Multilingual Not comparable

INTELLECT-1: —, Wizardlm 13b: 27.3 (#272)

Multilingual benchmarks
BenchmarkINTELLECT-1Wizardlm 13b
LMArena Non-English—1034
LMArena Chinese—1023

Instruction Following Not comparable

INTELLECT-1: —, Wizardlm 13b: 53.7 (#280)

Instruction Following benchmarks
BenchmarkINTELLECT-1Wizardlm 13b
LMArena Instruction Following—1049

Long Context Not comparable

INTELLECT-1: —, Wizardlm 13b: 32.0 (#268)

Long Context benchmarks
BenchmarkINTELLECT-1Wizardlm 13b
LMArena Longer Query—1054

Writing & Preference Not comparable

INTELLECT-1: —, Wizardlm 13b: 30.7 (#282)

Writing & Preference benchmarks
BenchmarkINTELLECT-1Wizardlm 13b
LMArena Text—1077
LMArena Creative Writing—1090
LMArena Multi-Turn—1047

Frequently asked questions

Is INTELLECT-1 better than Wizardlm 13b?

Wizardlm 13b has enough public results to be ranked (#272); INTELLECT-1 does not yet, so treat this comparison as directional.

How many benchmarks do INTELLECT-1 and Wizardlm 13b share?

0 benchmarks have published results for both models. INTELLECT-1 has 7 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper