Noometry

Model comparison

Grok 4.3 vs Qwen3.5 397B-A17B

Qwen3.5 397B-A17B is the stronger model overall, scoring 46.0 to 43.8 on the Noometry Index.

Last verified . 27 shared benchmarks.

Grok 4.3 xAI

43.8

Rank #86 Confirmed

Qwen3.5 397B-A17B Alibaba (Qwen)

46.0

Rank #67 Confirmed

Summary

  • They share 27 benchmarks with published results for both. Grok 4.3 scores higher in 1 category and Qwen3.5 397B-A17B in 9 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in multimodal, where Qwen3.5 397B-A17B leads 40.7 to 31.6.
  • The biggest single-benchmark swing is Chess Puzzles: 25% for Grok 4.3 and 13% for Qwen3.5 397B-A17B.
  • Qwen3.5 397B-A17B is cheaper at $0.60 / $3.60 per million input/output tokens, against $1.25 / $2.50 for Grok 4.3.
  • Grok 4.3 accepts more context: 1M tokens versus 262K.
  • Qwen3.5 397B-A17B has downloadable open weights; the other is API-only.

Side by side

Grok 4.3Qwen3.5 397B-A17B
ProviderxAIAlibaba (Qwen)
Noometry Index43.846.0
Released2026-04-172026-02-01
WeightsProprietaryOpen
Context window1M262K
Max output30K66K
Input $ / M tokens$1.25$0.60
Output $ / M tokens$2.50$3.60
Results tracked4036

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Grok 4.3: 41.6 (#121), Qwen3.5 397B-A17B: 42.0 (#114)

BenchmarkGrok 4.3Qwen3.5 397B-A17B
LMArena WebDev13571400
LMArena Coding14151465
SciCode47.3%—
WeirdML49.9%—
ALE-Bench944.17—

Agentic & Tool Use Qwen3.5 397B-A17B leads

Grok 4.3: 27.7 (#99), Qwen3.5 397B-A17B: 33.3 (#53)

BenchmarkGrok 4.3Qwen3.5 397B-A17B
APEX-Agents—24.9%
τ²-bench Airline—81.5%
τ²-bench Banking—9.8%
τ²-bench Retail—84.4%
τ²-bench Telecom—97.8%
GDP.pdf8%—
LMArena Search1165—
Vending-Bench 235.26—

Reasoning Grok 4.3 leads

Grok 4.3: 35.9 (#68), Qwen3.5 397B-A17B: 34.5 (#70)

BenchmarkGrok 4.3Qwen3.5 397B-A17B
NYT Connections (extended)55.2%58.9%
Chess Puzzles25%13%
LMArena Hard Prompts13961448
DTBench90.7%87.5%
LMCA38.3%37.9%
Epoch Capabilities Index149.16146.65
Kagi LLM Benchmark—73.7%
CritPt8%—
Thematic Generalization—65.1%
Mystery Game Puzzles—18%
ForecastBench60.3—

Math Too close to call

Grok 4.3: 46.0 (#74), Qwen3.5 397B-A17B: 46.1 (#73)

BenchmarkGrok 4.3Qwen3.5 397B-A17B
FrontierMath (Tiers 1-3)42.8%31.2%
OTIS Mock AIME 2024-202593.3%88.9%
LMArena Math13881454
FrontierMath Tier 414.6%—
ProofBench11%—

Knowledge Too close to call

Grok 4.3: 52.5 (#62), Qwen3.5 397B-A17B: 53.3 (#58)

BenchmarkGrok 4.3Qwen3.5 397B-A17B
GPQA Diamond88.8%86.4%
LMArena Expert13851462
SimpleQA Verified33.2%—

Multimodal Qwen3.5 397B-A17B leads

Grok 4.3: 31.6 (#104), Qwen3.5 397B-A17B: 40.7 (#44)

BenchmarkGrok 4.3Qwen3.5 397B-A17B
LMArena Vision12291263
Blueprint-Bench 20%—

Multilingual Qwen3.5 397B-A17B leads

Grok 4.3: 50.5 (#120), Qwen3.5 397B-A17B: 53.7 (#59)

BenchmarkGrok 4.3Qwen3.5 397B-A17B
LMArena Non-English13851430
LMArena Chinese14221500
LMArena French14121461
LMArena German13951447
LMArena Japanese13791426
LMArena Korean13561384
LMArena Russian13991429
LMArena Spanish13981441

Instruction Following Qwen3.5 397B-A17B leads

Grok 4.3: 72.1 (#140), Qwen3.5 397B-A17B: 75.0 (#77)

BenchmarkGrok 4.3Qwen3.5 397B-A17B
LMArena Instruction Following13661424

Long Context Qwen3.5 397B-A17B leads

Grok 4.3: 42.5 (#123), Qwen3.5 397B-A17B: 44.1 (#74)

BenchmarkGrok 4.3Qwen3.5 397B-A17B
LMArena Longer Query13931442

Writing & Preference Qwen3.5 397B-A17B leads

Grok 4.3: 58.5 (#118), Qwen3.5 397B-A17B: 62.3 (#79)

BenchmarkGrok 4.3Qwen3.5 397B-A17B
LMArena Text13971438
LMArena Creative Writing13801401
LMArena Multi-Turn14061446
EQ-Bench Creative Writing—1478
EQ-Bench 41075—

Frequently asked questions

Is Grok 4.3 better than Qwen3.5 397B-A17B?

Qwen3.5 397B-A17B is the stronger model overall, scoring 46.0 to 43.8 on the Noometry Index.

Which is cheaper, Grok 4.3 or Qwen3.5 397B-A17B?

Qwen3.5 397B-A17B is cheaper. It lists at $0.60 per million input tokens and $3.60 per million output tokens; Grok 4.3 lists at $1.25 and $2.50.

Is Grok 4.3 or Qwen3.5 397B-A17B better for coding?

They score almost the same on coding (41.6 vs 42.0); test both on your own repository before choosing.

Which has the bigger context window?

Grok 4.3 does, with 1M tokens against 262K.

How many benchmarks do Grok 4.3 and Qwen3.5 397B-A17B share?

27 benchmarks have published results for both models. Grok 4.3 has 40 scored results on Noometry and Qwen3.5 397B-A17B has 36.

Related comparisons

Go deeper