All models › alibaba

Qwen3.5-397B-A17B

alibaba · Apache 2.0 license · on Arena since 19 Feb 2026

Lab chat Download
Arena score1438#81 of 416 in Chat, paid models included
Size403.4 B17 B active per token (mixture of experts)
4-bit download244 GBweights only, Q4_K_M
Max context256Ktokens, from the model config

Where to use it for free

Arena scores

ArenaScoreRankVotes
Chat1438#81 of 41694K
Coding1400#93 of 14421K
Vision1263#54 of 16532K

Rank among all models, paid ones included. Source: Arena leaderboard dataset.

Speed on popular hardware

HardwareGPU memoryFits?Speed
RTX 3060 12 GB12 GBDoes not fit—
RTX 4060 Ti 16 GB16 GBDoes not fit—
RTX 309024 GBDoes not fit—
RTX 409024 GBDoes not fit—
RTX 509032 GBDoes not fit—
RX 7900 XTX24 GBDoes not fit—
2 × RTX 309048 GBDoes not fit—
4 × RTX 309096 GBDoes not fit—
Mac M4 Max 128 GB96 GBDoes not fit—
Ryzen AI Max+ 395 128 GB96 GBDoes not fit—
8 × H100 SXM640 GBFits in GPU171 tok/s

Estimate at 4-bit with 32K context, 64 GB of DDR5 for offload. Speed ≈ memory bandwidth × 70% ÷ data read per token; real numbers vary by about ±30%.

GPU memory needed

Level8K context32K context128K contextQuality vs full
Q3_K_M203 GB203 GB206 GB+4.7% noticeable loss
Q4_K_M245 GB246 GB249 GB+1.2% very small loss
Q5_K_M288 GB288 GB291 GB+0.4% near-lossless
Q6_K332 GB332 GB335 GB+0.2% near-lossless
Q8_0429 GB430 GB433 GB≈ 0% same as full
F16808 GB808 GB811 GB≈ 0% same as full

Weights + context cache (from the model's architecture) + runtime. Quality: increase in perplexity against the full model, from llama.cpp tests, scaled by model size. Simulate your own setup.

Chat score over time

Qwen3.5-397B-A17B 1438Best paid model

Arena score from 17 Apr 2026 to 15 Oct 2026.

Vision score over time

Qwen3.5-397B-A17B 1263Best paid model

Arena score from 10 Apr 2026 to 9 Oct 2026.

Similar free models in Chat