All models › alibaba

qwen3-235b-a22b-instruct-2507

alibaba · Apache 2.0 license · on Arena since 1 Aug 2025

Lab chat Download
Arena score1419#119 of 416 in Chat, paid models included
Size235.1 B22 B active per token (mixture of experts)
4-bit download142 GBweights only, Q4_K_M
Max context256Ktokens, from the model config

Where to use it for free

Arena scores

ArenaScoreRankVotes
Chat1419#119 of 41698K

Rank among all models, paid ones included. Source: Arena leaderboard dataset.

Speed on popular hardware

HardwareGPU memoryFits?Speed
RTX 3060 12 GB12 GBDoes not fit—
RTX 4060 Ti 16 GB16 GBDoes not fit—
RTX 309024 GBDoes not fit—
RTX 409024 GBDoes not fit—
RTX 509032 GBDoes not fit—
RX 7900 XTX24 GBDoes not fit—
2 × RTX 309048 GBDoes not fit—
4 × RTX 309096 GBDoes not fit—
Mac M4 Max 128 GB96 GBDoes not fit—
Ryzen AI Max+ 395 128 GB96 GBDoes not fit—
8 × H100 SXM640 GBFits in GPU99 tok/s

Estimate at 4-bit with 32K context, 64 GB of DDR5 for offload. Speed ≈ memory bandwidth × 70% ÷ data read per token; real numbers vary by about ±30%.

GPU memory needed

Level8K context32K context128K contextQuality vs full
Q3_K_M120 GB124 GB143 GB+4.7% noticeable loss
Q4_K_M145 GB149 GB168 GB+1.2% very small loss
Q5_K_M169 GB174 GB193 GB+0.4% near-lossless
Q6_K195 GB200 GB219 GB+0.2% near-lossless
Q8_0252 GB257 GB276 GB≈ 0% same as full
F16472 GB477 GB496 GB≈ 0% same as full

Weights + context cache (from the model's architecture) + runtime. Quality: increase in perplexity against the full model, from llama.cpp tests, scaled by model size. Simulate your own setup.

Chat score over time

qwen3-235b-a22b-instruct-2507 1419Best paid model

Arena score from 17 Apr 2026 to 15 Oct 2026.

Similar free models in Chat