All models › zai

GLM-4.6

zai · MIT license · on Arena since 3 Oct 2025

Lab chat Download
Arena score1440#76 of 416 in Chat, paid models included
Size356.8 B37.6 B active per token (mixture of experts)
4-bit download216 GBweights only, Q4_K_M
Max context198Ktokens, from the model config

Where to use it for free

Arena scores

ArenaScoreRankVotes
Chat1440#76 of 41636K
Coding1341#116 of 1447K

Rank among all models, paid ones included. Source: Arena leaderboard dataset.

Speed on popular hardware

HardwareGPU memoryFits?Speed
RTX 3060 12 GB12 GBDoes not fit—
RTX 4060 Ti 16 GB16 GBDoes not fit—
RTX 309024 GBDoes not fit—
RTX 409024 GBDoes not fit—
RTX 509032 GBDoes not fit—
RX 7900 XTX24 GBDoes not fit—
2 × RTX 309048 GBDoes not fit—
4 × RTX 309096 GBDoes not fit—
Mac M4 Max 128 GB96 GBDoes not fit—
Ryzen AI Max+ 395 128 GB96 GBDoes not fit—
8 × H100 SXM640 GBFits in GPU55 tok/s

Estimate at 4-bit with 32K context, 64 GB of DDR5 for offload. Speed ≈ memory bandwidth × 70% ÷ data read per token; real numbers vary by about ±30%.

GPU memory needed

Level8K context32K context128K contextQuality vs full
Q3_K_M182 GB191 GB228 GB+4.7% noticeable loss
Q4_K_M220 GB229 GB266 GB+1.2% very small loss
Q5_K_M257 GB267 GB304 GB+0.4% near-lossless
Q6_K296 GB306 GB343 GB+0.2% near-lossless
Q8_0383 GB392 GB429 GB≈ 0% same as full
F16717 GB727 GB764 GB≈ 0% same as full

Weights + context cache (from the model's architecture) + runtime. Quality: increase in perplexity against the full model, from llama.cpp tests, scaled by model size. Simulate your own setup.

Chat score over time

GLM-4.6 1440Best paid model

Arena score from 17 Apr 2026 to 15 Oct 2026.

Similar free models in Chat