All models › deepseek

deepseek-v3.1

deepseek · MIT license · on Arena since 27 Aug 2025

Lab chat Download
Arena score1420#116 of 416 in Chat, paid models included
Size684.5 B51.1 B active per token (mixture of experts)
4-bit download415 GBweights only, Q4_K_M
Max context160Ktokens, from the model config

Where to use it for free

Arena scores

ArenaScoreRankVotes
Chat1420#116 of 41615K

Rank among all models, paid ones included. Source: Arena leaderboard dataset.

Speed on popular hardware

HardwareGPU memoryFits?Speed
RTX 3060 12 GB12 GBDoes not fit—
RTX 4060 Ti 16 GB16 GBDoes not fit—
RTX 309024 GBDoes not fit—
RTX 409024 GBDoes not fit—
RTX 509032 GBDoes not fit—
RX 7900 XTX24 GBDoes not fit—
2 × RTX 309048 GBDoes not fit—
4 × RTX 309096 GBDoes not fit—
Mac M4 Max 128 GB96 GBDoes not fit—
Ryzen AI Max+ 395 128 GB96 GBDoes not fit—
8 × H100 SXM640 GBFits in GPU58 tok/s

Estimate at 4-bit with 32K context, 64 GB of DDR5 for offload. Speed ≈ memory bandwidth × 70% ÷ data read per token; real numbers vary by about ±30%.

GPU memory needed

Level8K context32K context128K contextQuality vs full
Q3_K_M343 GB345 GB352 GB+4.7% noticeable loss
Q4_K_M416 GB418 GB425 GB+1.2% very small loss
Q5_K_M488 GB490 GB496 GB+0.4% near-lossless
Q6_K562 GB564 GB571 GB+0.2% near-lossless
Q8_0728 GB730 GB737 GB≈ 0% same as full
F161370 GB1372 GB1379 GB≈ 0% same as full

Weights + context cache (from the model's architecture) + runtime. Quality: increase in perplexity against the full model, from llama.cpp tests, scaled by model size. Simulate your own setup.

Chat score over time

deepseek-v3.1 1420Best paid model

Arena score from 17 Apr 2026 to 15 Oct 2026.

Similar free models in Chat