All models › alibaba

qwen2.5-vl-32b-instruct

alibaba · Apache 2.0 license · on Arena since 8 Apr 2025

Lab chat Download
Arena score1152#117 of 165 in Vision, paid models included
Size33.5 Bparameters
4-bit download20 GBweights only, Q4_K_M
Max context125Ktokens, from the model config

Where to use it for free

Arena scores

ArenaScoreRankVotes
Vision1152#117 of 1651K

Rank among all models, paid ones included. Source: Arena leaderboard dataset.

Speed on popular hardware

HardwareGPU memoryFits?Speed
RTX 3060 12 GB12 GBGPU + 64 GB RAM3.7 tok/s
RTX 4060 Ti 16 GB16 GBGPU + 64 GB RAM4.0 tok/s
RTX 309024 GBGPU + 64 GB RAM9.3 tok/s
RTX 409024 GBGPU + 64 GB RAM9.6 tok/s
RTX 509032 GBFits in GPU43 tok/s
RX 7900 XTX24 GBGPU + 64 GB RAM9.4 tok/s
2 × RTX 309048 GBFits in GPU22 tok/s
4 × RTX 309096 GBFits in GPU21 tok/s
Mac M4 Max 128 GB96 GBFits in GPU13 tok/s
Ryzen AI Max+ 395 128 GB96 GBFits in GPU6.2 tok/s
8 × H100 SXM640 GBFits in GPU67 tok/s

Estimate at 4-bit with 32K context, 64 GB of DDR5 for offload. Speed ≈ memory bandwidth × 70% ÷ data read per token; real numbers vary by about ±30%.

GPU memory needed

Level8K context32K contextQuality vs full
Q3_K_M19 GB26 GB+6.7% noticeable loss
Q4_K_M23 GB29 GB+1.8% small loss
Q5_K_M27 GB33 GB+0.6% near-lossless
Q6_K30 GB37 GB+0.2% near-lossless
Q8_038 GB45 GB≈ 0% same as full
F1670 GB76 GB≈ 0% same as full

Weights + context cache (from the model's architecture) + runtime. Quality: increase in perplexity against the full model, from llama.cpp tests, scaled by model size. Simulate your own setup.

Vision score over time

qwen2.5-vl-32b-instruct 1152Best paid model

Arena score from 10 Apr 2026 to 9 Oct 2026.

Similar free models in Vision