All models › openbmb
MiniCPM-V-4.7-1B
openbmb · on Arena since 6 Oct 2026
Download New · waiting for Arena votes
Arena score—Not voted on Arena yet
Size1.6 Bparameters
4-bit download1.0 GBweights only, Q4_K_M
Max context256Ktokens, from the model config
Where to use it for free
- Download and run it at home: official weights · GGUF files for Ollama and LM Studio
New: waiting for Arena votes
Released on 6 Oct 2026. Arena has not voted on this model yet. As soon as it does, the model moves into the ranking automatically, usually the next night. Until then you can still check its size, memory needs and speed below.
Speed on popular hardware
| Hardware | GPU memory | Fits? | Speed |
|---|---|---|---|
| RTX 3060 12 GB | 12 GB | Fits in GPU | 184 tok/s |
| RTX 4060 Ti 16 GB | 16 GB | Fits in GPU | 147 tok/s |
| RTX 3090 | 24 GB | Fits in GPU | 477 tok/s |
| RTX 4090 | 24 GB | Fits in GPU | 514 tok/s |
| RTX 5090 | 32 GB | Fits in GPU | 914 tok/s |
| RX 7900 XTX | 24 GB | Fits in GPU | 490 tok/s |
| 2 × RTX 3090 | 48 GB | Fits in GPU | 464 tok/s |
| 4 × RTX 3090 | 96 GB | Fits in GPU | 438 tok/s |
| Mac M4 Max 128 GB | 96 GB | Fits in GPU | 279 tok/s |
| Ryzen AI Max+ 395 128 GB | 96 GB | Fits in GPU | 131 tok/s |
| 8 × H100 SXM | 640 GB | Fits in GPU | 1412 tok/s |
Estimate at 4-bit with 32K context, 64 GB of DDR5 for offload. Speed ≈ memory bandwidth × 70% ÷ data read per token; real numbers vary by about ±30%.
GPU memory needed
| Level | 8K context | 32K context | 128K context | Quality vs full |
|---|---|---|---|---|
| Q3_K_M | 1.5 GB | 1.8 GB | 3.0 GB | +10.5% noticeable loss |
| Q4_K_M | 1.7 GB | 2.0 GB | 3.2 GB | +2.8% small loss |
| Q5_K_M | 1.8 GB | 2.1 GB | 3.3 GB | +0.9% very small loss |
| Q6_K | 2.0 GB | 2.3 GB | 3.5 GB | +0.3% near-lossless |
| Q8_0 | 2.4 GB | 2.7 GB | 3.9 GB | ≈ 0% same as full |
| F16 | 3.9 GB | 4.2 GB | 5.4 GB | ≈ 0% same as full |
Weights + context cache (from the model's architecture) + runtime. Quality: increase in perplexity against the full model, from llama.cpp tests, scaled by model size. Simulate your own setup.