Qwen3-VL-8B
Qwen3-VL-8B is an open-weights language model from Qwen, released October 15, 2025. It has 8.8B parameters (dense). The context window is 256K tokens.
We introduce Qwen3-VL, the most capable vision-language model in the Qwen series to date, achieving superior performance across a broad range of multimodal benchmarks. It natively supports interleaved contexts of up to 256K tokens, seamlessly integrating text, images, and video.
Check it against your own PC →
Can you run Qwen3-VL-8B locally?
The smallest common GPU it runs on is 6 GB of VRAM (with 32 GB of RAM): Q6_K, split GPU / CPU, roughly 5 tokens per second. Estimates assume 32 GB of DDR5 RAM, a 16K context and llama.cpp-style GGUF quantization. Enter your exact hardware in the live app.
| GPU memory | Verdict | Best quant | VRAM | RAM | tok/s |
|---|---|---|---|---|---|
| 6 GB VRAM | Runs, slowly | Q6_K (≈ lossless) | 5.2 GB | 5.0 GB | ~5 |
| 8 GB VRAM | Runs, slowly | Q6_K (≈ lossless) | 7.2 GB | 3.0 GB | ~8 |
| 12 GB VRAM | Runs on GPU | Q6_K (≈ lossless) | 10.2 GB | – | ~29 |
| 16 GB VRAM | Runs on GPU | Q6_K (≈ lossless) | 10.2 GB | – | ~40 |
| 24 GB VRAM | Runs on GPU | Q6_K (≈ lossless) | 10.2 GB | – | ~72 |
| 32 GB VRAM | Runs on GPU | Q6_K (≈ lossless) | 10.2 GB | – | ~130 |
Ready-made quantizations on Hugging Face: Qwen/Qwen3-VL-8B-Instruct-GGUF · unsloth/Qwen3-VL-8B-Instruct-GGUF · lmstudio-community/Qwen3-VL-8B-Instruct-GGUF · bartowski/Qwen_Qwen3-VL-8B-Instruct-GGUF · darrellbest/Qwen-Image-2.1-Text-Encoder-GGUF · cyankiwi/Qwen3-VL-8B-Instruct-AWQ-4bit
Benchmark results
Epoch AI has not published results for Qwen3-VL-8B yet. New models are usually evaluated within days to weeks.
Links
Announcement · Hugging Face: Qwen/Qwen3-VL-8B-Instruct
More from Qwen
Qwen3.8 Omni Flash · Qwen3.8 Max (0902) · Qwen3.8 Flash · Qwen3.8 Flash Next · Qwen 3.8 27B · Qwen3.8-2.4T-A95B · Qwen 3.8 Max · Qwen3.7 Flash