Qwen2.5-Coder-32B
Qwen2.5-Coder-32B is an open-weights language model from Qwen, released September 18, 2024. It has 32B parameters (dense). On the Epoch Capabilities Index it scores 118.9, rank 187 of 256 rated models.
Check it against your own PC →
Can you run Qwen2.5-Coder-32B locally?
The smallest common GPU it runs on is 16 GB of VRAM (with 32 GB of RAM): Q3_K_M, split GPU / CPU, roughly 5 tokens per second. Estimates assume 32 GB of DDR5 RAM, a 16K context and llama.cpp-style GGUF quantization. Enter your exact hardware in the live app.
| GPU memory | Verdict | Best quant | VRAM | RAM | tok/s |
|---|---|---|---|---|---|
| 6 GB VRAM | Very slow | IQ3_XXS (noticeable loss) | 5.2 GB | 11.0 GB | ~3 |
| 8 GB VRAM | Very slow | IQ3_XXS (noticeable loss) | 7.2 GB | 9.0 GB | ~3 |
| 12 GB VRAM | Very slow | IQ3_XXS (noticeable loss) | 11.2 GB | 5.0 GB | ~5 |
| 16 GB VRAM | Runs, slowly | Q3_K_M (okay) | 15.2 GB | 4.4 GB | ~5 |
| 24 GB VRAM | Runs on GPU | IQ4_XS (good) | 21.0 GB | – | ~32 |
| 32 GB VRAM | Runs on GPU | Q6_K (≈ lossless) | 30.2 GB | – | ~39 |
Benchmark results
| Benchmark (Epoch AI) | Score |
|---|---|
| MMLU | 72.1% |
Links
Models with a similar score
Llama 3.2 90B · Qwen2-72B · GPT-4 (Mar 2023) · Llama 3-70B · DeepSeek-V2 (MoE-236B, May 2024) · Gemini 1.5 Flash (May 2024) · GPT-4 (Jun 2023) · Mistral Large
More from Qwen
Qwen3.8 Omni Flash · Qwen3.8 Max (0902) · Qwen3.8 Flash · Qwen3.8 Flash Next · Qwen 3.8 27B · Qwen3.8-2.4T-A95B · Qwen 3.8 Max · Qwen3.7 Flash