Qwen2.5-Coder (7B)
Qwen2.5-Coder (7B) is an open-weights language model from Qwen, released September 18, 2024. On the Epoch Capabilities Index it scores 107.7, rank 206 of 256 rated models.
Check it against your own PC →
Can you run Qwen2.5-Coder (7B) locally?
Even with 32 GB of VRAM and 32 GB of RAM it is too large to run at a usable speed on a single consumer GPU. Estimates assume 32 GB of DDR5 RAM, a 16K context and llama.cpp-style GGUF quantization. Enter your exact hardware in the live app.
| GPU memory | Verdict | Best quant | VRAM | RAM | tok/s |
|---|---|---|---|---|---|
| 6 GB VRAM | Size unknown | – | – | – | – |
| 8 GB VRAM | Size unknown | – | – | – | – |
| 12 GB VRAM | Size unknown | – | – | – | – |
| 16 GB VRAM | Size unknown | – | – | – | – |
| 24 GB VRAM | Size unknown | – | – | – | – |
| 32 GB VRAM | Size unknown | – | – | – | – |
Parameter count unknown. The weights may not be on Hugging Face yet.
Benchmark results
| Benchmark (Epoch AI) | Score |
|---|---|
| MMLU | 57.3% |
Links
Models with a similar score
Llama 3.1-8B · phi-3-mini 3.8B · Stable Beluga 2 · Llama 3-8B · Falcon-180B · GPT-3.5 Turbo (Jun 2023) · Llama 2-70B
More from Qwen
Qwen3.8 Omni Flash · Qwen3.8 Max (0902) · Qwen3.8 Flash · Qwen3.8 Flash Next · Qwen 3.8 27B · Qwen3.8-2.4T-A95B · Qwen 3.8 Max · Qwen3.7 Flash