Qwen-14B
Qwen-14B is an open-weights language model from Qwen, released September 24, 2023. It has 14B parameters (dense). On the Epoch Capabilities Index it scores 101.9, rank 213 of 256 rated models.
Check it against your own PC →
Lab
Qwen
Released
September 24, 2023
Weights
Open restricted use
Parameters
14B dense
Context
–
Price / M tokens
–
Epoch ECI
101.9 #213
Can you run Qwen-14B locally?
The smallest common GPU it runs on is 6 GB of VRAM (with 32 GB of RAM): Q3_K_M, split GPU / CPU, roughly 6 tokens per second. Estimates assume 32 GB of DDR5 RAM, a 16K context and llama.cpp-style GGUF quantization. Enter your exact hardware in the live app.
| GPU memory | Verdict | Best quant | VRAM | RAM | tok/s |
|---|---|---|---|---|---|
| 6 GB VRAM | Runs, slowly | Q3_K_M (okay) | 5.2 GB | 4.8 GB | ~6 |
| 8 GB VRAM | Runs, slowly | Q4_K_M (very good) | 7.2 GB | 4.5 GB | ~6 |
| 12 GB VRAM | Runs on GPU | IQ4_XS (good) | 10.6 GB | – | ~28 |
| 16 GB VRAM | Runs on GPU | Q6_K (≈ lossless) | 14.7 GB | – | ~25 |
| 24 GB VRAM | Runs on GPU | Q6_K (≈ lossless) | 14.7 GB | – | ~47 |
| 32 GB VRAM | Runs on GPU | Q6_K (≈ lossless) | 14.7 GB | – | ~86 |
Benchmark results
| Benchmark (Epoch AI) | Score |
|---|---|
| MMLU | 55.1% |
Links
Models with a similar score
Llama 2-70B · Gemma 7B · Mistral 7B v0.1 · Yi-9B · LLaMA-65B · DeepSeek-Coder-V2-Lite-Base · Falcon 2 11B · Nemotron-4 15B
More from Qwen
Qwen3.8 Omni Flash · Qwen3.8 Max (0902) · Qwen3.8 Flash · Qwen3.8 Flash Next · Qwen 3.8 27B · Qwen3.8-2.4T-A95B · Qwen 3.8 Max · Qwen3.7 Flash