Phi-2
Phi-2 is an open-weights language model from Microsoft, released December 12, 2023. On the Epoch Capabilities Index it scores 96.4, rank 223 of 256 rated models.
Check it against your own PC →
Can you run Phi-2 locally?
Even with 32 GB of VRAM and 32 GB of RAM it is too large to run at a usable speed on a single consumer GPU. Estimates assume 32 GB of DDR5 RAM, a 16K context and llama.cpp-style GGUF quantization. Enter your exact hardware in the live app.
| GPU memory | Verdict | Best quant | VRAM | RAM | tok/s |
|---|---|---|---|---|---|
| 6 GB VRAM | Size unknown | – | – | – | – |
| 8 GB VRAM | Size unknown | – | – | – | – |
| 12 GB VRAM | Size unknown | – | – | – | – |
| 16 GB VRAM | Size unknown | – | – | – | – |
| 24 GB VRAM | Size unknown | – | – | – | – |
| 32 GB VRAM | Size unknown | – | – | – | – |
Parameter count unknown. The weights may not be on Hugging Face yet.
Benchmark results
| Benchmark (Epoch AI) | Score |
|---|---|
| MMLU | 44.5% |
Links
Models with a similar score
DeepSeek-Coder-V2-Lite-Base · Falcon 2 11B · Nemotron-4 15B · internlm-20b · PaLM 2-M · Qwen2.5-Coder-3B · Llama 2-13B · LLaMA-33B
More from Microsoft
MAI-Cyber-1.1-Flash · MAI-Base-2 · MAI-Cyber-1-Flash · MAI-Code-1.1-Flash · Mage VL · MAI-Thinking-1 · MAI-Code-1-Flash · Phi-4