Voxtral Small
Voxtral Small is an open-weights language model from Mistral, released July 15, 2025. The context window is 32K tokens. API price: $0.1 input / $0.4 output per million tokens.
Check it against your own PC →
Can you run Voxtral Small locally?
Even with 32 GB of VRAM and 32 GB of RAM it is too large to run at a usable speed on a single consumer GPU. Estimates assume 32 GB of DDR5 RAM, a 16K context and llama.cpp-style GGUF quantization. Enter your exact hardware in the live app.
| GPU memory | Verdict | Best quant | VRAM | RAM | tok/s |
|---|---|---|---|---|---|
| 6 GB VRAM | Size unknown | – | – | – | – |
| 8 GB VRAM | Size unknown | – | – | – | – |
| 12 GB VRAM | Size unknown | – | – | – | – |
| 16 GB VRAM | Size unknown | – | – | – | – |
| 24 GB VRAM | Size unknown | – | – | – | – |
| 32 GB VRAM | Size unknown | – | – | – | – |
Parameter count unknown. The weights may not be on Hugging Face yet.
Benchmark results
Epoch AI has not published results for Voxtral Small yet. New models are usually evaluated within days to weeks.
More from Mistral
Mistral Large 4 · Mistral Large 4 Preview · Mistral Large 4 1T A52B · Leanstral 1.5 · Mistral Medium 3.5 · Mistral Small 4 · Devstral Small 2 · Devstral 2