granite switch 4.1 30b
granite switch 4.1 30b is an open-weights language model from IBM, released October 14, 2026. It has 30B parameters (dense). The context window is 128K tokens.
Check it against your own PC →
Can you run granite switch 4.1 30b locally?
The smallest common GPU it runs on is 16 GB of VRAM (with 32 GB of RAM): Q3_K_M, split GPU / CPU, roughly 5 tokens per second. Estimates assume 32 GB of DDR5 RAM, a 16K context and llama.cpp-style GGUF quantization. Enter your exact hardware in the live app.
| GPU memory | Verdict | Best quant | VRAM | RAM | tok/s |
|---|---|---|---|---|---|
| 6 GB VRAM | Very slow | IQ3_XXS (noticeable loss) | 5.2 GB | 11.3 GB | ~3 |
| 8 GB VRAM | Very slow | IQ3_XXS (noticeable loss) | 7.2 GB | 9.3 GB | ~3 |
| 12 GB VRAM | Very slow | IQ3_XXS (noticeable loss) | 11.2 GB | 5.3 GB | ~5 |
| 16 GB VRAM | Runs, slowly | Q3_K_M (okay) | 15.2 GB | 4.5 GB | ~5 |
| 24 GB VRAM | Runs on GPU | IQ4_XS (good) | 21.0 GB | – | ~34 |
| 32 GB VRAM | Runs on GPU | Q6_K (≈ lossless) | 29.6 GB | – | ~42 |
Ready-made quantizations on Hugging Face: ibm-granite/granite-switch-4.1-30b-GGUF · netprojects/granite-switch-4.1-30b-mlx-4bit · netprojects/granite-switch-4.1-30b-mlx-8bit
Benchmark results
Epoch AI has not published results for granite switch 4.1 30b yet. New models are usually evaluated within days to weeks.
Links
Hugging Face: ibm-granite/granite-switch-4.1-30b
More from IBM
granite switch 4.1 8b · Granite 4.1 30B · Granite 4.1 8B · Granite-4.0-H-Tiny · Granite-4.0-H-Micro · Granite-4.0-H-Small · Granite-Docling