Jamba Large
Jamba Large is an open-weights language model from AI21, released July 3, 2025. The context window is 250K tokens. API price: $2 input / $8 output per million tokens.
Check it against your own PC →
Lab
AI21
Released
July 3, 2025
Weights
Open
Parameters
–
Context
250K
Price / M tokens
$2 / $8 in / out
Epoch ECI
not yet rated
Can you run Jamba Large locally?
Even with 32 GB of VRAM and 32 GB of RAM it is too large to run at a usable speed on a single consumer GPU. Estimates assume 32 GB of DDR5 RAM, a 16K context and llama.cpp-style GGUF quantization. Enter your exact hardware in the live app.
| GPU memory | Verdict | Best quant | VRAM | RAM | tok/s |
|---|---|---|---|---|---|
| 6 GB VRAM | Size unknown | – | – | – | – |
| 8 GB VRAM | Size unknown | – | – | – | – |
| 12 GB VRAM | Size unknown | – | – | – | – |
| 16 GB VRAM | Size unknown | – | – | – | – |
| 24 GB VRAM | Size unknown | – | – | – | – |
| 32 GB VRAM | Size unknown | – | – | – | – |
Parameter count unknown. The weights may not be on Hugging Face yet.
Benchmark results
Epoch AI has not published results for Jamba Large yet. New models are usually evaluated within days to weeks.