Nemotron 3 Ultra
Nemotron 3 Ultra is an open-weights language model from NVIDIA, released June 4, 2026. Its makers disclosed about 550B parameters. On the Epoch Capabilities Index it scores 146.9, rank 84 of 256 rated models.
We introduce Nemotron 3 Ultra, a 550 billion total and 55 billion active parameter Mixture-of-Experts Hybrid Mamba-Attention language model. We pre-trained Nemotron 3 Ultra on 20 trillion text tokens, then extended the context length to 1M tokens, and post-trained using Supervised Fine Tuning (SFT), Reinforcement …
Check it against your own PC →
Can you run Nemotron 3 Ultra locally?
Even with 32 GB of VRAM and 32 GB of RAM it is too large to run at a usable speed on a single consumer GPU. Estimates assume 32 GB of DDR5 RAM, a 16K context and llama.cpp-style GGUF quantization. Enter your exact hardware in the live app.
| GPU memory | Verdict | Best quant | VRAM | RAM | tok/s |
|---|---|---|---|---|---|
| 6 GB VRAM | Size unknown | – | – | – | – |
| 8 GB VRAM | Size unknown | – | – | – | – |
| 12 GB VRAM | Size unknown | – | – | – | – |
| 16 GB VRAM | Size unknown | – | – | – | – |
| 24 GB VRAM | Size unknown | – | – | – | – |
| 32 GB VRAM | Size unknown | – | – | – | – |
Parameter count unknown. The weights may not be on Hugging Face yet.
Strengths by category
ModelTape's 0–100 fit on Epoch AI benchmark results.
| Category | Score | Based on |
|---|---|---|
| Reasoning | 11.6 | SimpleBench, Mystery Game Puzzles |
| Math | 35.2 | ProofBench, OTIS Mock AIME 2024-2025 |
Benchmark results
| Benchmark (Epoch AI) | Score |
|---|---|
| OTIS Mock AIME | 86.7% |
| GPQA Diamond | 83.8% |
| SimpleBench | 30.0% |
| Mystery Game Puzzles | 11.9% |
| ProofBench | 2.0% |
Links
Announcement · Epoch AI benchmarks
Models with a similar score
GPT-5.1 · Beam 1.0 · Inkling-Small · GLM-5.1 · DeepSeek-V4-Pro · GPT-5 · Grok 4.3 Beta · Qwen 3.6 Max (Preview)
More from NVIDIA
NVIDIA Nemotron Labs Dory1.0 4B BF16 · NVIDIA Nemotron Labs Dory1.0 4B MXFP8 · Nemotron 3.5 Lightning · Nemotron 3 Super · Nemotron 3-Nano-30B-A3B · Nemotron-Cascade 14B · NVIDIA Isaac GR00T N1.6 · NVIDIA-Nemotron-Nano-9B-v2