nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-FP8 · Hugging Face
NVIDIA published benchmark or leaderboard evidence for Nemotron 3 Super, NVIDIA-Nemotron-3-Super-120B-A12B-FP8, NVIDIA Nemotron 3 Super 120B A12B FP8.
View sourceNVIDIA
NVIDIA Nemotron 3 Super is a 120B-parameter open hybrid MoE model, activating just 12B parameters for maximum compute efficiency and accuracy in complex multi-agent applications. Built on a hybrid Mamba-Transformer...
Running this yourself: likely needs a high-memory cloud gpu.
OpenRouter
Price record: 2026-11-17. Source: openrouter.
No current subscription pricing is tracked for this model.
Confirm this specific model, usage limits, and billing terms with the provider. A subscription does not automatically include API credits.
No login needed to compare. Prices are in USD; provider charges are separate from AI Market Cap plans. Context length, caching, tools, taxes, and regional terms can change the final cost. Open weights do not mean free hosting.
43.1
Quality Score
---
Arena ELO
120B
Parameters
262K
Context
This measures the amount of verifiable public evidence we have, not how capable the model is. A missing field means it has not been verified yet, not that its value is zero.
17 of 22 public signals
Sign in to join the discussion
0
Downloads
0
Likes
Mar 2026
Released
4/5 signals
3/4 signals
5/5 signals
1/4 signals
4/4 signals
Parameters
120B
Training compute
Not reported
Dataset scale
Not reported
Base model
Not reported
Source-reported access: Open weights (unrestricted) · Likely confidence
Gaps we are still tracking
Benchmarks
2
Open Source
1
Research
2
Recent launch, pricing, benchmark, and API signals linked to this model or its provider.
NVIDIA published benchmark or leaderboard evidence for Nemotron 3 Super, NVIDIA-Nemotron-3-Super-120B-A12B-FP8, NVIDIA Nemotron 3 Super 120B A12B FP8.
View sourceModels | Try NVIDIA NIM APIs Skip to main content Search ⌘K Ctrl+K Login Models Deploy and scale models on your GPU infrastructure of choice with NVIDIA NIM inference microservices Optimized by NVIDIA Launch from Hugging Face Beta Filters Free Endpoint 43 Partner Endpoint 25 Download Available 80 Use Case Drug Discovery 13 Image Generation 9 Speech-to-Text 9 Text-to-Image 8 Retrieval Augmented Generation 6 Show more Inference Providers Deepinfra 19 OpenRouter 15 Together AI 1
Nemotron 3 Super is now available through local Ollama runtime. 128K context window listed. NVIDIA Nemotron 3 Nano Omni is a multimodal large language model that unifies video, audio, image, and text understanding to support enterprise-grade Q&A, summarization, transcription, and document intelligence workflows.
View sourceWe describe the pre-training, post-training, and quantization of Nemotron 3 Super, a 120 billion (active 12 billion) parameter hybrid Mamba-Attention Mixture-of-Experts model. Nemotron 3 Super is the first model in the Nemotron 3 family to 1) be pre-trained in NVFP4, 2) leverage LatentMoE, a new Mixture-of-Experts architecture that optimizes for both accuracy per FLOP and accuracy per parameter, and 3) include MTP layers for inference acceleration through native speculative decoding. We pre-trained Nemotron 3 Super on 25 trillion tokens followed by post-training using supervised fine tuning (SFT) and reinforcement learning (RL). The final model supports up to 1M context length and achieves comparable accuracy on common benchmarks, while also achieving up to 2.2x and 7.5x higher inference throughput compared to GPT-OSS-120B and Qwen3.5-122B, respectively. Nemotron 3 Super datasets, along with the base, post-trained, and quantized checkpoints, are open-sourced on HuggingFace.
View sourcePost-training for long-horizon agentic tasks has a tension between compute efficiency and generalization. While supervised fine-tuning (SFT) is compute efficient, it often suffers from out-of-domain (OOD) degradation. Conversely, end-to-end reinforcement learning (E2E RL) preserves OOD capabilities, but incurs high compute costs due to many turns of on-policy rollout. We introduce PivotRL, a novel framework that operates on existing SFT trajectories to combine the compute efficiency of SFT with the OOD accuracy of E2E RL. PivotRL relies on two key mechanisms: first, it executes local, on-policy rollouts and filters for pivots: informative intermediate turns where sampled actions exhibit high variance in outcomes; second, it utilizes rewards for functional-equivalent actions rather than demanding strict string matching with the SFT data demonstration. We theoretically show that these mechanisms incentivize strong learning signals with high natural gradient norm, while maximally preserving policy probability ordering on actions unrelated to training tasks. In comparison to standard SFT on identical data, we demonstrate that PivotRL achieves +4.17% higher in-domain accuracy on average across four agentic domains, and +10.04% higher OOD accuracy in non-agentic tasks. Notably, on agentic coding tasks, PivotRL achieves competitive accuracy with E2E RL with 4x fewer rollout turns. PivotRL is adopted by NVIDIA's Nemotron-3-Super-120B-A12B, acting as the workhorse in production-scale agentic post-training.
View sourceWe describe the pre-training, post-training, and quantization of Nemotron 3 Super, a 120 billion (active 12 billion) parameter hybrid Mamba-Attention Mixture-of-Experts model. Nemotron 3 Super is the first model in the Nemotron 3 family to 1) be pre-trained in NVFP4, 2) leverage LatentMoE, a new Mixture-of-Experts architecture that optimizes for both accuracy per FLOP and accuracy per parameter, and 3) include MTP layers for inference acceleration through native speculative decoding. We pre-trained Nemotron 3 Super on 25 trillion tokens followed by post-training using supervised fine tuning (SFT) and reinforcement learning (RL). The final model supports up to 1M context length and achieves comparable accuracy on common benchmarks, while also achieving up to 2.2x and 7.5x higher inference throughput compared to GPT-OSS-120B and Qwen3.5-122B, respectively. Nemotron 3 Super datasets, along with the base, post-trained, and quantized checkpoints, are open-sourced on HuggingFace.
Post-training for long-horizon agentic tasks has a tension between compute efficiency and generalization. While supervised fine-tuning (SFT) is compute efficient, it often suffers from out-of-domain (OOD) degradation. Conversely, end-to-end reinforcement learning (E2E RL) preserves OOD capabilities, but incurs high compute costs due to many turns of on-policy rollout. We introduce PivotRL, a novel framework that operates on existing SFT trajectories to combine the compute efficiency of SFT with the OOD accuracy of E2E RL. PivotRL relies on two key mechanisms: first, it executes local, on-policy rollouts and filters for pivots: informative intermediate turns where sampled actions exhibit high variance in outcomes; second, it utilizes rewards for functional-equivalent actions rather than demanding strict string matching with the SFT data demonstration. We theoretically show that these mechanisms incentivize strong learning signals with high natural gradient norm, while maximally preserving policy probability ordering on actions unrelated to training tasks. In comparison to standard SFT on identical data, we demonstrate that PivotRL achieves +4.17% higher in-domain accuracy on average across four agentic domains, and +10.04% higher OOD accuracy in non-agentic tasks. Notably, on agentic coding tasks, PivotRL achieves competitive accuracy with E2E RL with 4x fewer rollout turns. PivotRL is adopted by NVIDIA's Nemotron-3-Super-120B-A12B, acting as the workhorse in production-scale agentic post-training.
Nemotron 3 Super is now available through local Ollama runtime. 128K context window listed. NVIDIA Nemotron 3 Nano Omni is a multimodal large language model that unifies video, audio, image, and text understanding to support enterprise-grade Q&A, summarization, transcription, and document intelligence workflows.
NVIDIA published benchmark or leaderboard evidence for Nemotron 3 Super, NVIDIA-Nemotron-3-Super-120B-A12B-FP8, NVIDIA Nemotron 3 Super 120B A12B FP8.
Models | Try NVIDIA NIM APIs Skip to main content Search ⌘K Ctrl+K Login Models Deploy and scale models on your GPU infrastructure of choice with NVIDIA NIM inference microservices Optimized by NVIDIA Launch from Hugging Face Beta Filters Free Endpoint 43 Partner Endpoint 25 Download Available 80 Use Case Drug Discovery 13 Image Generation 9 Speech-to-Text 9 Text-to-Image 8 Retrieval Augmented Generation 6 Show more Inference Providers Deepinfra 19 OpenRouter 15 Together AI 1