Nemotron 3 Super: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
We describe the pre-training, post-training, and quantization of Nemotron 3 Super, a 120 billion (active 12 billion) parameter hybrid Mamba-Attention Mixture-of-Experts model. Nemotron 3 Super is the first model in the Nemotron 3 family to 1) be pre-trained in NVFP4, 2) leverage LatentMoE, a new Mixture-of-Experts architecture that optimizes for both accuracy per FLOP and accuracy per parameter, and 3) include MTP layers for inference acceleration through native speculative decoding. We pre-trained Nemotron 3 Super on 25 trillion tokens followed by post-training using supervised fine tuning (SFT) and reinforcement learning (RL). The final model supports up to 1M context length and achieves comparable accuracy on common benchmarks, while also achieving up to 2.2x and 7.5x higher inference throughput compared to GPT-OSS-120B and Qwen3.5-122B, respectively. Nemotron 3 Super datasets, along with the base, post-trained, and quantized checkpoints, are open-sourced on HuggingFace.
69defebfd3c84fcbf29215d7
NVIDIA
69defebfd3c84fcbf29215d9
Aakshita Chandiramani
69defebfd3c84fcbf29215da
Aaron Blakeman
69defebfd3c84fcbf29215db
Abdullahi Olaoye
69defebfd3c84fcbf29215dc
Abhibha Gupta
69defebfd3c84fcbf29215dd
Abhilash Somasamudramath
69defebfd3c84fcbf29215de
Abhinav Khattar
69defebfd3c84fcbf29215df
Adeola Adesoba
69defebfd3c84fcbf29215e0
Adi Renduchintala
69defebfd3c84fcbf29215e1
Adil Asif
69defebfd3c84fcbf29215e2
Aditya Agrawal
69defebfd3c84fcbf29215e3
Aditya Vavre
69defebfd3c84fcbf29215e4
Ahmad Kiswani
69defebfd3c84fcbf29215e5
Aishwarya Padmakumar
69defebfd3c84fcbf29215e6
Ajay Hotchandani
69defebfd3c84fcbf29215e7
Akanksha Shukla
69defebfd3c84fcbf29215e8
Akhiad Bercovich
69defebfd3c84fcbf29215e9
Aleksander Ficek
69defebfd3c84fcbf29215ea
Aleksandr Shaposhnikov
69defebfd3c84fcbf29215eb
Alex Gronskiy
69defebfd3c84fcbf29215ec
Alex Kondratenko
69defebfd3c84fcbf29215ed
Alex Neefus
69defebfd3c84fcbf29215ee
Alex Steiner
69defebfd3c84fcbf29215ef
Alex Yang
69defebfd3c84fcbf29215f0
Alexander Bukharin
69defebfd3c84fcbf29215f1
Alexander Young
69defebfd3c84fcbf29215f2
Ali Hatamizadeh
69defebfd3c84fcbf29215f3
Ali Taghibakhshi
69defebfd3c84fcbf29215f4
Alina Galiautdinova
69defebfd3c84fcbf29215f5
Alisa Liu
69defebfd3c84fcbf29215f6
Alok Kumar
69defebfd3c84fcbf29215f7
Ameya Sunil Mahabaleshwarkar
69defebfd3c84fcbf29215f8
Amir Klein
69defebfd3c84fcbf29215f9
Amit Zuker
69defebfd3c84fcbf29215fa
Amnon Geifman
69defebfd3c84fcbf29215fb
Anahita Bhiwandiwalla
69defebfd3c84fcbf29215fc
Ananth Subramaniam
69defebfd3c84fcbf29215fd
Andrew Tao
69defebfd3c84fcbf29215fe
Anjaney Shrivastava
69defebfd3c84fcbf29215ff
Anjulie Agrusa
69defebfd3c84fcbf2921600
Ankur Srivastava
69defebfd3c84fcbf2921601
Ankur Verma
69defebfd3c84fcbf2921602
Ann Guan
69defebfd3c84fcbf2921603
Anna Shors
69defebfd3c84fcbf2921604
Annamalai Chockalingam
69defebfd3c84fcbf2921605
Anubhav Mandarwal
69defebfd3c84fcbf2921606
Aparnaa Ramani
69defebfd3c84fcbf2921607
Arham Mehta
69defebfd3c84fcbf2921608
Arti Jain
69defebfd3c84fcbf2921609
Arun Venkatesan
69defebfd3c84fcbf292160a
Asha Anoosheh
69defebfd3c84fcbf292160b
Ashwath Aithal
69defebfd3c84fcbf292160c
Ashwin Poojary
69defebfd3c84fcbf292160d
Asif Ahamed
69defebfd3c84fcbf292160e
Asit Mishra
69defebfd3c84fcbf292160f
Asli Sabanci Demiroz
69defebfd3c84fcbf2921610
Asma Kuriparambil Thekkumpate
69defebfd3c84fcbf2921611
Atefeh Sohrabizadeh
69defebfd3c84fcbf2921612
Avinash Kaur
69defebfd3c84fcbf2921613
Ayush Dattagupta
69defebfd3c84fcbf2921614
Barath Subramaniam Anandan
69defebfd3c84fcbf2921615
Bardiya Sadeghi
69defebfd3c84fcbf2921616
Barnaby Simkin
69defebfd3c84fcbf2921617
Ben Lanir
69defebfd3c84fcbf2921618
Benedikt Schifferer
69defebfd3c84fcbf2921619
Benjamin Chislett
69defebfd3c84fcbf292161a
Besmira Nushi
69defebfd3c84fcbf292161b
Bilal Kartal
69defebfd3c84fcbf292161c
Bill Thiede
69defebfd3c84fcbf292161d
Bita Darvish Rouhani
69defebfd3c84fcbf292161e
Bobby Chen
69defebfd3c84fcbf292161f
Boris Ginsburg
69defebfd3c84fcbf2921620
Brandon Norick
69defebfd3c84fcbf2921621
Branislav Kisacanin
69defebfd3c84fcbf2921622
Brian Yu
69defebfd3c84fcbf2921623
Bryan Catanzaro
69defebfd3c84fcbf2921624
Buvaneswari Mani
69defebfd3c84fcbf2921625
Carlo del Mundo
69defebfd3c84fcbf2921626
Chankyu Lee
69defebfd3c84fcbf2921627
Chanran Kim
69defebfd3c84fcbf2921628
Chantal Hwang
69defebfd3c84fcbf2921629
Chao Ni
69defebfd3c84fcbf292162a
Charles Wang
69defebfd3c84fcbf292162b
Charlie Truong
69defebfd3c84fcbf292162c
Cheng-Ping Hsieh
69defebfd3c84fcbf292162d
Chenhan Yu
69defebfd3c84fcbf292162e
Chenjie Luo
69defebfd3c84fcbf292162f
Cherie Wang
69defebfd3c84fcbf2921630
Chetan Mungekar
69defebfd3c84fcbf2921631
Chintan Patel
69defebfd3c84fcbf2921632
Chris Alexiuk
69defebfd3c84fcbf2921633
Chris Holguin
69defebfd3c84fcbf2921634
Chris Wing
69defebfd3c84fcbf2921635
Christian Munley
69defebfd3c84fcbf2921636
Christopher Parisien
69defebfd3c84fcbf2921637
Chuck Desai
69defebfd3c84fcbf2921638
Chunyang Sheng
69defebfd3c84fcbf2921639
Collin Neale
69defebfd3c84fcbf292163a
Cyril Meurillon
69defebfd3c84fcbf292163b
Dakshi Kumar
69defebfd3c84fcbf292163c
Dan Gil
69defebfd3c84fcbf292163d
Dan Su
69defebfd3c84fcbf292163e
Dane Corneil
69defebfd3c84fcbf292163f
Daniel Afrimi
69defebfd3c84fcbf2921640
Daniel Burkhardt Eliuth Triana
69defebfd3c84fcbf2921641
Daniel Egert
69defebfd3c84fcbf2921642
Daniel Fatade
69defebfd3c84fcbf2921643
Daniel Lo
69defebfd3c84fcbf2921644
Daniel Rohrer
69defebfd3c84fcbf2921645
Daniel Serebrenik
69defebfd3c84fcbf2921646
Daniil Sorokin
69defebfd3c84fcbf2921647
Daria Gitman
69defebfd3c84fcbf2921648
Daria Levy
69defebfd3c84fcbf2921649
Darko Stosic
69defebfd3c84fcbf292164a
David Edelsohn
69defebfd3c84fcbf292164b
David Messina
69defebfd3c84fcbf292164c
David Mosallanezhad
69defebfd3c84fcbf292164d
David Tamok
69defebfd3c84fcbf292164e
Deena Donia
69defebfd3c84fcbf292164f
Deepak Narayanan
69defebfd3c84fcbf2921650
Devin O'Kelly
69defebfd3c84fcbf2921651
Dheeraj Peri
69defebfd3c84fcbf2921652
Dhruv Nathawani
69defebfd3c84fcbf2921653
Di Wu
69defebfd3c84fcbf2921654
Dima Rekesh
69defebfd3c84fcbf2921655
Dina Yared
69defebfd3c84fcbf2921656
Divyanshu Kakwani
69defebfd3c84fcbf2921657
Dmitry Konyagin Brandon Tuttle
69defebfd3c84fcbf2921658
Dong Ahn
69defebfd3c84fcbf2921659
Dongfu Jiang
69defebfd3c84fcbf292165a
Dorrin Poorkay
69defebfd3c84fcbf292165b
Douglas O'Flaherty
69defebfd3c84fcbf292165c
Duncan Riach
69defebfd3c84fcbf292165d
Dusan Stosic
69defebfd3c84fcbf292165e
Dustin Van Stee
69defebfd3c84fcbf292165f
Edgar Minasyan
69defebfd3c84fcbf2921660
Edward Lin
69defebfd3c84fcbf2921661
Eileen Peters Long
69defebfd3c84fcbf2921662
Elad Segal
69defebfd3c84fcbf2921663
Elena Lantz
69defebfd3c84fcbf2921664
Elena Lewis
69defebfd3c84fcbf2921665
Ellie Evans
69defebfd3c84fcbf2921666
Elliott Ning
69defebfd3c84fcbf2921667
Eric Chung
69defebfd3c84fcbf2921668
Eric Harper
69defebfd3c84fcbf2921669
Eric Pham-Hung
69defebfd3c84fcbf292166a
Eric W. Tramel
69defebfd3c84fcbf292166b
Erick Galinkin
69defebfd3c84fcbf292166c
Erik Pounds
69defebfd3c84fcbf292166d
Esti Etrog
69defebfd3c84fcbf292166e
Evan Briones
69defebfd3c84fcbf292166f
Evan Wu
69defebfd3c84fcbf2921670
Evelina Bakhturina
69defebfd3c84fcbf2921671
Evgeny Tsykunov
69defebfd3c84fcbf2921672
Ewa Dobrowolska
69defebfd3c84fcbf2921673
Farshad Saberi Movahed
69defebfd3c84fcbf2921674
Farzan Memarian
69defebfd3c84fcbf2921675
Fay Wang
69defebfd3c84fcbf2921676
Fei Jia
69defebfd3c84fcbf2921677
Felipe Soares
69defebfd3c84fcbf2921678
Felipe Vieira Frujeri
69defebfd3c84fcbf2921679
Feng Chen
69defebfd3c84fcbf292167a
Fengguang Lin
69defebfd3c84fcbf292167b
Ferenc Galko
69defebfd3c84fcbf292167c
Fortuna Zhang
69defebfd3c84fcbf292167d
Frankie Siino
69defebfd3c84fcbf292167e
Frida Hou
69defebfd3c84fcbf292167f
Gantavya Bhatt
69defebfd3c84fcbf2921680
Gargi Prasad
69defebfd3c84fcbf2921681
Geethapriya Venkataramani
69defebfd3c84fcbf2921682
Geetika Gupta
69defebfd3c84fcbf2921683
George Armstrong
69defebfd3c84fcbf2921684
Gerald Shen
69defebfd3c84fcbf2921685
Giulio Borghesi
69defebfd3c84fcbf2921686
Gordana Neskovic
69defebfd3c84fcbf2921687
Gorkem Batmaz
69defebfd3c84fcbf2921688
Grace Lam
69defebfd3c84fcbf2921689
Grace Wu
69defebfd3c84fcbf292168a
Greg Pauloski
69defebfd3c84fcbf292168b
Greyson Davis
69defebfd3c84fcbf292168c
Grigor Nalbandyan
69defebfd3c84fcbf292168d
Guoming Zhang
69defebfd3c84fcbf292168e
Guy Farber
69defebfd3c84fcbf292168f
Guyue Huang
69defebfd3c84fcbf2921690
Haifeng Qian
69defebfd3c84fcbf2921691
Haran Kumar Shiv Kumar
69defebfd3c84fcbf2921692
Harry Kim
69defebfd3c84fcbf2921693
Harsh Sharma
69defebfd3c84fcbf2921694
Hayate Iso
69defebfd3c84fcbf2921695
Hayley Ross
69defebfd3c84fcbf2921696
Herbert Hum
69defebfd3c84fcbf2921697
Herman Sahota
69defebfd3c84fcbf2921698
Hexin Wang
69defebfd3c84fcbf2921699
Himanshu Soni
69defebfd3c84fcbf292169a
Hiren Upadhyay
69defebfd3c84fcbf292169b
Huy Nguyen
69defebfd3c84fcbf292169c
Iain Cunningham
69defebfd3c84fcbf292169d
Ido Galil
69defebfd3c84fcbf292169e
Ido Shahaf
69defebfd3c84fcbf292169f
Igino Padovani
69defebfd3c84fcbf29216a0
Igor Gitman
69defebfd3c84fcbf29216a1
Igor Shovkun
69defebfd3c84fcbf29216a2
Ikroop Dhillon
69defebfd3c84fcbf29216a3
Ilya Loshchilov
69defebfd3c84fcbf29216a4
Ingrid Kelly
69defebfd3c84fcbf29216a5
Itamar Schen
69defebfd3c84fcbf29216a6
Itay Levy
69defebfd3c84fcbf29216a7
Ivan Moshkov
69defebfd3c84fcbf29216a8
Izik Golan
69defebfd3c84fcbf29216a9
Izzy Putterman
69defebfd3c84fcbf29216aa
Jain Tu
69defebfd3c84fcbf29216ab
Jan Baczek
69defebfd3c84fcbf29216ac
Jan Kautz
69defebfd3c84fcbf29216ad
Jane Polak Scowcroft
69defebfd3c84fcbf29216ae
Janica Rosenberg
69defebfd3c84fcbf29216af
Jared Casper
69defebfd3c84fcbf29216b0
Jarrod Pflum
69defebfd3c84fcbf29216b1
Jason Grant
69defebfd3c84fcbf29216b2
Jason Sewall
69defebfd3c84fcbf29216b3
Jatin Mitra
69defebfd3c84fcbf29216b4
Jeffrey Glick
69defebfd3c84fcbf29216b5
Jenny Chen
69defebfd3c84fcbf29216b6
Jesse Oliver
69defebfd3c84fcbf29216b7
Jiacheng Xu
69defebfd3c84fcbf29216b8
Jiafan Zhu
69defebfd3c84fcbf29216b9
Jialin Song
69defebfd3c84fcbf29216ba
Jian Zhang
69defebfd3c84fcbf29216bb
Jiaqi Zeng
69defebfd3c84fcbf29216bc
Jie Lou
69defebfd3c84fcbf29216bd
Jill Milton
69defebfd3c84fcbf29216be
Jim Chow
69defebfd3c84fcbf29216bf
Jimmy Zhang
69defebfd3c84fcbf29216c0
Jinhang Choi
69defebfd3c84fcbf29216c1
Jining Huang
69defebfd3c84fcbf29216c2
Jocelyn Huang
69defebfd3c84fcbf29216c3
Joel Caruso
69defebfd3c84fcbf29216c4
Joey Conway
69defebfd3c84fcbf29216c5
Joey Guman
69defebfd3c84fcbf29216c6
Johan Jatko
69defebfd3c84fcbf29216c7
John Kamalu
69defebfd3c84fcbf29216c8
Johnny Greco
69defebfd3c84fcbf29216c9
Jonathan Cohen
69defebfd3c84fcbf29216ca
Jonathan Raiman
69defebfd3c84fcbf29216cb
Joseph Jennings
69defebfd3c84fcbf29216cc
Joyjit Daw
69defebfd3c84fcbf29216cd
Juan Yu
69defebfd3c84fcbf29216ce
Julio Tapia
69defebfd3c84fcbf29216cf
Junkeun Yi
69defebfd3c84fcbf29216d0
Jupinder Parmar
69defebfd3c84fcbf29216d1
Jyothi Achar
69defebfd3c84fcbf29216d2
Kari Briski
69defebfd3c84fcbf29216d3
Kartik Mattoo
69defebfd3c84fcbf29216d4
Katherine Cheung
69defebfd3c84fcbf29216d5
Katherine Luna
69defebfd3c84fcbf29216d6
Keith Wyss
69defebfd3c84fcbf29216d7
Kevin Shih
69defebfd3c84fcbf29216d8
Kezhi Kong
69defebfd3c84fcbf29216d9
Khanh Nguyen
69defebfd3c84fcbf29216da
Khushi Bhardwaj
69defebfd3c84fcbf29216db
Kirill Buryak
69defebfd3c84fcbf29216dc
Kirthi Shankar Sivamani
69defebfd3c84fcbf29216dd
Konstantinos Krommydas
69defebfd3c84fcbf29216de
Kris Murphy
69defebfd3c84fcbf29216df
Krishna C. Puvvada
69defebfd3c84fcbf29216e0
Krzysztof Pawelec
69defebfd3c84fcbf29216e1
Kumar Anik
69defebfd3c84fcbf29216e2
Laikh Tewari
69defebfd3c84fcbf29216e3
Laya Sleiman
69defebfd3c84fcbf29216e4
Leo Du
69defebfd3c84fcbf29216e5
Leon Derczynski
69defebfd3c84fcbf29216e6
Li Ding
69defebfd3c84fcbf29216e7
Lilach Ilan
69defebfd3c84fcbf29216e8
Lingjie Wu
69defebfd3c84fcbf29216e9
Lizzie Wei
69defebfd3c84fcbf29216ea
Luis Vega
69defebfd3c84fcbf29216eb
Lun Su
69defebfd3c84fcbf29216ec
Maarten Van Segbroeck
69defebfd3c84fcbf29216ed
Maer Rodrigues de Melo
69defebfd3c84fcbf29216ee
Magaret Zhang
69defebfd3c84fcbf29216ef
Mahan Fathi
69defebfd3c84fcbf29216f0
Makesh Narsimhan Sreedhar
69defebfd3c84fcbf29216f1
Makesh Sreedhar
69defebfd3c84fcbf29216f2
Makesh Tarun Chandran
69defebfd3c84fcbf29216f3
Manuel Reyes Gomez
69defebfd3c84fcbf29216f4
Maor Ashkenazi
69defebfd3c84fcbf29216f5
Marc Cuevas
69defebfd3c84fcbf29216f6
Marc Romeijn
69defebfd3c84fcbf29216f7
Margaret Zhang
69defebfd3c84fcbf29216f8
Mark Cai
69defebfd3c84fcbf29216f9
Mark Gabel
69defebfd3c84fcbf29216fa
Markus Kliegl
69defebfd3c84fcbf29216fb
Martyna Patelka
69defebfd3c84fcbf29216fc
Maryam Moosaei
69defebfd3c84fcbf29216fd
Matthew Varacalli
69defebfd3c84fcbf29216fe
Matvei Novikov
69defebfd3c84fcbf29216ff
Mauricio Ferrato
69defebfd3c84fcbf2921700
Mehrzad Samadi
69defebfd3c84fcbf2921701
Melissa Corpuz
69defebfd3c84fcbf2921702
Meng Xin
69defebfd3c84fcbf2921703
Mengdi Wang
69defebfd3c84fcbf2921704
Mengru Wang
69defebfd3c84fcbf2921705
Meredith Price
69defebfd3c84fcbf2921706
Micah Schaffer
69defebfd3c84fcbf2921707
Michael Andersch
69defebfd3c84fcbf2921708
Michael Boone
69defebfd3c84fcbf2921709
Michael Evans
69defebfd3c84fcbf292170a
Michael Z Wang
69defebfd3c84fcbf292170b
Miguel Martinez
69defebfd3c84fcbf292170c
Mikail Khona
69defebfd3c84fcbf292170d
Mike Chrzanowski
69defebfd3c84fcbf292170e
Mike Hollinger
69defebfd3c84fcbf292170f
Mingyuan Ma
69defebfd3c84fcbf2921710
Minseok Lee
69defebfd3c84fcbf2921711
Mohammad Dabbah
69defebfd3c84fcbf2921712
Mohammad Shoeybi
69defebfd3c84fcbf2921713
Mostofa Patwary
69defebfd3c84fcbf2921714
Nabin Mulepati
69defebfd3c84fcbf2921715
Nader Khalil
69defebfd3c84fcbf2921716
Najeeb Nabwani
69defebfd3c84fcbf2921717
Nancy Agarwal
69defebfd3c84fcbf2921718
Nanthini Balasubramaniam
69defebfd3c84fcbf2921719
Narimane Hennouni
69defebfd3c84fcbf292171a
Narsi Kodukula
69defebfd3c84fcbf292171b
Natalie Hereth
69defebfd3c84fcbf292171c
Nathaniel Pinckney
69defebfd3c84fcbf292171d
Nave Assaf
69defebfd3c84fcbf292171e
Negar Habibi
69defebfd3c84fcbf292171f
Nestor Qin
69defebfd3c84fcbf2921720
Neta Zmora
69defebfd3c84fcbf2921721
Netanel Haber
69defebfd3c84fcbf2921722
Nick Reamaroon
69defebfd3c84fcbf2921723
Nickson Quak
69defebfd3c84fcbf2921724
Nidhi Bhatia
69defebfd3c84fcbf2921725
Nikhil Jukar
69defebfd3c84fcbf2921726
Nikki Pope
69defebfd3c84fcbf2921727
Nikolai Ludwig
69defebfd3c84fcbf2921728
Nima Tajbakhsh
69defebfd3c84fcbf2921729
Nir Ailon
69defebfd3c84fcbf292172a
Nirmal Juluru
69defebfd3c84fcbf292172b
Nirmalya De
69defebfd3c84fcbf292172c
Nowel Pitt
69defebfd3c84fcbf292172d
Oleg Rybakov
69defebfd3c84fcbf292172e
Oleksii Hrinchuk
69defebfd3c84fcbf292172f
Oleksii Kuchaiev
69defebfd3c84fcbf2921730
Olivier Delalleau
69defebfd3c84fcbf2921731
Oluwatobi Olabiyi
69defebfd3c84fcbf2921732
Omer Ullman Argov
69defebfd3c84fcbf2921733
Omri Almog
69defebfd3c84fcbf2921734
Omri Puny
69defebfd3c84fcbf2921735
Oren Tropp
69defebfd3c84fcbf2921736
Otavio Padovani
69defebfd3c84fcbf2921737
Ouye Xie
69defebfd3c84fcbf2921738
Parth Chadha
69defebfd3c84fcbf2921739
Pasha Shamis
69defebfd3c84fcbf292173a
Paul Gibbons
69defebfd3c84fcbf292173b
Pavlo Molchanov
69defebfd3c84fcbf292173c
Peter Belcak
69defebfd3c84fcbf292173d
Peter Jin
69defebfd3c84fcbf292173e
Pinky Xu
69defebfd3c84fcbf292173f
Piotr Januszewski
69defebfd3c84fcbf2921740
Pooya Jannaty
69defebfd3c84fcbf2921741
Prachi Shevate
69defebfd3c84fcbf2921742
Pradeep Thalasta
69defebfd3c84fcbf2921743
Pranav Prashant Thombre
69defebfd3c84fcbf2921744
Prasoon Varshney
69defebfd3c84fcbf2921745
Prerana Gambhir
69defebfd3c84fcbf2921746
Pritam Gundecha
69defebfd3c84fcbf2921747
Przemek Tredak
69defebfd3c84fcbf2921748
Qing Miao
69defebfd3c84fcbf2921749
Qiyu Wan
69defebfd3c84fcbf292174a
Quan Tran Minh
69defebfd3c84fcbf292174b
Rabeeh Karimi Mahabadi
69defebfd3c84fcbf292174c
Rachel Oberman
69defebfd3c84fcbf292174d
Rachit Garg
69defebfd3c84fcbf292174e
Rahul Kandu
69defebfd3c84fcbf292174f
Raina Zhong
69defebfd3c84fcbf2921750
Ran El-Yaniv
69defebfd3c84fcbf2921751
Ran Zilberstein
69defebfd3c84fcbf2921752
Rasoul Shafipour
69defebfd3c84fcbf2921753
Renee Yao
69defebfd3c84fcbf2921754
Renjie Pi
69defebfd3c84fcbf2921755
Richard Mazzarese
69defebfd3c84fcbf2921756
Richard Wang
69defebfd3c84fcbf2921757
Rick Izzo
69defebfd3c84fcbf2921758
Ridhima Singla
69defebfd3c84fcbf2921759
Rima Shahbazyan
69defebfd3c84fcbf292175a
Rishabh Garg
69defebfd3c84fcbf292175b
Ritika Borkar
69defebfd3c84fcbf292175c
Ritu Gala
69defebfd3c84fcbf292175d
Riyad Islam
69defebfd3c84fcbf292175e
Robert Clark
69defebfd3c84fcbf292175f
Robert Hesse
69defebfd3c84fcbf2921760
Roger Waleffe
69defebfd3c84fcbf2921761
Rohit Varma Kalidindi
69defebfd3c84fcbf2921762
Rohit Watve
69defebfd3c84fcbf2921763
Roi Koren
69defebfd3c84fcbf2921764
Ron Fan
69defebfd3c84fcbf2921765
Ruchika Kharwar
69defebfd3c84fcbf2921766
Ruisi Cai
69defebfd3c84fcbf2921767
Ruoxi Zhang
69defebfd3c84fcbf2921768
Russell J. Hewett
69defebfd3c84fcbf2921769
Ryan Prenger
69defebfd3c84fcbf292176a
Ryan Timbrook
69defebfd3c84fcbf292176b
Ryota Egashira
69defebfd3c84fcbf292176c
Sadegh Mahdavi
69defebfd3c84fcbf292176d
Sagar Singh Ashutosh Joshi
69defebfd3c84fcbf292176e
Sahil Modi
69defebfd3c84fcbf292176f
Samuel Kriman
69defebfd3c84fcbf2921770
Sandeep Pombra
69defebfd3c84fcbf2921771
Sanjay Kariyappa
69defebfd3c84fcbf2921772
Sanjeev Satheesh
69defebfd3c84fcbf2921773
Santiago Pombo
69defebfd3c84fcbf2921774
Saori Kaji
69defebfd3c84fcbf2921775
Satish Pasumarthi
69defebfd3c84fcbf2921776
Saurav Mishra
69defebfd3c84fcbf2921777
Saurav Muralidharan
69defebfd3c84fcbf2921778
Scott Hara
69defebfd3c84fcbf2921779
Sean Narenthiran
69defebfd3c84fcbf292177a
Sebastian Rogawski
69defebfd3c84fcbf292177b
Seonjin Na
69defebfd3c84fcbf292177c
Seonmyeong Bak
69defebfd3c84fcbf292177d
Sepehr Sameni
claimed_verified
2026-04-16T08:03:05.099Z
63047a28eb6d777a838c3714
/avatars/918ec951c727c8ea7a349f0afd23f2bf.svg
Sepehr Sameni
Separius
user
Separius
69defebfd3c84fcbf292177e
Seth Poulos
69defebfd3c84fcbf292177f
Shahar Mor
69defebfd3c84fcbf2921780
Shantanu Acharya
69defebfd3c84fcbf2921781
Shaona Ghosh Adam Lord
69defebfd3c84fcbf2921782
Sharath Turuvekere Sreenivas
69defebfd3c84fcbf2921783
Shaun Kotek
69defebfd3c84fcbf2921784
Shaya Gharghabi
69defebfd3c84fcbf2921785
Shelby Thomas
69defebfd3c84fcbf2921786
Sheng-Chieh Lin
69defebfd3c84fcbf2921787
Shibani Likhite
69defebfd3c84fcbf2921788
Shiqing Fan
69defebfd3c84fcbf2921789
Shiyang Chen
69defebfd3c84fcbf292178a
Shreya Gopal
69defebfd3c84fcbf292178b
Shrimai Prabhumoye
69defebfd3c84fcbf292178c
Shubham Pachori
69defebfd3c84fcbf292178d
Shubham Toshniwal
69defebfd3c84fcbf292178e
Shuo Zhang
69defebfd3c84fcbf292178f
Shuoyang Ding
69defebfd3c84fcbf2921790
Shyam Renjith
69defebfd3c84fcbf2921791
Shyamala Prayaga
69defebfd3c84fcbf2921792
Siddhartha Jain
69defebfd3c84fcbf2921793
Simeng Sun
69defebfd3c84fcbf2921794
Sirisha Rella
69defebfd3c84fcbf2921795
Sirshak Das
69defebfd3c84fcbf2921796
Smita Ithape
69defebfd3c84fcbf2921797
Sneha Harishchandra S
69defebfd3c84fcbf2921798
Somshubra Majumdar
69defebfd3c84fcbf2921799
Soumye Singhal
69defebfd3c84fcbf292179a
Sri Harsha Singudasu
69defebfd3c84fcbf292179b
Sriharsha Niverty
69defebfd3c84fcbf292179c
Stas Sergienko
69defebfd3c84fcbf292179d
Stefana Gloginic
69defebfd3c84fcbf292179e
Stefania Alborghetti
69defebfd3c84fcbf292179f
Stephen Ge
69defebfd3c84fcbf29217a0
Stephen McCullough
69defebfd3c84fcbf29217a1
Sugam Dipak Devare
69defebfd3c84fcbf29217a2
Suguna Varshini Velury
69defebfd3c84fcbf29217a3
Sukrit Rao
69defebfd3c84fcbf29217a4
Sumeet Kumar Barua
69defebfd3c84fcbf29217a5
Sunny Gai
69defebfd3c84fcbf29217a6
Suseella Panguluri
69defebfd3c84fcbf29217a7
Sushil Koundinyan
69defebfd3c84fcbf29217a8
Swathi Patnam
69defebfd3c84fcbf29217a9
Sweta Priyadarshi
69defebfd3c84fcbf29217aa
Swetha Bhendigeri
69defebfd3c84fcbf29217ab
Syeda Nahida Akter
69defebfd3c84fcbf29217ac
Sylendran Arunagiri
69defebfd3c84fcbf29217ad
Tailling Yuan
69defebfd3c84fcbf29217ae
Talor Abramovich
claimed_verified
2026-04-15T11:50:55.399Z
668e7a379ab7631fcd434ee7
/avatars/68ddbc5e35125a779655e9033d24afe5.svg
Talor Abramovich
talor-abr
user
talor-abr
69defebfd3c84fcbf29217af
Tan Bui
69defebfd3c84fcbf29217b0
Tan Yu
69defebfd3c84fcbf29217b1
Terry Kong
69defebfd3c84fcbf29217b2
Thanh Do
69defebfd3c84fcbf29217b3
Thomas Gburek
69defebfd3c84fcbf29217b4
Thorgane Marques
69defebfd3c84fcbf29217b5
Tiffany Moore
69defebfd3c84fcbf29217b6
Tijmen Blankevoort
69defebfd3c84fcbf29217b7
Tim Moon
69defebfd3c84fcbf29217b8
Timothy Ma
69defebfd3c84fcbf29217b9
Tiyasa Mitra
69defebfd3c84fcbf29217ba
Tomasz Grzegorzek
69defebfd3c84fcbf29217bb
Tomer Asida
69defebfd3c84fcbf29217bc
Tomer Bar Natan
69defebfd3c84fcbf29217bd
Tomer Keren
69defebfd3c84fcbf29217be
Tomer Ronen
69defebfd3c84fcbf29217bf
Traian Rebedea
69defebfd3c84fcbf29217c0
Trenton Starkey
69defebfd3c84fcbf29217c1
Tugrul Konuk
69defebfd3c84fcbf29217c2
Twinkle Vashishth
69defebfd3c84fcbf29217c3
Tyler Condensa
69defebfd3c84fcbf29217c4
Udi Karpas
69defebfd3c84fcbf29217c5
Ushnish De
69defebfd3c84fcbf29217c6
Vahid Noorozi
69defebfd3c84fcbf29217c7
Vahid Noroozi
69defebfd3c84fcbf29217c8
Vanshil Atul Shah
69defebfd3c84fcbf29217c9
Veena Vaidyanathan
69defebfd3c84fcbf29217ca
Venkat Srinivasan
69defebfd3c84fcbf29217cb
Venmugil Elango
69defebfd3c84fcbf29217cc
Victor Cui
69defebfd3c84fcbf29217cd
Vijay Korthikanti
69defebfd3c84fcbf29217ce
Vikas Mehta
69defebfd3c84fcbf29217cf
Virginia Adams
69defebfd3c84fcbf29217d0
Virginia Wu
69defebfd3c84fcbf29217d1
Vitaly Kurin
69defebfd3c84fcbf29217d2
Vitaly Lavrukhin
69defebfd3c84fcbf29217d3
Vladimir Anisimov
69defebfd3c84fcbf29217d4
Wan Seo
69defebfd3c84fcbf29217d5
Wanli Jiang
69defebfd3c84fcbf29217d6
Wasi Uddin Ahmad
69defebfd3c84fcbf29217d7
Wei Du
69defebfd3c84fcbf29217d8
Wei Ping
69defebfd3c84fcbf29217d9
Wei-Ming Chen
69defebfd3c84fcbf29217da
Wendy Quan
69defebfd3c84fcbf29217db
Wenliang Dai
69defebfd3c84fcbf29217dc
Wenwen Gao
69defebfd3c84fcbf29217dd
Will Jennings
69defebfd3c84fcbf29217de
William Zhang
69defebfd3c84fcbf29217df
Xiaowei Ren
69defebfd3c84fcbf29217e0
Xiaowen Xin
69defebfd3c84fcbf29217e1
Xin Li
69defebfd3c84fcbf29217e2
Yang Yu
69defebfd3c84fcbf29217e3
Yangyi Chen
69defebfd3c84fcbf29217e4
Yaniv Galron
69defebfd3c84fcbf29217e5
Yashaswi Karnati
69defebfd3c84fcbf29217e6
Yejin Choi
69defebfd3c84fcbf29217e7
Yev Meyer
69defebfd3c84fcbf29217e8
Yi-Fu Wu
69defebfd3c84fcbf29217e9
Yian Zhang
69defebfd3c84fcbf29217ea
Ying Lin
69defebfd3c84fcbf29217eb
Yonatan Geifman
69defebfd3c84fcbf29217ec
Yonggan Fu
69defebfd3c84fcbf29217ed
Yoshi Suhara
69defebfd3c84fcbf29217ee
Youngeun Kwon
69defebfd3c84fcbf29217ef
Yuan Zhang
69defebfd3c84fcbf29217f0
Yuki Huang
69defebfd3c84fcbf29217f1
Zach Moshe
69defebfd3c84fcbf29217f2
Zhilin Wang
69defebfd3c84fcbf29217f3
Zhiyu Cheng
69defebfd3c84fcbf29217f4
Zhongbo Zhu
69defebfd3c84fcbf29217f5
Zhuolin Yang
69defebfd3c84fcbf29217f6
Zihan Liu
69defebfd3c84fcbf29217f7
Zijia Chen
69defebfd3c84fcbf29217f8
Zijie Yan
69defebfd3c84fcbf29217f9
Zuhair Ahmed
Nemotron 3 Super: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
We describe the pre-training, post-training, and quantization of Nemotron 3 Super, a 120 billion (active 12 billion) parameter hybrid Mamba-Attention Mixture-of-Experts model. Nemotron 3 Super is the first model in the Nemotron 3 family to 1) be pre-trained in NVFP4, 2) leverage LatentMoE, a new Mixture-of-Experts architecture that optimizes for both accuracy per FLOP and accuracy per parameter, and 3) include MTP layers for inference acceleration through native speculative decoding. We pre-trained Nemotron 3 Super on 25 trillion tokens followed by post-training using supervised fine tuning (SFT) and reinforcement learning (RL). The final model supports up to 1M context length and achieves comparable accuracy on common benchmarks, while also achieving up to 2.2x and 7.5x higher inference throughput compared to GPT-OSS-120B and Qwen3.5-122B, respectively. Nemotron 3 Super datasets, along with the base, post-trained, and quantized checkpoints, are open-sourced on HuggingFace.
Nemotron 3 Super is a 120 billion parameter hybrid Mamba-Attention Mixture-of-Experts model pre-trained in NVFP4 with LatentMoE architecture and MTP layers for accelerated inference, achieving superior throughput compared to existing models.
hybrid Mamba-Attention Mixture-of-Experts NVFP4 LatentMoE Mixture-of-Experts speculative decoding supervised fine tuning reinforcement learning context length inference throughput