Audio Flamingo Next: Next-Generation Open Audio-Language Models for Speech, Sound, and Music
We present Audio Flamingo Next (AF-Next), the next-generation and most capable large audio-language model in the Audio Flamingo series, designed to advance understanding and reasoning over speech, environmental sounds and music. Compared to Audio Flamingo 3, AF-Next introduces: (i) a stronger foundational audio-language model that significantly improves accuracy across diverse audio understanding tasks; (ii) scalable strategies for constructing large-scale audio understanding and reasoning data beyond existing academic benchmarks; (iii) support for long and complex audio inputs up to 30 minutes; and (iv) Temporal Audio Chain-of-Thought, a new reasoning paradigm that explicitly grounds intermediate reasoning steps to timestamps in long audio, enabling fine-grained temporal alignment and improved interpretability. To enable these capabilities, we first conduct a systematic analysis of Audio Flamingo 3 to identify key gaps in audio understanding and reasoning. We then curate and scale new large-scale datasets totaling over 1 million hours to address these limitations and expand the existing AudioSkills-XL, LongAudio-XL, AF-Think and AF-Chat datasets. AF-Next is trained using a curriculum-based strategy spanning pre-training, mid-training and post-training stages. Extensive experiments across 20 audio understanding and reasoning benchmarks, including challenging long-audio tasks, show that AF-Next outperforms similarly sized open models by large margins and remains highly competitive with and sometimes surpasses, much larger open-weight and closed models. Beyond benchmark performance, AF-Next exhibits strong real-world utility and transfers well to unseen tasks, highlighting its robustness and generalization ability. In addition to all data, code and methods, we open-source 3 variants of AF-Next, including AF-Next-Instruct, AF-Next-Think and AF-Next-Captioner.
69dd9cfbaea31e227c22c38f
Sreyan Ghosh
claimed_verified
2026-04-16T08:18:38.921Z
62c9664eb34e600d7eaa4beb
/avatars/ca23ecdec2d31c99ecce97d9b180ae0c.svg
Ghosh
Sreyan88
user
Sreyan88
69dd9cfbaea31e227c22c390
Arushi Goel
69dd9cfbaea31e227c22c391
Kaousheik Jayakumar
69dd9cfbaea31e227c22c392
Lasha Koroshinadze
claimed_verified
2026-04-15T12:08:16.396Z
63fc96a0b9db84750cec216f
/avatars/eb8cb2518260de4851f8f6aa8bc5508c.svg
Lasha Koroshinadze
lashahub
user
lashahub
69dd9cfbaea31e227c22c393
Nishit Anand
69dd9cfbaea31e227c22c394
Zhifeng Kong
69dd9cfbaea31e227c22c395
Siddharth Gururani
69dd9cfbaea31e227c22c396
Sang-gil Lee
claimed_verified
2026-04-15T12:08:18.043Z
628dba7ea13c4b25ff786ec6
https://cdn-avatars.huggingface.co/v1/production/uploads/1671164940704-628dba7ea13c4b25ff786ec6.jpeg
Sang-gil Lee
L0SG
user
L0SG
69dd9cfbaea31e227c22c397
Jaehyeon Kim
69dd9cfbaea31e227c22c398
Aya Aljafari
69dd9cfbaea31e227c22c399
Chao-Han Huck Yang
claimed_verified
2026-04-16T20:22:19.327Z
629e1b71bb6419817ed7566c
https://cdn-avatars.huggingface.co/v1/production/uploads/629e1b71bb6419817ed7566c/0ZCt-11eQtRDCOk9AozOp.jpeg
Huck Yang
huckiyang
user
huckiyang
69dd9cfbaea31e227c22c39a
Sungwon Kim
69dd9cfbaea31e227c22c39b
Ramani Duraiswami
69dd9cfbaea31e227c22c39c
Dinesh Manocha
69dd9cfbaea31e227c22c39d
Mohammad Shoeybi
69dd9cfbaea31e227c22c39e
Bryan Catanzaro
69dd9cfbaea31e227c22c39f
Ming-Yu Liu
69dd9cfbaea31e227c22c3a0
Wei Ping
Audio Flamingo Next: Next-Generation Open Audio-Language Models for Speech, Sound, and Music
We present Audio Flamingo Next (AF-Next), the next-generation and most capable large audio-language model in the Audio Flamingo series, designed to advance understanding and reasoning over speech, environmental sounds and music. Compared to Audio Flamingo 3, AF-Next introduces: (i) a stronger foundational audio-language model that significantly improves accuracy across diverse audio understanding tasks; (ii) scalable strategies for constructing large-scale audio understanding and reasoning data beyond existing academic benchmarks; (iii) support for long and complex audio inputs up to 30 minutes; and (iv) Temporal Audio Chain-of-Thought, a new reasoning paradigm that explicitly grounds intermediate reasoning steps to timestamps in long audio, enabling fine-grained temporal alignment and improved interpretability. To enable these capabilities, we first conduct a systematic analysis of Audio Flamingo 3 to identify key gaps in audio understanding and reasoning. We then curate and scale new large-scale datasets totaling over 1 million hours to address these limitations and expand the existing AudioSkills-XL, LongAudio-XL, AF-Think and AF-Chat datasets. AF-Next is trained using a curriculum-based strategy spanning pre-training, mid-training and post-training stages. Extensive experiments across 20 audio understanding and reasoning benchmarks, including challenging long-audio tasks, show that AF-Next outperforms similarly sized open models by large margins and remains highly competitive with and sometimes surpasses, much larger open-weight and closed models. Beyond benchmark performance, AF-Next exhibits strong real-world utility and transfers well to unseen tasks, highlighting its robustness and generalization ability. In addition to all data, code and methods, we open-source 3 variants of AF-Next, including AF-Next-Instruct, AF-Next-Think and AF-Next-Captioner.
Audio Flamingo Next represents a significant advancement in audio-language modeling with enhanced understanding capabilities, extended audio input lengths, and novel temporal reasoning mechanisms.
audio-language model Audio Flamingo long audio inputs Temporal Audio Chain-of-Thought curriculum-based strategy pre-training mid-training post-training audio understanding audio reasoning large-scale datasets AudioSkills-XL LongAudio-XL AF-Think AF-Chat