VIBEVOICE-ASR Technical Report
This report presents VibeVoice-ASR, a general-purpose speech understanding framework built upon VibeVoice, designed to address the persistent challenges of context fragmentation and multi-speaker complexity in long-form audio (e.g., meetings, podcasts) that remain despite recent advancements in short-form speech recognition. Unlike traditional pipelined approaches that rely on audio chunking, VibeVoice-ASRsupports single-pass processing for up to 60 minutes of audio. It unifies Automatic Speech Recognition, Speaker Diarization, and Timestamping into a single end-to-end generation task. In addition, VibeVoice-ASR supports over 50 languages, requires no explicit language setting, and natively handles code-switching within and across utterances. Furthermore, we introduce a prompt-based context injection mechanism that allows users to supply customized conetxt, significantly improving accuracy on domain-specific terminology and polyphonic character disambiguation.
697832bd026bdf0473116e89
Zhiliang Peng
admin_assigned
2026-01-27T14:29:35.447Z
68e3ba91fc9f7cbda9a2be02
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/5h166wHkdQSG7IusNV5wT.png
pengzhiliang
zhiliang2
user
zhiliang2
697832bd026bdf0473116e8a
Jianwei Yu
697832bd026bdf0473116e8b
Yaoyao Chang
admin_assigned
2026-01-27T14:30:15.096Z
65e552cb4dbf9514fb0c3110
/avatars/655dd9a36e85c1290855fb2c296472f8.svg
Yaoyao Chang
YaoyaoChang
user
YaoyaoChang
697832bd026bdf0473116e8c
Zilong Wang
697832bd026bdf0473116e8d
Li Dong
claimed_verified
2026-03-18T08:47:02.959Z
5df85abada6d0311fd3d5408
/avatars/2331cf703c1b5d3a62e2050b1a6eb108.svg
Li Dong
unilm
user
unilm
697832bd026bdf0473116e8e
Yingbo Hao
admin_assigned
2026-01-27T14:30:33.802Z
672b6da69380700b60c92367
/avatars/651b8bd4d1d6bbd047c6f0d6010a0ea3.svg
Yingbo Hao
YingboHao
user
YingboHao
697832bd026bdf0473116e8f
Yujie Tu
697832bd026bdf0473116e90
Chenyu Yang
697832bd026bdf0473116e91
Wenhui Wang
admin_assigned
2026-01-27T14:30:44.557Z
661396d69ef83c1509d41c3f
/avatars/9760ac72f2d44320e6033d30e2ce7bd5.svg
Wenhui Wang
stonewh1
user
stonewh1
697832bd026bdf0473116e92
Songchen Xu
697832bd026bdf0473116e93
Yutao Sun
697832bd026bdf0473116e94
Hangbo Bao
697832bd026bdf0473116e95
Weijiang Xu
admin_assigned
2026-01-27T14:30:57.860Z
66f4cc8dcb62f781535a27ac
/avatars/2b6cf6513a0c93f932115634092f7d30.svg
Weijiang Xu
WeijiangXU
user
WeijiangXU
697832bd026bdf0473116e96
Yi Zhu
697832bd026bdf0473116e97
Zehua Wang
admin_assigned
2026-01-27T14:31:04.270Z
67b358e504fec7fd742ae8c1
/avatars/3f404b20df769bcf87e8d8d7d5fc9ed6.svg
Zehua Wang
zehuawang
user
zehuawang
697832bd026bdf0473116e98
Ting Song
697832bd026bdf0473116e99
Yan Xia
697832bd026bdf0473116e9a
Zewen Chi
admin_assigned
2026-01-27T14:31:10.007Z
60f6d61f89b21b8fd2d471c6
https://cdn-avatars.huggingface.co/v1/production/uploads/60f6d61f89b21b8fd2d471c6/RmLFf97vUoXMoCT3rWbhm.jpeg
Zewen Chi
CZWin32768
user
CZWin32768
697832bd026bdf0473116e9b
Shaohan Huang
697832bd026bdf0473116e9c
Liang Wang
697832bd026bdf0473116e9d
Chuang Ding
697832bd026bdf0473116e9e
Shuai Wang
697832bd026bdf0473116e9f
Xie Chen
697832bd026bdf0473116ea0
Furu Wei
admin_assigned
2026-01-27T14:31:19.998Z
6368c512fbfe97c16a40baba
/avatars/1c23bc7c0b6d9225699ce27647623d7a.svg
Furu Wei
thegenerality
user
thegenerality
VIBEVOICE-ASR Technical Report
This report presents VibeVoice-ASR, a general-purpose speech understanding framework built upon VibeVoice, designed to address the persistent challenges of context fragmentation and multi-speaker complexity in long-form audio (e.g., meetings, podcasts) that remain despite recent advancements in short-form speech recognition. Unlike traditional pipelined approaches that rely on audio chunking, VibeVoice-ASRsupports single-pass processing for up to 60 minutes of audio. It unifies Automatic Speech Recognition, Speaker Diarization, and Timestamping into a single end-to-end generation task. In addition, VibeVoice-ASR supports over 50 languages, requires no explicit language setting, and natively handles code-switching within and across utterances. Furthermore, we introduce a prompt-based context injection mechanism that allows users to supply customized conetxt, significantly improving accuracy on domain-specific terminology and polyphonic character disambiguation.
VibeVoice-ASR is a unified end-to-end speech understanding framework that processes long-form audio in a single pass while supporting multilingual, code-switching, and domain-specific context injection.
speech understanding framework VibeVoice Automatic Speech Recognition Speaker Diarization Timestamping end-to-end generation long-form audio single-pass processing multilingual support code-switching prompt-based context injection