FlashLabs Chroma 1.0: A Real-Time End-to-End Spoken Dialogue Model with Personalized Voice Cloning
Recent end-to-end spoken dialogue systems leverage speech tokenizers and neural audio codecs to enable LLMs to operate directly on discrete speech representations. However, these models often exhibit limited speaker identity preservation, hindering personalized voice interaction. In this work, we present Chroma 1.0, the first open-source, real-time, end-to-end spoken dialogue model that achieves both low-latency interaction and high-fidelity personalized voice cloning. Chroma achieves sub-second end-to-end latency through an interleaved text-audio token schedule (1:2) that supports streaming generation, while maintaining high-quality personalized voice synthesis across multi-turn conversations. Our experimental results demonstrate that Chroma achieves a 10.96% relative improvement in speaker similarity over the human baseline, with a Real-Time Factor (RTF) of 0.43, while maintaining strong reasoning and dialogue capabilities. Our code and models are publicly available at https://github.com/FlashLabs-AI-Corp/FlashLabs-Chroma and https://huggingface.co/FlashLabs/Chroma-4B .
696d91063f1837bfb8970953
Tanyu Chen
claimed_verified
2026-01-21T09:24:09.590Z
65224256377bffdc599901c9
https://cdn-avatars.huggingface.co/v1/production/uploads/65224256377bffdc599901c9/xUM64_ugWwt4NO1F6DOcc.jpeg
chentanyu
sailorjs0804
user
sailorjs0804
696d91063f1837bfb8970954
Tairan Chen
claimed_verified
2026-01-21T12:54:02.586Z
655dc83ca499c26280ae26cb
https://cdn-avatars.huggingface.co/v1/production/uploads/655dc83ca499c26280ae26cb/NSDMlsuLbTKkT4U_TovGE.jpeg
Terrence
terrencecchen
user
terrencecchen
696d91063f1837bfb8970955
Kai Shen
claimed_verified
2026-01-20T09:41:12.758Z
68b941018936c20ec712b011
https://cdn-avatars.huggingface.co/v1/production/uploads/68b941018936c20ec712b011/8dvgJn1ROXISOZo8NUsi1.jpeg
shenkai
FakerVSdonk
user
FakerVSdonk
696d91063f1837bfb8970956
Zhenghua Bao
claimed_verified
2026-01-21T09:24:01.839Z
679caa50208bfa0539ca05c8
/avatars/5e9d76169dbcd8c414d8cddaa2029c0a.svg
Zhenghua Bao
KingZ23
user
KingZ23
696d91063f1837bfb8970957
Zhihui Zhang
696d91063f1837bfb8970958
Man Yuan
696d91063f1837bfb8970959
Yi Shi
claimed_verified
2026-01-22T08:47:32.091Z
696de1a7ca820bff80b8977d
https://cdn-avatars.huggingface.co/v1/production/uploads/696de1a7ca820bff80b8977d/0-IeLu9q-oz2ePK7sMfE6.jpeg
Yi Shi
hugging-yiii
user
hugging-yiii
FlashLabs Chroma 1.0: A Real-Time End-to-End Spoken Dialogue Model with Personalized Voice Cloning
Recent end-to-end spoken dialogue systems leverage speech tokenizers and neural audio codecs to enable LLMs to operate directly on discrete speech representations. However, these models often exhibit limited speaker identity preservation, hindering personalized voice interaction. In this work, we present Chroma 1.0, the first open-source, real-time, end-to-end spoken dialogue model that achieves both low-latency interaction and high-fidelity personalized voice cloning. Chroma achieves sub-second end-to-end latency through an interleaved text-audio token schedule (1:2) that supports streaming generation, while maintaining high-quality personalized voice synthesis across multi-turn conversations. Our experimental results demonstrate that Chroma achieves a 10.96% relative improvement in speaker similarity over the human baseline, with a Real-Time Factor (RTF) of 0.43, while maintaining strong reasoning and dialogue capabilities. Our code and models are publicly available at https://github.com/FlashLabs-AI-Corp/FlashLabs-Chroma and https://huggingface.co/FlashLabs/Chroma-4B .
Chroma 1.0 enables real-time spoken dialogue with personalized voice cloning through discrete speech representations and interleaved text-audio token scheduling.
speech tokenizers neural audio codecs LLMs end-to-end spoken dialogue systems voice cloning real-time interaction discrete speech representations interleaved text-audio token schedule streaming generation speaker identity preservation