VoXtream2: Full-stream TTS with dynamic speaking rate control
Full-stream text-to-speech (TTS) for interactive systems must start speaking with minimal delay while remaining controllable as text arrives incrementally. We present VoXtream2, a zero-shot full-stream TTS model with dynamic speaking-rate control that can be updated mid-utterance on the fly. VoXtream2 combines a distribution matching mechanism over duration states with classifier-free guidance across conditioning signals to improve controllability and synthesis quality. Prompt-text masking enables textless audio prompting, removing the need for prompt transcription. Across standard zero-shot benchmarks and a dedicated speaking-rate test set, VoXtream2 achieves competitive objective and subjective results against public baselines despite a smaller model and less training data. In full-stream mode, it runs 4 times faster than real time with 74 ms first-packet latency on a consumer GPU.
69b917ed6b3f36c249fbc630
Nikita Torgashov
claimed_verified
2026-03-17T17:34:38.343Z
65a149d6df9a2ca62096188b
https://cdn-avatars.huggingface.co/v1/production/uploads/65a149d6df9a2ca62096188b/K9GPaeJhqVwCPJmGbsqYz.jpeg
Nikita Torgashov
herimor
user
herimor
69b917ed6b3f36c249fbc631
Gustav Eje Henter
69b917ed6b3f36c249fbc632
Gabriel Skantze
VoXtream2: Full-stream TTS with dynamic speaking rate control
Full-stream text-to-speech (TTS) for interactive systems must start speaking with minimal delay while remaining controllable as text arrives incrementally. We present VoXtream2, a zero-shot full-stream TTS model with dynamic speaking-rate control that can be updated mid-utterance on the fly. VoXtream2 combines a distribution matching mechanism over duration states with classifier-free guidance across conditioning signals to improve controllability and synthesis quality. Prompt-text masking enables textless audio prompting, removing the need for prompt transcription. Across standard zero-shot benchmarks and a dedicated speaking-rate test set, VoXtream2 achieves competitive objective and subjective results against public baselines despite a smaller model and less training data. In full-stream mode, it runs 4 times faster than real time with 74 ms first-packet latency on a consumer GPU.