How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-to-speech", model="mlx-community/VibeVoice-Realtime-0.5B-8bit")
# pip install -U transformers accelerate
# Load model directly
from transformers import VibeVoiceStreamingForConditionalGenerationInference
model = VibeVoiceStreamingForConditionalGenerationInference.from_pretrained("mlx-community/VibeVoice-Realtime-0.5B-8bit", device_map="auto")
Quick Links

mlx-community/VibeVoice-Realtime-0.5B-8bit

This model was converted to MLX format from microsoft/VibeVoice-Realtime-0.5B using mlx-audio version 0.2.6. Refer to the original model card for more details on the model.

Use with mlx

pip install -U mlx-audio
python -m mlx_audio.tts.generate --model mlx-community/VibeVoice-Realtime-0.5B-8bit --text "Hello, this is VibeVoice real-time 0.5B model." --voice en-Emma_woman
Downloads last month
285
Safetensors
Model size
1B params
Tensor type
F16
ยท
U32
ยท
MLX
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for mlx-community/VibeVoice-Realtime-0.5B-8bit

Quantized
(118)
this model

Collection including mlx-community/VibeVoice-Realtime-0.5B-8bit