Instructions to use prithivMLmods/drama-3-TTS-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use prithivMLmods/drama-3-TTS-GGUF with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-to-speech", model="prithivMLmods/drama-3-TTS-GGUF")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("prithivMLmods/drama-3-TTS-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use prithivMLmods/drama-3-TTS-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf prithivMLmods/drama-3-TTS-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf prithivMLmods/drama-3-TTS-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf prithivMLmods/drama-3-TTS-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf prithivMLmods/drama-3-TTS-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf prithivMLmods/drama-3-TTS-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf prithivMLmods/drama-3-TTS-GGUF:Q4_K_M
Use Docker
docker model run hf.co/prithivMLmods/drama-3-TTS-GGUF:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use prithivMLmods/drama-3-TTS-GGUF with Ollama:
ollama run hf.co/prithivMLmods/drama-3-TTS-GGUF:Q4_K_M
- Unsloth Desktop
- Pi
How to use prithivMLmods/drama-3-TTS-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf prithivMLmods/drama-3-TTS-GGUF:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "prithivMLmods/drama-3-TTS-GGUF:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use prithivMLmods/drama-3-TTS-GGUF with Docker Model Runner:
docker model run hf.co/prithivMLmods/drama-3-TTS-GGUF:Q4_K_M
- Lemonade
How to use prithivMLmods/drama-3-TTS-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull prithivMLmods/drama-3-TTS-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.drama-3-TTS-GGUF-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use prithivMLmods/drama-3-TTS-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf prithivMLmods/drama-3-TTS-GGUF:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default prithivMLmods/drama-3-TTS-GGUF:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use prithivMLmods/drama-3-TTS-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf prithivMLmods/drama-3-TTS-GGUF:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "prithivMLmods/drama-3-TTS-GGUF:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
drama-3-TTS-GGUF
Fish Audio Drama 3 is Fish Audio's new-generation text-to-speech model, built for multi-character scenes and long-form content. It supports multi-speaker generation (up to 16 characters via
<|speaker:0|>…<|speaker:15|>tags), voice cloning from a short reference clip, and natural-language control, including inline point tags such as[sighs]and[laughs]. It also supports editing by continuation: you pass earlier takes as context and change only a few words. The model has 35B parameters with about 3B active per token. It uses a mixture-of-experts text backbone with hybrid full and linear attention, FP8 experts, and a codebook-MTP audio decoder over 10 codebooks. It covers roughly 80 languages, and long text is automatically chunked and can be streamed. It runs on SGLang-Omni and vLLM-Omni. On a single H200, a single stream gets first audio in under 100 ms with a real-time factor of about 0.13, and throughput reaches about 1,687 frames/s at 64 concurrent streams. Placing the vocoder on a second GPU raises throughput by about 72% and lowers median time to first audio by about 37% at 256 streams. The model is released under the Fish Audio research/community license.
Drama-3 TTS (Fish Audio) is now supported in the mainline llama.cpp release, v1.0.0.
Model Files
| File Name | Quant Type | File Size | File Link | Description |
|---|---|---|---|---|
| drama-3.MXFP4_MOE.gguf | MXFP4_MOE | 19.8 GB | Link | MXFP4_MOE: Highly optimized for NVIDIA Blackwell hardware accelerators (e.g., RTX Pro 6000, RTX 50-series, B200, B300), offering native hardware-accelerated FP4 Tensor Core speeds and a strong balance of size and performance. |
| drama-3.Q3_K_L.gguf | Q3_K_L | 18.1 GB | Link | Lower quality but usable, good for low RAM availability. |
| drama-3.Q3_K_M.gguf | Q3_K_M | 16.8 GB | Link | Low quality, smallest file size. |
| drama-3.Q4_K_M.gguf | Q4_K_M | 21.2 GB | Link | Good quality, default size for most use cases, recommended. |
| drama-3.Q5_K_M.gguf | Q5_K_M | 24.7 GB | Link | High quality, recommended. |
| drama-3.Q5_K_S.gguf | Q5_K_S | 24 GB | Link | High quality with slight space savings, recommended. |
| drama-3.Q6_K.gguf | Q6_K | 28.5 GB | Link | Very high quality, near perfect, recommended. |
| drama-3.mmproj-bf16.gguf | mmproj-bf16 | 2.94 GB | Link | Multimodal projection file in BF16 format. Used for audio/TTS capabilities. |
Run with llama.cpp (MXFP4 MoE)
Install dependencies and clone llama.cpp
!pip install huggingface-hub
!git clone https://github.com/ggml-org/llama.cpp.git
%cd /data/llama.cpp
Download GGUF model files
Download the MXFP4 MoE model and BF16 multimodal projector:
from huggingface_hub import snapshot_download
# Target local directory
local_dir = "./model/drama-3-TTS-GGUF"
# Download only the specified files
snapshot_download(
repo_id="prithivMLmods/drama-3-TTS-GGUF",
local_dir=local_dir,
allow_patterns=[
"drama-3.MXFP4_MOE.gguf",
"drama-3.mmproj-bf16.gguf",
],
resume_download=True,
)
Build llama-tts
Build the TTS CLI with the CUDA backend enabled:
!cmake --build . --config Release -j$(nproc) --target llama-tts
Text-to-speech generation (GPU offloading)
Run inference using llama-tts with GPU offloading enabled:
!/data/llama.cpp/build/bin/llama-tts \
-m /data/llama.cpp/model/drama-3-TTS-GGUF/drama-3.MXFP4_MOE.gguf \
-mm /data/llama.cpp/model/drama-3-TTS-GGUF/drama-3.mmproj-bf16.gguf \
-p "<|speaker:0|> Did you remember to buy the bread? <|speaker:1|> Of course I did, it is on the kitchen table." \
-ngl 99 \
-n 1000 \
--seed 42 \
--output /data/llama.cpp/model/drama-3-TTS-GGUF/out.wav
Output
The generated audio file will be saved at:
/data/llama.cpp/model/drama-3-TTS-GGUF/out.wav
You can play the generated WAV file using an audio player or notebook audio widget.
llama.cpp
LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp
Quantized using llama.cpp(v1.0.0) by prithivMLmods.
- Downloads last month
- 874
3-bit
4-bit
5-bit
6-bit
Model tree for prithivMLmods/drama-3-TTS-GGUF
Base model
fishaudio/drama-3