aboutsummaryrefslogtreecommitdiff

faster-qwen3-tts (--backend faster)

Runs the OpenAI-compatible demo server from faster-qwen3-tts. The package installs into its own managed venv (app/envs/faster), the repo is cloned to app/faster-qwen3-tts.

Run all commands from the project root (next to audiobook.py).

Requirements

  • NVIDIA GPU
  • git

Install

  1. Venv and package:
python3 -m venv app/envs/faster
app/envs/faster/bin/pip install "faster-qwen3-tts[demo]"

Do not install upstream qwen-tts into this venv — the two ship conflicting qwen_tts modules.

  1. Clone the repo (the pip package does not include the server script):
git clone https://github.com/andimarafioti/faster-qwen3-tts app/faster-qwen3-tts
  1. Create a voices.json mapping voice names to reference clips:
{
    "default": {"ref_audio": "voice1.wav", "ref_text": "Transcript of voice 1.", "language": "English"},
    "obama": {"ref_audio": "voice2.wav", "ref_text": "Transcript of voice 2.", "language": "English"}
}

This backend always clones: every voice is a key in this file, and ref_text is the transcript of the clip.

Run the server

app/envs/faster/bin/python app/faster-qwen3-tts/examples/openai_server.py --voices voices.json --port 8000

Use it

python audiobook.py --backend faster --api-url http://127.0.0.1:8000 --voice default

--voice must be a key in the server’s voices.json.