diff options
| -rw-r--r-- | README.md | 4 |
1 files changed, 2 insertions, 2 deletions
@@ -85,7 +85,7 @@ python audiobook.py Change the voice settings in `converter/config.py`. -## Using the `--faster` backend +## Optional: Using the `--faster` backend Instead of the Qwen Gradio demos, `--faster` talks to the OpenAI-compatible server from [faster-qwen3-tts](https://github.com/andimarafioti/faster-qwen3-tts), which uses CUDA graph capture for roughly 5-10x faster inference with the same models. **It requires an NVIDIA GPU**. @@ -162,7 +162,7 @@ python audiobook.py --faster [--faster-voice NAME] Other options and defaults are configured in `converter/config.py` -## FlashAttention for qwen-tts-demo server (optional) +## Optional: FlashAttention for qwen-tts-demo server This is **not** used with the `--faster` backend. The Gradio server tries to use FlashAttention 2 by default, but requires `--no-flash-attn` without it. On supported GPUs FlashAttention can give a modest speedup. |