diff options
| author | historia <historiavg@proton.me> | 2026-08-18 23:29:16 -0400 |
|---|---|---|
| committer | historia <historiavg@proton.me> | 2026-08-18 23:29:16 -0400 |
| commit | a89daa1af05e2816f970d6a7b28a07df4f102f7d (patch) | |
| tree | c9d4810a6d7657b5635fa85a32284ef51850095d | |
| parent | f3e21980320c1708ff17cc6f699a9aa4758accdf (diff) | |
| download | tts-audiobook-generator-a89daa1af05e2816f970d6a7b28a07df4f102f7d.tar.gz | |
readme
| -rw-r--r-- | README.md | 4 |
1 files changed, 2 insertions, 2 deletions
@@ -85,7 +85,7 @@ python audiobook.py Change the voice settings in `converter/config.py`. -## Using the `--faster` backend +## Optional: Using the `--faster` backend Instead of the Qwen Gradio demos, `--faster` talks to the OpenAI-compatible server from [faster-qwen3-tts](https://github.com/andimarafioti/faster-qwen3-tts), which uses CUDA graph capture for roughly 5-10x faster inference with the same models. **It requires an NVIDIA GPU**. @@ -162,7 +162,7 @@ python audiobook.py --faster [--faster-voice NAME] Other options and defaults are configured in `converter/config.py` -## FlashAttention for qwen-tts-demo server (optional) +## Optional: FlashAttention for qwen-tts-demo server This is **not** used with the `--faster` backend. The Gradio server tries to use FlashAttention 2 by default, but requires `--no-flash-attn` without it. On supported GPUs FlashAttention can give a modest speedup. |