diff options
| author | historia <historiavg@proton.me> | 2026-08-24 16:18:38 -0400 |
|---|---|---|
| committer | historia <historiavg@proton.me> | 2026-08-24 16:18:38 -0400 |
| commit | 919544c0931d53bb81904b6212ff14f856549da3 (patch) | |
| tree | aef7161db4cdb43bbd572fdc6c2fa2539726f4ee /app/docs | |
| parent | 1ff9a635bd9b033b631a6b525891b7eb44e189d3 (diff) | |
| download | tts-audiobook-generator-919544c0931d53bb81904b6212ff14f856549da3.tar.gz | |
feat: option to unload models from audio.cpp per-run
Diffstat (limited to 'app/docs')
| -rw-r--r-- | app/docs/backend-audiocpp.md | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/app/docs/backend-audiocpp.md b/app/docs/backend-audiocpp.md index aaeb5a5..5ce7f49 100644 --- a/app/docs/backend-audiocpp.md +++ b/app/docs/backend-audiocpp.md @@ -92,4 +92,4 @@ python audiobook.py --backend audiocpp --model qwen-design \ The hub also works with an audio.cpp server that runs somewhere else (another checkout, another machine): set `AUDIOCPP_REMOTE_URL` in `app/converter/config.py` (or the TUI **Settings** → "audio.cpp remote URL") to its `host:port`. The hub probes that URL and, when it answers, offers an `audio.cpp [remote]` entry in **Convert books…** whose models and voices are queried live (`GET /v1/models` and `GET /v1/audio/voices`) — alongside the managed `audio.cpp` entry, which keeps reading the local `server.json`. The remote URL defaults to `127.0.0.1:8080`, so a server started outside this tool on the local port is found automatically. On the CLI, pass `--api-url http://host:port` (and `--model`/`--voice` matching that server's config). -Before converting, `audiobook.py` asks the server to unload all currently loaded models (`POST /v1/tasks/unload_all_models`) so models left resident by earlier runs free their memory (e.g. VRAM on GPU backends) and only the selected entry loads. A server without that endpoint, or one busy unloading, only produces a warning. +Before converting, `audiobook.py` asks the server to unload all currently loaded models (`POST /v1/tasks/unload_all_models`) so models left resident by earlier runs free their memory (e.g. VRAM on GPU backends) and only the selected entry loads. A server without that endpoint, or one busy unloading, only produces a warning. This behavior is controlled by the **Settings** → "Unload models" option (or `AUDIOCPP_UNLOAD_MODELS` in `app/converter/config.py`), which defaults to **Yes**; set it to **No** to keep other models resident across runs. |
