From e7a3d65f68659d17f37b79e8bfefea19d7ac0648 Mon Sep 17 00:00:00 2001 From: historia Date: Mon, 24 Aug 2026 14:13:06 -0400 Subject: feat: audio.cpp unloads model before converting --- app/docs/backend-audiocpp.md | 2 ++ 1 file changed, 2 insertions(+) (limited to 'app/docs') diff --git a/app/docs/backend-audiocpp.md b/app/docs/backend-audiocpp.md index c193e92..deb8fbe 100644 --- a/app/docs/backend-audiocpp.md +++ b/app/docs/backend-audiocpp.md @@ -91,3 +91,5 @@ python audiobook.py --backend audiocpp --model qwen-design \ ``` The hub also works with an audio.cpp server that runs somewhere else (another checkout, another machine) as long as it answers on the configured port: when there is no local `server.json`, the convert menus query the running server directly (`GET /v1/models` and `GET /v1/audio/voices`) instead of reading one. On the CLI, pass `--model`/`--voice` matching that server's config. + +Before converting, `audiobook.py` asks the server to unload all currently loaded models (`POST /v1/tasks/unload_all_models`) so models left resident by earlier runs free their memory (e.g. VRAM on GPU backends) and only the selected entry loads. A server without that endpoint, or one busy unloading, only produces a warning. -- cgit v1.2.3