From 6804c785c6b506c47b45264398728d0a609310be Mon Sep 17 00:00:00 2001 From: historia Date: Wed, 2 Sep 2026 19:13:24 -0400 Subject: feat: sglang-omni model picker on manual server launch --- app/docs/backend-qwen.md | 2 +- app/docs/backend-sglomni.md | 7 +++++++ 2 files changed, 8 insertions(+), 1 deletion(-) (limited to 'app/docs') diff --git a/app/docs/backend-qwen.md b/app/docs/backend-qwen.md index cb01561..31af47c 100644 --- a/app/docs/backend-qwen.md +++ b/app/docs/backend-qwen.md @@ -1,6 +1,6 @@ # Backend Option 2: Qwen3-TTS -The easiest way is to run `python audiobook.py` → **Configure Backends… → Install Backend → qwen-tts** (or `python app/backends/qwen.py`): the TUI pip-installs `qwen-tts` into its own managed venv (`app/envs/qwen`, separate from the app's venv and from the faster backend's — the two TTS stacks ship conflicting versions of a shared `qwen_tts` module) — that's all there is to it, the install asks no questions. The demo port lives in `app/converter/config.py` (edit it in the hub's **Settings** screen). The qwen backend runs **one model at a time** on that single port: pick Base, CustomVoice or VoiceDesign per run on the **Generate Audiobooks** screen (switching models while a managed server is up restarts it with the newly-selected model; an autostart boots exactly the model the run picked). You can also start the server from the hub's **Start/Stop Backend Servers** menu (a fresh start runs CustomVoice), or let a conversion start it automatically. +The easiest way is to run `python audiobook.py` → **Configure Backends… → Install Backend → qwen-tts** (or `python app/backends/qwen.py`): the TUI pip-installs `qwen-tts` into its own managed venv (`app/envs/qwen`, separate from the app's venv and from the faster backend's — the two TTS stacks ship conflicting versions of a shared `qwen_tts` module) — that's all there is to it, the install asks no questions. The demo port lives in `app/converter/config.py` (edit it in the hub's **Settings** screen). The qwen backend runs **one model at a time** on that single port: pick Base, CustomVoice or VoiceDesign per run on the **Generate Audiobooks** screen (switching models while a managed server is up restarts it with the newly-selected model; an autostart boots exactly the model the run picked). You can also start the server from the hub's **Start/Stop Backend Servers** menu (a fresh start asks which of CustomVoice, Base or VoiceDesign to load; stopping never asks), or let a conversion start it automatically. If you prefer to install the backend yourself (in your own environment, not the managed venv), the manual steps are below. Either way the hub detects a running server by its port (its `GET /info` names which of the three demos answers), so a manually-installed backend works once its server is up. To use a demo server on another machine, set `QWEN_REMOTE_URL` in `app/converter/config.py` to its `host:port` (default `127.0.0.1:7860`) — the hub probes it and offers the matching `qwen-tts [remote]` mode limited to the model that server hosts — or pass `--api-url` on the CLI. diff --git a/app/docs/backend-sglomni.md b/app/docs/backend-sglomni.md index 2aac93e..bf7d3a9 100644 --- a/app/docs/backend-sglomni.md +++ b/app/docs/backend-sglomni.md @@ -118,6 +118,13 @@ hosts one model, a run whose selected model differs from the hosted one restarts a server this tool started — a foreign server hosting another model refuses the run with an actionable message instead. +The hub's **Start/Stop Backend Servers** menu asks which *downloaded* model +to load when starting the server fresh (with none downloaded the entry says +so and points at the Configure screen; a single model starts without +asking). A start also auto-installs a model's missing companion packages +first, so a boot never dies on their import even when the weights arrived +via the shared HuggingFace cache or an earlier install's pip run failed. + The server boots a multi-stage pipeline (preprocessing → TTS generation → vocoder) and may pull companion weights on first start, so its start timeout is larger than the other backends' (20 minutes). Pre-downloading -- cgit v1.2.3