aboutsummaryrefslogtreecommitdiff
path: root/app/docs/backend-sglomni.md
AgeCommit message (Expand)Author
6 daysfix: increase gpu memory for MOSS with gplang-omni to .87historia
6 daysfeat: gplang-omni reserves 70% of gpu 0 memory, preventing oom errors on cons...historia
6 daysfix: warn before using a likely too-big chunk size for sglang-omni modelshistoria
7 daysfeat: reserve 20% vram when running higgs with sglang-omnihistoria
7 daysfeat: sglang-omni model picker on manual server launchhistoria
7 daysfix: ZONOS2 only generating 1024 tokens maxhistoria
7 daysfeat: sglang backend supporthistoria