aboutsummaryrefslogtreecommitdiff
path: root/app/tests/test_backends_sglomni.py
AgeCommit message (Expand)Author
7 daysfix: increase gpu memory for MOSS with gplang-omni to .87historia
7 daysfeat: gplang-omni reserves 70% of gpu 0 memory, preventing oom errors on cons...historia
7 daysfix: warn before using a likely too-big chunk size for sglang-omni modelshistoria
7 daysfeat: reserve 20% vram when running higgs with sglang-omnihistoria
7 daysfeat: sglang-omni model picker on manual server launchhistoria
8 daysfeat: sglang backend supporthistoria