Abiba 15c474aea0 fix: select_best_gpu respects candidate order — first non-busy wins ...

Previously it picked the least-loaded GPU globally, ignoring priority order.
Now it tries candidates in order: MoE → VLM → Dense. Only falls back to
least-loaded when ALL candidates are busy.

2026-05-19 18:18:00 +00:00

..

Dockerfile

Initial commit: CT 116 inference harness — nginx, LiteLLM, router, dashboard, Redis

2026-05-16 18:51:50 +00:00

requirements.txt

Initial commit: CT 116 inference harness — nginx, LiteLLM, router, dashboard, Redis

2026-05-16 18:51:50 +00:00

router.py

fix: select_best_gpu respects candidate order — first non-busy wins

2026-05-19 18:18:00 +00:00