Abiba Bot c0be4c1699 router: reference - new 5-tier routing with vision guard (deployed CT116) ...

Vision guard: multimodal -> VLM only
TIER 1 Tiny: VLM->Dense->MoE
TIER 2 Light: Dense->VLM->MoE
TIER 3 Medium: MoE->Dense->VLM
TIER 4 Heavy: MoE->Dense->VLM
TIER 5 Default: MoE->Dense->VLM
Hints: speed->VLM, quality->MoE, code->Dense

2026-06-05 23:32:27 +00:00

..

Dockerfile

Initial commit: CT 116 inference harness — nginx, LiteLLM, router, dashboard, Redis

2026-05-16 18:51:50 +00:00

requirements.txt

Initial commit: CT 116 inference harness — nginx, LiteLLM, router, dashboard, Redis

2026-05-16 18:51:50 +00:00

route_v2.py

router: reference - new 5-tier routing with vision guard (deployed CT116)

2026-06-05 23:32:27 +00:00

router.py

router: fix Dense context window 98K→262K (matches actual n_ctx)

2026-06-05 23:15:18 +00:00