Abiba Bot
39cf297a8f
Phase 0: Dual-key router — no hardcoded keys, gemma sync, 262K context fix
...
- Removed all hardcoded API_KEYS from source (env var now REQUIRED)
- Added dual-key transition support (old keys deprecated, logged)
- Model sync: qwen3.5-9b-vlm → gemma-4-12b everywhere
- Dense context: 131K → 262K (all 3 models at 262K)
- Added /admin/keys endpoints for key lifecycle management
- Added ADMIN_KEY env var for admin auth
- Dashboard already synced to gemma-4-12b labels
Deployment: set API_KEYS from phase0-dual-keys.json in docker-compose
Transition: 7 days dual-key, then POST /admin/keys/revoke
2026-06-06 00:51:29 +00:00
Abiba Bot
1e24bc3b9b
docs: update model table with context windows, capabilities, GPU labels
2026-06-05 23:49:03 +00:00
Abiba Bot
e6a6c30211
router: v3 — 5-tier routing with vision guard, MoE spillover, code hint
...
GUARD: multimodal -> VLM only
TIER 1 Tiny: VLM->Dense->MoE
TIER 2 Light: VLM->Dense->MoE
TIER 3 Medium: MoE<->Dense (40% spill)->VLM
TIER 4 Heavy: Dense->MoE->VLM (quality first)
TIER 5 Default: MoE<->Dense (40% spill)->VLM
HINTS: speed->VLM, quality->MoE, code->Dense
+ moe_spillover(): 60/40 MoE/Dense load distribution
2026-06-05 23:48:45 +00:00
Abiba Bot
c0be4c1699
router: reference - new 5-tier routing with vision guard (deployed CT116)
...
Vision guard: multimodal -> VLM only
TIER 1 Tiny: VLM->Dense->MoE
TIER 2 Light: Dense->VLM->MoE
TIER 3 Medium: MoE->Dense->VLM
TIER 4 Heavy: MoE->Dense->VLM
TIER 5 Default: MoE->Dense->VLM
Hints: speed->VLM, quality->MoE, code->Dense
2026-06-05 23:32:27 +00:00
Abiba Bot
424d943b12
router: fix Dense context window 98K→262K (matches actual n_ctx)
2026-06-05 23:15:18 +00:00
Abiba Bot
b6abd84062
dashboard: rename VLM GPU label 'New Backend' → 'RTX 5070' for consistency
2026-06-05 21:53:07 +00:00
Abiba Bot
dace488f93
VLM migration: qwen3.5-9b-vlm → gemma-4-12b across entire harness
...
- router/router.py: model ID, context window (131K→262K), VRAM comment
- litellm_config.yaml: model name updated
- gpu-router.conf, gpu-router-docker.conf: pool names, comments
- dashboard/dashboard.py: MODELS array refactor for single-point config
- README.md: architecture diagram, model table
2026-06-05 21:37:18 +00:00
Abiba Bot
370f5546dd
dashboard: migrate VLM model qwen3.5-9b-vlm → gemma-4-12b (new backend 192.168.68.110:8080/v1)
2026-06-05 21:26:51 +00:00
mumuni-bot
b65ea22765
Update Nginx Docker config
2026-05-15 21:35:13 +00:00
mumuni-bot
cf7f61650f
Add Dockerfile.dashboard
2026-05-15 21:34:52 +00:00
mumuni-bot
7d00bbec0e
Add Dockerfile.queue
2026-05-15 21:34:49 +00:00
mumuni-bot
37f7c95b05
Add env example
2026-05-15 21:07:34 +00:00
mumuni-bot
a28b3a557d
Add Nginx router config
2026-05-15 21:07:33 +00:00
mumuni-bot
c42f3a9979
Add migration plan
2026-05-15 21:07:32 +00:00
mumuni-bot
e1f12c3462
Add dashboard
2026-05-15 21:07:07 +00:00
mumuni-bot
b55b954967
Add queue service
2026-05-15 21:07:05 +00:00
mumuni-bot
c85aaa570b
Add docker-compose
2026-05-15 21:07:05 +00:00
mumuni-bot
43382dac5b
Initial commit: README
2026-05-15 21:07:03 +00:00
Abiba Bot
mumuni-bot