root
a07ff2d96a
prose: align all contracts with Vulkan rebuild + Koby key regen
...
- gpu-fleet: Koby key updated (sk-lDTsWy7H3T...), config table (ornith service
+ masked services), benchmarks (prompt 209→532 tok/s), ROCm→Vulkan status
- gpu-monitor: topology (sidecars :8090 removed, .15 via router), subsystem
polling (router /health/unified as source of truth), execution steps,
alert threshold (sidecar-unreachable downgraded from critical)
2026-07-02 00:29:10 +00:00
root
49e8d968f5
gpu-fleet: Strix Halo Vulkan rebuild + LiteLLM alignment (2026-07-01)
...
- ornith now on Vulkan build 4fc4ec5, 256K ctx, ~70 tok/s
- Fixed GPU_MOE_URL bug in docker-compose (.110→.15)
- Added router sidecar fallback for health-checks
- Updated roster context 4096→262144 + correct model_path
- Documented port 8080 firewall (restricted to .116)
2026-07-02 00:01:56 +00:00
root
38d2f7d956
feat: update contracts with GPU optimizations, Strix Halo/ROCm status, alert migration
...
- gpu-fleet: documented parallel=2/batch=4096 optimizations for RTX 3090/5070
- gpu-fleet: added Strix Halo ROCm status (installed, blocked by HSA runtime on Debian 13)
- gpu-fleet: documented alert migration from DM → #agent-hub stream topics
- gpu-monitor: added Alert Delivery section with stream topic conventions
- All GPU alerts now go to #agent-hub for cross-agent visibility
2026-07-01 22:25:26 +00:00
root
76fc2595ea
feat(gpu-fleet): GPU fleet management prose contract
...
Declarative GPU roster replaces hardcoded router.py model configs.
Operations: add-model, remove-model, heal, sync-keys, list.
Documents agent key architecture with LITELLM_API_KEY env var.
Covers all 3 GPU hosts (RTX 5070, RTX 3090, Strix Halo).
2026-06-28 16:24:40 +00:00