Abiba
dc572889f8
contracts: sync to ground truth — ornith-1.0-35b→strix-moe, 256K all GPUs, real LiteLLM timeouts
...
Verified on ground 2026-07-16 against CT 116 litellm_config.yaml + GPU hosts:
- AMD host serves qwen3.6-35B-udq4 (LiteLLM alias strix-moe); ornith-1.0-35b does NOT exist
- All 3 GPUs at 256K ctx, parallel 2 (RTX 3090 was listed 128K/parallel 1)
- LiteLLM timeouts: qwen 300s, gemma 120s, strix 300s (were stale 90s/120s)
- Added LiteLLM model surface + key scoping to litellm-self-heal
- Patched health-check script path ref
Files: litellm-self-heal, litellm-health, gpu-fleet, gpu-self-heal,
zulip-adapter-lessons, abiba-zulip-restore, hermes-agent-baseline,
delegation-prose-contract, mumuni-delegation-prose-contract
2026-07-16 17:02:44 +00:00
root
053d30ce7c
feat: consolidate litellm-health into litellm-self-heal
...
- litellm-self-heal: merged health check as §Health Check section,
includes full architecture diagram (v4.0.0), GPU topology, timeout
tables, container list, and execution flow. Eliminates duplication
between the two contracts.
- litellm-health: marked DEPRECATED, retained for reference
- README.md: updated with consolidated contract, deprecation notice,
disk-gc-threat-response, and infrastructure-monitoring status
2026-07-09 06:01:48 +00:00
root
a2c5a14c74
fix: LiteLLM contracts — align with 2026-07-08 architecture changes
...
- litellm-health: v4.0.0 — Router removed from path (nginx→LiteLLM→GPU directly),
GPU engines corrected (Docker→systemd), timeouts updated (gemma 120s, qwen 90s),
Strix Halo: CPU→Vulkan, context sizes + parallel slots added
- litellm-self-heal: ornith context 262K→256K, Rule 7 marked DEPRECATED
(router not in path), GPU topology synced with gpu-fleet
- litellm-api-keys: reference gpu-fleet as source of truth for keys,
removed qwen3.6-35B-A3B from model list (never deployed)
2026-07-09 05:37:16 +00:00
Abiba
bb20637b32
fix: align contract name fields to filenames (litellm-health, infrastructure-monitoring)
...
- litellm-health: 'check-litellm-health' -> 'litellm-health'
- infrastructure-monitoring: 'deploy-monitoring-stack' -> 'infrastructure-monitoring'
Fixes 'prose run <filename>' mismatch. No external references broken.
2026-07-02 20:35:44 +00:00
root
aa55634571
feat: tighten contracts with GPU fleet topology, model routing, Strix Halo details
...
litellm-health: added GPU fleet topology table, model routing map,
3-tier GPU checks (reachability, VRAM, temp, test inference)
litellm-self-heal: added GPU fleet reference, rules for GPU
unreachable and model not responding
Infrastructure topology now fully documented:
- amdpve: Strix Halo CPU (35B, 16 threads, 262K ctx, llama-server)
- llm-gpu: RTX 3090 24GB (Dense tier)
- ocu-llm: RTX 5070 12GB (MoE + Light tiers)
2026-06-29 04:07:05 +00:00
root
584338fb60
feat: initial OpenProse contracts — LiteLLM health check + hello world
...
- litellm-health.prose.md: Verifies admin UI, API docs, OIDC auth, container
health, and aggregate health endpoint. Reusable by any Syslog agent.
- hello-world.prose.md: Simple example contract demonstrating OpenProse
function pattern with parameters, returns, and postconditions.
2026-06-26 14:40:22 +00:00
Abiba