root
a2c5a14c74
fix: LiteLLM contracts — align with 2026-07-08 architecture changes
...
- litellm-health: v4.0.0 — Router removed from path (nginx→LiteLLM→GPU directly),
GPU engines corrected (Docker→systemd), timeouts updated (gemma 120s, qwen 90s),
Strix Halo: CPU→Vulkan, context sizes + parallel slots added
- litellm-self-heal: ornith context 262K→256K, Rule 7 marked DEPRECATED
(router not in path), GPU topology synced with gpu-fleet
- litellm-api-keys: reference gpu-fleet as source of truth for keys,
removed qwen3.6-35B-A3B from model list (never deployed)
2026-07-09 05:37:16 +00:00
Abiba
bb20637b32
fix: align contract name fields to filenames (litellm-health, infrastructure-monitoring)
...
- litellm-health: 'check-litellm-health' -> 'litellm-health'
- infrastructure-monitoring: 'deploy-monitoring-stack' -> 'infrastructure-monitoring'
Fixes 'prose run <filename>' mismatch. No external references broken.
2026-07-02 20:35:44 +00:00
root
aa55634571
feat: tighten contracts with GPU fleet topology, model routing, Strix Halo details
...
litellm-health: added GPU fleet topology table, model routing map,
3-tier GPU checks (reachability, VRAM, temp, test inference)
litellm-self-heal: added GPU fleet reference, rules for GPU
unreachable and model not responding
Infrastructure topology now fully documented:
- amdpve: Strix Halo CPU (35B, 16 threads, 262K ctx, llama-server)
- llm-gpu: RTX 3090 24GB (Dense tier)
- ocu-llm: RTX 5070 12GB (MoE + Light tiers)
2026-06-29 04:07:05 +00:00
root
584338fb60
feat: initial OpenProse contracts — LiteLLM health check + hello world
...
- litellm-health.prose.md: Verifies admin UI, API docs, OIDC auth, container
health, and aggregate health endpoint. Reusable by any Syslog agent.
- hello-world.prose.md: Simple example contract demonstrating OpenProse
function pattern with parameters, returns, and postconditions.
2026-06-26 14:40:22 +00:00