89 Commits

Include renames

Author	SHA1	Message	Date
root	947e8b24e0	fix(zulip-monitor): stream alert body now carries real content, plain & params, WARN on delivery failure ... The #agent-hub / zulip-health stream post in notify() encoded content with python quote(str()) (always empty), so every stream alert posted empty content and Zulip rejected it silently behind '|| true'. The merged body also used backslash-escaped ampersands inside double quotes, which curl transmits literally (type=stream\ -> Zulip 400 'Invalid type'). Stream post now percent-encodes the real message text by piping it through the encoder (locale-proof: quote_from_bytes on stdin.buffer), uses plain & separators, and on failure appends one WARN line to the monitor log with the curl exit status instead of silently swallowing it. Delivery failure stays non-fatal and unretried. DM path, probes, alive rule, exit codes and log format unchanged.	2026-09-09 02:47:44 +00:00
abiba-bot	95b4a0e6b0	Merge pull request 'fix(agent-health-check): correct unit names, abiba key path, pid crash, uptime math (script-only)' (#65) from fm/agent-health-probe-repoint-20260907 into master	2026-09-09 01:39:29 +00:00
root	1b8186f6b9	no-mistakes(document): docs: reword Tanko .122 SSH dependency claims in zulip-health	2026-09-08 13:00:05 +00:00
root	4ac60e14a3	no-mistakes(review): fix zulip-monitor Tanko probe fallback-echo contamination in down detection	2026-09-08 12:38:45 +00:00
root	4684ee64e0	no-mistakes(review): Align zulip-monitor Tanko probe and B2/B3 criteria to dsh-web	2026-09-08 12:10:58 +00:00
root	af3d364242	no-mistakes(review): Bracket pgrep patterns to stop ssh wrapper self-match	2026-09-08 12:04:01 +00:00
root	2716e55c16	fix(agent-health): repoint .8 GPU unit, fix pid UnboundLocalError, source abiba key from env.sh ... - GPU unit repoint verified live 2026-09-08: .8 rtx3090 probes llama-chat-api.service (stale llama-server unit read inactive -> false UNREACHABLE for a healthy process); .110 keeps llama-server.service (ocu-llm VM), .15 keeps strix-server.service. is-active no longer swallowed as SSH failure (|| true). - check_agents: bind pid before the summary f-string so the non-report-only path (abiba/koonimo) no longer raises UnboundLocalError (line 305 crash). - abiba key leg: read LITELLM_API_KEY from /root/.pi/agent/env.sh (#735 moved creds out of shared /root/.bashrc); 'abiba NO KEY' gone on healthy setup.	2026-09-08 11:08:28 +00:00
mumuni-bot	0aa0ea4906	fix: restore agent-health-check AGENTS roster + land missed Tanko-DSH rows ... 2dfc3e1 (PR #50's out-of-band squash) overwrote agent-health-check.py with a version whose AGENTS dict was empty — the health check silently skipped every agent since. Restore the pre-stomp roster verbatim: tanko (runtime: dsh), abiba, koby, koonimo. Also land two Tanko-DSH rows from PR #52 that the earlier merge missed: - hermes-zulip-plugin live-state table (plugin retired on CT112) - zulip-self-heal restart-services table (restart via DSH service, not hermes gateway restart) Mumuni rows from the branch were NOT restored: they carry pre-migration CT100/.24 data, superseded by PRs #54-56 (Mumuni now on kagentz CT105/.14). Closes the reland of PR #52's substance; the stale branch head stays closed.	2026-09-07 07:31:34 +00:00
root	e8b9f990b2	Fix zulip-monitor.sh LOG variable scope bug ... Move LOG, TIMESTAMP, and ISSUES declarations from inside notify() to script scope so they are available throughout the script.	2026-08-30 12:24:06 +00:00
root	2dfc3e1530	Merged PR #50: fix/gpu-dense-docs	2026-08-30 12:16:39 +00:00
root	79af0ae7a3	Merged PR #52: fix/tanko-runtime	2026-08-30 12:16:28 +00:00
mumuni-bot	20fe5adcbc	fix: ship pm2-self-heal crash-loop guard + align gpu-dense docs to Qwen3.8-27B ... - pm2-self-heal.sh: restart abiba-telegram when TEL_RESTARTS > 1000 even if 'online' (catches quiet crash-loops like the 10k-restarts spoton incident); alert includes count. - pm2-self-heal.prose.md: document the crash-loop guard under Rule 2. - gpu-fleet.prose.md / gpu-self-heal.prose.md: gpu-dense is Qwen3.8-27B-Uncensored-Q4_K_M (~16.8GB, alias qwen3.6-27B-code for LiteLLM routing), not SmartCode-Fable-5 (verified live on .8:8080 Aug 16).	2026-08-17 02:32:52 +00:00
Agent Zero	19a67c6815	fix: align mumuni ct field to 100 in daily-infra-report.py	2026-08-15 20:12:09 -04:00
kagentz-bot	44f7008302	docs: reflect hwepve removal from Tabiri cluster (5 nodes + standalone London node) ... - Remove hwepve from cluster member lists/diagrams in infrastructure-control, proxmox-monitor, infrastructure-update, litellm-health, mumuni-delegation - CTs 100 (abiba) and 105 (kagentz) moved to minipve; CT 114 (mumuni) no longer exists (Mumuni runs inside Abiba CT 100) - Add standalone London role + NetBird routing peer description for hwepve - Update scripts: agent-health-check.py, pct-run.sh, prose-ai-review.sh - Update disk-gc CT access table, hermes baselines/restore host references	2026-08-15 20:03:02 -04:00
root	b3193e5e1b	fix(agent-health): 14 stale-reference fixes (Mumuni CT100/.24, Koby .129, Koonimo CT113, wrapper paths)	2026-08-01 14:10:52 +00:00
root	b56501a1cf	no-mistakes(review): Guard infisical-token fallback read against OSError crashes	2026-08-01 13:27:41 +00:00
root	1921937bee	fix(agent-health): vault token fallback + strix-server service name	2026-08-01 13:24:38 +00:00
root	7c0adefdeb	Merge PR #38: feat: add Level 0 auto-delete for heartbeat log orphans	2026-07-29 21:50:19 +00:00
root	3b6cf44a30	fix: update all Mumuni IP references from .123 to .24 (inside Abiba CT100) ... Mumuni CT114 destroyed. Mumuni now runs inside Abiba CT100 at 192.168.68.24. Updated all contract files and agent-health-check.py.	2026-07-28 08:56:45 +00:00
root	0f572ff9f2	fix: remove mumuni from health check — now inside Abiba CT 100	2026-07-26 12:37:07 +00:00
root	de9adb13cf	fix: agent health check v2 — CT liveness, config validation, wrapper integrity, vault emptiness ... Gaps fixed: - Koby (.129) and Koonimo (.114) now have SSH hosts — no longer skipped - Agent key lookup uses correct {NAME}_LITELLM_API_KEY format - New CT liveness check via pct status on PVE nodes - New config YAML integrity check via yaml.safe_load() - New wrapper/CLI integrity check (hermes wrapper, infisical path, hermes-real) - New vault secret non-emptiness check - Ops escalation: failures produce ALERT lines for cron capture	2026-07-26 12:06:32 +00:00
root	7d1db62a8e	no-mistakes(document): Fix stale CT placements across 5 docs matching infrastructure-control updates	2026-07-24 20:21:03 +00:00
root	9943be5e68	no-mistakes(test): Lint, shell syntax, and all 13 user-intent constraints pass on 3 changed files. One mode fix: netbird-add-domain.sh 644→755	2026-07-24 20:16:57 +00:00
root	b17c60f997	fix: contract accuracy updates post fleet-wide reboot ... infrastructure-control.prose.md: - Add hwepve as 6th Proxmox node - Fix Gitea IP: .17 (was .110) - Fix AdGuard IP: .10 on minipve (was .102 on acerpve) - Fix Abiba placement: hwepve (was amdpve) - Fix Mumuni placement: hwepve (was minipve) - Fix Authentik port: add :9000 - Add CT 118 (jdownloader), CT 119 (infisical-vault) - Add last-verified date (2026-07-24) infrastructure-update.prose.md: - Add post-reboot CT sweep procedure - Add Zulip Docker network recovery steps - Add WireGuard tunnel verification scripts/netbird-add-domain.sh: - New script to register domains in Netbird proxy store.db	2026-07-24 20:01:43 +00:00
root	17a77e6b3f	fix: fleet config issues from 2026-07-18 relay review ... - hermes-agent-baseline: add gpu-dense and gpu-light to models list - hermes-config-template: fix pgrep traps (exclude infisical wrapper) + add vault empty-key guard documentation in Rule 13 - litellm-api-keys: fix pgrep pattern in auditable check - scripts/agent-health-check: fix pgrep to exclude infisical bash wrapper Addresses issues found during relay inbox resolution session: 1. pgrep -f 'hermes_cli.main gateway run' matches both the real python gateway and the infisical bash wrapper, causing false health readings 2. infisical vault stores empty key silently — no guard/monitoring 3. gpu-dense/gpu-light stable aliases missing from baseline config	2026-07-18 17:39:46 +00:00
root	79d4a73895	docs: lessons learned from 2026-07-12 session ... - gpu-fleet: Corrected architecture (direct GPU, no router in path). Updated context values (RTX 3090=256K, not 128K). Added api-key standardization requirement. - gpu-self-heal: Added Lessons Learned section with 5 critical findings: L1: API key standardization (RTX 5070 sk-loc...5678 vs not-needed) L2: Fallback chain cascading failure loop detection L3: Verify running state, not documentation L4: Infisical fallback requirement (.env must have uncommented key) L5: Zulip event queue can silently die after ~40 reconnects - litellm-self-heal: Updated status manual-only→deployed, cron schedule - litellm-api-keys: Added Infisical token expiry warning + .env fallback - hermes-config-template: Rule 3 updated with .env fallback requirement	2026-07-12 22:49:39 +00:00
root	97977f320c	fix: contract improvements from 2026-07-09 run log review ... - pct-run.sh: add CT 109 note (KVM VM), document decommissioned/migrated CTs - disk-gc-threat-response: add docker-vm (SSH .7), add amdpve Docker scope, remove jitsi (decommissioned), update access matrix with KVM VM section - infrastructure-control: docker-vm container count 11→16, add Trove agents stack - infrastructure-monitoring: deployment status updated (core live, GPU exporters not deployed)	2026-07-09 05:32:00 +00:00
root	79855ea9e1	feat: consolidated agent health check — key validation + GPU port conflict + streaming ... Single non-disruptive script replacing 7 scattered Zulip health checks. Checks every 10 min via cron, never restarts anything: - LiteLLM key validation for all 4 Hermes agents - GPU port conflict / ghost process detection - Agent gateway liveness + Zulip streaming status - Recent gateway error count Port conflict detection added to all 3 GPU wrappers: - .8 (qwen): wrapper detects ghost on port 8080 before starting - .110 (gemma): same pattern - .15 (ornith): port-cleanup.sh replaces blanket pkill -x llama-server	2026-07-06 02:23:54 +00:00
root	5c90eb8f6c	rename: Koonimo→Baggy, Koby→Tdunna — match hostnames ... Standardize agent names across all contracts and pct-run.sh. No functional changes — same CT IDs, same keys, same nodes.	2026-07-05 20:04:22 +00:00
root	b65116b847	feat: pct-run.sh — run commands in CTs by ID, no IPs needed ... Adds /scripts/pct-run.sh that maps CT IDs to PVE nodes and runs pct exec directly. No hardcoded IPs — Proxmox is the source of truth. Updates infrastructure-control with CT access table using pct-run. Usage examples: pct-run 112 cat /etc/hostname # Tanko pct-run 114 grep LITELLM /etc/environment # Mumuni key check pct-run 116 docker ps # LiteLLM containers	2026-07-05 20:02:20 +00:00
root	9cf6304e23	fix: remove hardcoded LiteLLM defaults — rely on Gitea secrets	2026-07-04 23:33:34 +00:00
root	e59f59d776	fix: ai-review gracefully skips when LiteLLM secrets not configured	2026-07-04 23:30:25 +00:00
root	b3ab3a6850	fix: remove all Gitea expression syntax from ai-review script	2026-07-04 23:09:29 +00:00
root	105844cf7b	fix: ai-review script — handle Gitea env vars + push event diffs	2026-07-04 23:08:19 +00:00
root	57605c6f16	docs: add AGENTS.md + authorization enforcement gates ... NEW: AGENTS.md — complete agent workflow documentation - Step-by-step PR workflow for all agents - Authorization matrix (who can change which contracts) - Emergency bypass procedure - Quick start commands NEW: scripts/prose-auth-check.sh — authorization enforcement - Blocks unauthorized agents from changing CRITICAL contracts - infrastructure-control, proxmox-monitor: abiba only - hermes-config-template: abiba, mumuni, tanko - zulip-health: abiba, mumuni - All scripts: abiba only - Fails CI if unauthorized changes detected UPDATED: .gitea/workflows/pr-pipeline.yaml - Added Stage 0: auth check (runs first) - Added gate job that confirms all 4 checks passed - Expanded trigger paths to include scripts/*.sh UPDATED: branch protection — now requires 4 contexts: pr-pipeline / auth, validate, lint, ai-review	2026-07-04 22:25:05 +00:00
root	263c4080f3	ci: add automated PR validation pipeline + fix regressions ... NEW: Gitea Actions CI pipeline (.gitea/workflows/pr-pipeline.yaml) - Stage 1 (validate): YAML frontmatter validation for all .prose.md files - Stage 2 (lint): Structural checks + regression detection * /grafana/ nginx route (reverted 2026-07-02) * Stale CT IDs (122→112, no 123) * Verified: .19/.122/.123 = correct bridge IPs - Stage 3 (ai-review): LiteLLM-powered diff review against ground truth - Stage 4 (auto-merge): Gate — safe to merge when all green NEW: scripts/prose-lint.sh — contract structure + regression checker NEW: scripts/prose-ai-review.sh — AI review via syslog-auto model FIXES FOUND BY LINT: - gpu-fleet.prose.md: removed /grafana/ from nginx routing diagram - gpu-fleet.prose.md: removed /grafana/ from config file description - infrastructure-control.prose.md: CT 122→112 in topology diagram - scripts/prose-lint.sh: updated to not flag .19 (verified correct IP)	2026-07-04 22:13:51 +00:00
root	dd985f0e49	pm2-self-heal: migrate alerts from Zulip to Telegram ... - abiba-zulip PM2 process decommissioned (2026-07-04) - Replace Zulip stream alerts (agent-hub > alerts-pm2) with Telegram DM - Remove stale abiba-zulip monitoring block (process no longer exists) - Retain abiba-telegram auto-restart (critical — sole communication bridge) - Token sourced from extension .env, not hardcoded	2026-07-04 22:07:35 +00:00
Abiba	9101026a0d	chore: move pm2-self-heal.sh into scripts/ ... All companion scripts now live under scripts/ for a single, discoverable location.	2026-07-02 20:36:37 +00:00
root	90e074dbcc	feat(zulip-health): monitor script + infra report — cron-ready implementations of prose contracts	2026-06-27 19:22:53 +00:00