From dd11c8f14f47f8e4e65fbad5cdd6c7dbe4ea81ea Mon Sep 17 00:00:00 2001 From: root Date: Tue, 22 Sep 2026 10:45:44 +0000 Subject: [PATCH] Apply captain 2026-08-03 decisions: restore abiba-zulip, retire gpu-watchdog, PM2-track gpu-monitor --- pm2-self-heal.prose.md | 14 ++++++++------ 1 file changed, 8 insertions(+), 6 deletions(-) diff --git a/pm2-self-heal.prose.md b/pm2-self-heal.prose.md index 77abbd0..9049992 100644 --- a/pm2-self-heal.prose.md +++ b/pm2-self-heal.prose.md @@ -2,20 +2,22 @@ kind: responsibility name: pm2-self-heal description: > - PM2 process health check for abiba-telegram, abiba-zulip, gitea-runner, and zulip-watchdog. - gpu-monitor is systemd-managed (gpu-monitor.service), NOT PM2. - gpu-watchdog is decommissioned and folded into gpu-monitor.service. - gitea-runner is KEPT. abiba-zulip is KEPT (online for days). + Monitors critical PM2 processes (abiba-zulip, abiba-telegram) and + auto-restarts any that are stopped or errored. Logs every action to + the knowledge graph and alerts the owner via Zulip DM on failures. + Abiba-zulip is the live Zulip bridge and may be restarted; alert owner on failure. --- ## Maintains - abiba-telegram: { status: "online", uptime: string, restarts: number } - abiba-zulip: { status: "online", uptime: string, restarts: number } +- gpu-monitor: { status: "online", uptime: string, restarts: number } (systemd-managed, PM2-tracked) - gitea-runner: { status: "online", uptime: string, restarts: number } -- zulip-watchdog: { status: "online", uptime: string, restarts: number } - last_check: timestamp +> **Status (2026-08-03):** `abiba-zulip` fully restored — live Zulip bridge, heartbeating, monitored. `gpu-monitor` runs via systemd (stable); PM2 tracks it for status reporting only. `gpu-watchdog` retired from PM2. + ## Continuity @@ -40,7 +42,7 @@ description: > crash-loop that never toggles status to "stopped"/"errored" (e.g. the 10k-restarts spoton incident). Alerts include the restart count. - **AS-BUILT (2026-09-15)**: spoton-service was deleted with its app; the live PM2 set is - four processes (abiba-telegram, abiba-zulip, gitea-runner, zulip-watchdog). The spoton + four processes (abiba-telegram, abiba-zulip, gitea-runner, gpu-monitor). The spoton reference above is historical context for the crash-loop guard, not a live process. - **Escalate**: Only when restarts > 30 — alerts to Zulip DM - **Historical fix**: Previous cycles were caused by abiba-zulip extension's