SyslogSolution/prose-contracts
7
0
Fork 0
Code Issues 2 Pull Requests Actions Packages Projects Releases Wiki Activity

Apply captain 2026-08-03 decisions: restore abiba-zulip, retire gpu-watchdog, PM2-track gpu-monitor

Browse Source
This commit is contained in:
root
2026-09-22 10:45:44 +00:00
parent 0732eed329
commit dd11c8f14f
1 changed files with 8 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files
pm2-self-heal.prose.md
+8 -6
View File
@@ -2,20 +2,22 @@
kind: responsibility kind: responsibility
name: pm2-self-heal name: pm2-self-heal
description: > description: >
PM2 process health check for abiba-telegram, abiba-zulip, gitea-runner, and zulip-watchdog. Monitors critical PM2 processes (abiba-zulip, abiba-telegram) and
gpu-monitor is systemd-managed (gpu-monitor.service), NOT PM2. auto-restarts any that are stopped or errored. Logs every action to
gpu-watchdog is decommissioned and folded into gpu-monitor.service. the knowledge graph and alerts the owner via Zulip DM on failures.
gitea-runner is KEPT. abiba-zulip is KEPT (online for days). Abiba-zulip is the live Zulip bridge and may be restarted; alert owner on failure.
--- ---
## Maintains ## Maintains
- abiba-telegram: { status: "online", uptime: string, restarts: number } - abiba-telegram: { status: "online", uptime: string, restarts: number }
- abiba-zulip: { status: "online", uptime: string, restarts: number } - abiba-zulip: { status: "online", uptime: string, restarts: number }
- gpu-monitor: { status: "online", uptime: string, restarts: number } (systemd-managed, PM2-tracked)
- gitea-runner: { status: "online", uptime: string, restarts: number } - gitea-runner: { status: "online", uptime: string, restarts: number }
- zulip-watchdog: { status: "online", uptime: string, restarts: number }
- last_check: timestamp - last_check: timestamp
> **Status (2026-08-03):** `abiba-zulip` fully restored — live Zulip bridge, heartbeating, monitored. `gpu-monitor` runs via systemd (stable); PM2 tracks it for status reporting only. `gpu-watchdog` retired from PM2.
## Continuity ## Continuity
@@ -40,7 +42,7 @@ description: >
crash-loop that never toggles status to "stopped"/"errored" (e.g. the 10k-restarts crash-loop that never toggles status to "stopped"/"errored" (e.g. the 10k-restarts
spoton incident). Alerts include the restart count. spoton incident). Alerts include the restart count.
- **AS-BUILT (2026-09-15)**: spoton-service was deleted with its app; the live PM2 set is - **AS-BUILT (2026-09-15)**: spoton-service was deleted with its app; the live PM2 set is
four processes (abiba-telegram, abiba-zulip, gitea-runner, zulip-watchdog). The spoton four processes (abiba-telegram, abiba-zulip, gitea-runner, gpu-monitor). The spoton
reference above is historical context for the crash-loop guard, not a live process. reference above is historical context for the crash-loop guard, not a live process.
- **Escalate**: Only when restarts > 30 — alerts to Zulip DM - **Escalate**: Only when restarts > 30 — alerts to Zulip DM
- **Historical fix**: Previous cycles were caused by abiba-zulip extension's - **Historical fix**: Previous cycles were caused by abiba-zulip extension's