provision: register okyeame-memory-audit cron job id (kagentz 2026-09-08)

2026-09-08 16:22:51 +00:00
5 changed files with 13 additions and 84 deletions
@@ -1155,7 +1155,7 @@ contracts:
    type: scheduled
    cadence: 0 3 * * *
    description: Daily at 3am ET
-    cron_job_id: null
+    cron_job_id: b59f3cc21f4c  # provisioned on kagentz 2026-09-08 (okyeame-memory-audit, glm-5.3-flash)
  execution:
    agent: mumuni
    timeout: 600
@@ -97,28 +97,7 @@ This replaces the previous DM-only delivery. All agents on the mesh can see and
 `curl http://localhost:9100/gpu-data | jq` — Full fleet status

 ### check-health
-
-**RUN LIVE, NEVER ECHO — every dispatch must execute the probes below with real tool calls; never repeat a prior report unless a live probe fails.**
-
-```bash
-# GPU Monitor health
- curl http://localhost:9100/health | jq
-# Expected: 200 with {"status": "healthy", "cache_age_seconds": <n>}
-
-# Router health (via nginx on port 80)
-curl -s -o /dev/null -w '%{http_code}' http://192.168.68.116/health
-# Expected: 200 (Router is up and responding)
-
-# LiteLLM health (via nginx on port 80)
-curl -s -o /dev/null -w '%{http_code}' http://192.168.68.116/litellm/health
-# Expected: 200 (LiteLLM is up and responding)
-
-# Dashboard
- curl -s -o /dev/null -w '%{http_code}' http://192.168.68.116/dashboard/
-# Expected: 200 (Dashboard is up and responding)
-```
-
-**Report format**: Summarize actual results from each probe. If any probe returns non-200, flag as alert.
+`curl http://localhost:9100/health` — Monitor self-check

 ### view-dashboard
 Open `http://localhost:9100/` in browser — Live HTML dashboard
@@ -108,9 +108,7 @@ GPU .8 (RTX 3090)    GPU .110 (RTX 5070)   GPU .15 (Strix Halo)

 ```bash
 # Zulip API health (POST ping)
-source /etc/litellm-monitor.env
-ZULIP_USER="abiba-bot@chat.sysloggh.net"
-curl -s -o /dev/null -w '%{http_code}' -X POST https://chat.sysloggh.net/api/v1/messages -u "${ZULIP_USER}:${ZULIP_BOT_KEY}"
+curl -s -o /dev/null -w '%{http_code}' -X POST https://chat.sysloggh.net/api/v1/messages -u 'abiba-bot@chat.sysloggh.net:KEY'
 # Expected: 200 (HTTP 000 = unreachable/cache)

 # PM2 process health
@@ -122,18 +120,6 @@ curl -s http://192.168.68.8:9400/metrics && echo " - OK" || echo " - FAIL"
 curl -s http://192.168.68.110:9400/metrics && echo " - OK" || echo " - FAIL"
 curl -s http://192.168.68.15:9400/metrics && echo " - OK" || echo " - FAIL"

-# Router health (via nginx on port 80)
-curl -s -o /dev/null -w '%{http_code}' http://192.168.68.116/health
-# Expected: 200 (Router is up and responding)
-
-# LiteLLM health (via nginx on port 80)
-curl -s -o /dev/null -w '%{http_code}' http://192.168.68.116/litellm/health
-# Expected: 200 (LiteLLM is up and responding)
-
-# PVE API (401 expected for unauthenticated probe — API is up over https)
-curl -s -o /dev/null -w '%{http_code}' https://192.168.68.116:8006/api2/json
-# Expected: 401 (unauthorized — API is up; 000 = unreachable, 500 = API down)
-
 # Prometheus targets
 curl -s http://192.168.68.116:9090/api/v1/targets | jq '.data.activeTargets'
 # Expected: All targets UP (may show some down if exporters not deployed)
@@ -142,7 +128,7 @@ curl -s http://192.168.68.116:9090/api/v1/targets | jq '.data.activeTargets'
 curl -s http://192.168.68.116:3001/api/health | jq '{status, version}'
 # Expected: {"status":"ok","version":"..."}

-# LiteLLM metrics (Prometheus endpoint)
+# LiteLLM metrics
 curl -s http://192.168.68.116:4001/metrics | head -20
 # Expected: Prometheus-formatted metrics output
 ```
@@ -100,32 +100,6 @@ Edit `build-dashboards.py`, run it, `docker restart harness-grafana`
 ### check-targets
 `curl http://192.168.68.116:9090/api/v1/targets | jq '.data.activeTargets[] | {job:.labels.job,health}'`

-### check-health
-
-**RUN LIVE, NEVER ECHO — every dispatch must execute the probes below with real tool calls; never repeat a prior report unless a live probe fails.**
-
-```bash
-# Prometheus health (bound to 0.0.0.0:9090 on .116)
-curl -s -o /dev/null -w '%{http_code}' http://192.168.68.116:9090/-/healthy
-# Expected: 200 (Prometheus is up and healthy)
-
-# Grafana health (bound to 0.0.0.0:3001 on .116)
-curl -s -o /dev/null -w '%{http_code}' http://192.168.68.116:3001/api/health
-# Expected: 200 (Grafana is up and healthy)
-
-# Docker Stats exporter (bound to 127.0.0.1:9324 on .116 — must probe from .116 localhost)
-ssh root@192.168.68.116 "curl -s -o /dev/null -w '%{http_code}' http://127.0.0.1:9324/metrics"
-# Expected: 200 (docker-stats-exporter is up and responding)
-
-# PVE exporter (bound to 127.0.0.1:9221 on .116 — must probe from .116 localhost)
-ssh root@192.168.68.116 "curl -s -o /dev/null -w '%{http_code}' http://127.0.0.1:9221/metrics"
-# Expected: 200 (pve-exporter is up and responding)
-```
-
-**Report format**: Summarize actual results from each probe. If any probe returns non-200, flag as alert.
-
-**Note**: Docker Stats and PVE Exporter are bound to 127.0.0.1 (localhost-only) so they must be probed from .116 via SSH. Prometheus and Grafana are bound to 0.0.0.0 so they can be probed from the LAN.
-
 ### restart-exporter
 `cd /opt/monitoring && docker compose restart pve-exporter docker-stats`

@@ -197,22 +197,15 @@ Check `platforms.zulip.state`: `connected` ✅ | `disconnected` ❌ | `error`
 **B2: Agent Process**

 ```bash
-# Probe from CT 115 (amdpve) to avoid SSH key issues on CT 117
-ssh root@192.168.68.15 "pct exec 112 'systemctl is-active dsh-web'"
+ssh root@<CT> "ps aux | grep 'gateway run' | grep -v grep"
 ```

-Gateway should be active. **Dual-gateway detection**: check for duplicate processes.
+Gateway PID should exist with uptime > 60s. **Dual-gateway detection**: if more than one `gateway run` process is found, the gateway has a collision (typically one `--force` and one `--replace` process). Kill the newer/duplicate process, then restart the remaining gateway per-agent (parameterized 2026-08-09, captain ruling):

-**B3: Gateway Health**
+| Agent | Restart command | Notes |
+|-------|-----------------|-------|

-```bash
-# Probe localhost on CT 112 for DSH web service
-ssh root@192.168.68.15 "pct exec 112 'curl -s -o /dev/null -w \"%{http_code}\" http://127.0.0.1:3080/'"
-```
-
-Expected: any HTTP code (200, 302, 401, etc.) = gateway is alive. Connection refused = gateway down.
-
-**Note**: DSH web service listens on 127.0.0.1:3080 (loopback-only) by design. Public URL returns 302 through proxy-auth chain, not bare 200.
+Check gateway log for "Gateway running with 2 platform(s)" (not 1) to confirm Zulip reloaded.

 **B3: Heartbeat Verification** (Hermes agent Mumuni only — Tanko has no Hermes gateway)

@@ -245,11 +238,10 @@ ssh root@192.168.68.24 "grep -E 'Finalized|Failed to finalize|Replied to' ~/.her
 **C1: A2A Server Health**

 ```bash
-# A2A server is on :50080 (not :8001) and is auth-gated (401 expected for unauthenticated)
-ssh root@192.168.68.14 "curl -s --connect-timeout 5 -o /dev/null -w '%{http_code}' http://127.0.0.1:50080/a2a/"
+ssh root@192.168.68.14 "docker exec agent-zero curl -s --connect-timeout 5 http://127.0.0.1:8001/.well-known/agent.json"
 ```

-Expected: `401` (auth-gated, A2A server is up and responding) or `200` (if no auth required). Connection refused (000) → A2A server down.
+Expected: `{"name":"kagentz",...}`. Connection refused → A2A server down.

 **C2: Adapter Process**

@@ -270,14 +262,12 @@ Check: `processed=N` incrementing, `silence < 600s`, `reconnects` ≈ 0.
 **C4: A2A Response Verification**

 ```bash
-# A2A server is on :50080 (not :8001) and is auth-gated (401 expected for unauthenticated)
-ssh root@192.168.68.14 "curl -s -X POST http://127.0.0.1:50080/a2a \
+ssh root@192.168.68.14 "docker exec agent-zero curl -s -X POST http://127.0.0.1:8001/a2a \
  -H 'Content-Type: application/json' \
-  -H 'Authorization: Bearer $LITELLM_KEY' \
  -d '{\"jsonrpc\":\"2.0\",\"method\":\"tasks/send\",\"params\":{\"message\":{\"role\":\"user\",\"parts\":[{\"text\":\"ping\"}]}},\"id\":1}'"
 ```

-Expected: task ID with "working" status. Poll for completion with `tasks/get`. If 401, check LITELLM_KEY is set.
+Expected: task ID with "working" status. Poll for completion with `tasks/get`.

 **Platform C Actions**