Compare commits
4
Commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
994ae1b7ac | ||
|
|
b835986d44 | ||
|
|
d6ad016ac9 | ||
|
|
c3306e87e4 |
@@ -71,7 +71,7 @@ model:
|
|||||||
custom_providers:
|
custom_providers:
|
||||||
- name: harness
|
- name: harness
|
||||||
model: syslog-auto
|
model: syslog-auto
|
||||||
base_url: http://192.168.68.116/v1
|
base_url: http://192.168.68.116/litellm/v1
|
||||||
api_key_env: LITELLM_API_KEY
|
api_key_env: LITELLM_API_KEY
|
||||||
api_mode: chat_completions
|
api_mode: chat_completions
|
||||||
```
|
```
|
||||||
@@ -82,7 +82,7 @@ auxiliary:
|
|||||||
vision:
|
vision:
|
||||||
provider: harness
|
provider: harness
|
||||||
model: gemma-4-12b # or syslog-auto
|
model: gemma-4-12b # or syslog-auto
|
||||||
base_url: http://192.168.68.116/v1
|
base_url: http://192.168.68.116/litellm/v1
|
||||||
api_key_env: LITELLM_API_KEY
|
api_key_env: LITELLM_API_KEY
|
||||||
api_key: <value from: infisical secrets get LITELLM_API_KEY --project=agents --env=production> # ← MANDATORY workaround
|
api_key: <value from: infisical secrets get LITELLM_API_KEY --project=agents --env=production> # ← MANDATORY workaround
|
||||||
timeout: 60
|
timeout: 60
|
||||||
@@ -97,7 +97,7 @@ auxiliary:
|
|||||||
target_ratio: 0.3
|
target_ratio: 0.3
|
||||||
provider: harness
|
provider: harness
|
||||||
model: syslog-auto # or gemma-4-12b
|
model: syslog-auto # or gemma-4-12b
|
||||||
base_url: http://192.168.68.116/v1
|
base_url: http://192.168.68.116/litellm/v1
|
||||||
api_key_env: LITELLM_API_KEY
|
api_key_env: LITELLM_API_KEY
|
||||||
api_key: <value from: infisical secrets get LITELLM_API_KEY --project=agents --env=production> # ← MANDATORY workaround
|
api_key: <value from: infisical secrets get LITELLM_API_KEY --project=agents --env=production> # ← MANDATORY workaround
|
||||||
timeout: 120
|
timeout: 120
|
||||||
|
|||||||
@@ -285,13 +285,13 @@ auxiliary:
|
|||||||
vision:
|
vision:
|
||||||
api_key: sk-<agent-key-from-vault> # ← workaround (get via: infisical secrets get LITELLM_API_KEY --project=agents --env=production --plain)
|
api_key: sk-<agent-key-from-vault> # ← workaround (get via: infisical secrets get LITELLM_API_KEY --project=agents --env=production --plain)
|
||||||
api_key_env: LITELLM_API_KEY
|
api_key_env: LITELLM_API_KEY
|
||||||
base_url: http://192.168.68.116/v1
|
base_url: http://192.168.68.116/litellm/v1
|
||||||
model: gemma-4-12b
|
model: gemma-4-12b
|
||||||
provider: harness
|
provider: harness
|
||||||
compression:
|
compression:
|
||||||
api_key: sk-<agent-key-from-vault> # ← workaround (same as above)
|
api_key: sk-<agent-key-from-vault> # ← workaround (same as above)
|
||||||
api_key_env: LITELLM_API_KEY
|
api_key_env: LITELLM_API_KEY
|
||||||
base_url: http://192.168.68.116/v1
|
base_url: http://192.168.68.116/litellm/v1
|
||||||
model: gemma-4-12b
|
model: gemma-4-12b
|
||||||
provider: harness
|
provider: harness
|
||||||
```
|
```
|
||||||
|
|||||||
@@ -102,6 +102,39 @@ GPU .8 (RTX 3090) GPU .110 (RTX 5070) GPU .15 (Strix Halo)
|
|||||||
- Stack persists across reboots (systemd for exporters, Docker restart policy)
|
- Stack persists across reboots (systemd for exporters, Docker restart policy)
|
||||||
|
|
||||||
## Execution
|
## Execution
|
||||||
|
### check-health
|
||||||
|
|
||||||
|
**RUN LIVE, NEVER ECHO — every dispatch must execute the probes below with real tool calls; never repeat a prior report unless a live probe fails.**
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# Zulip API health (POST ping)
|
||||||
|
curl -s -o /dev/null -w '%{http_code}' -X POST https://chat.sysloggh.net/api/v1/messages -u 'abiba-bot@chat.sysloggh.net:KEY'
|
||||||
|
# Expected: 200 (HTTP 000 = unreachable/cache)
|
||||||
|
|
||||||
|
# PM2 process health
|
||||||
|
pm2 jlist
|
||||||
|
# Expected: 5/5 online (abiba-telegram, abiba-zulip, zulip-watchdog, gitea-runner, spoton-service)
|
||||||
|
|
||||||
|
# GPU exporters (may be down per DEPLOYMENT STATUS)
|
||||||
|
curl -s http://192.168.68.8:9400/metrics && echo " - OK" || echo " - FAIL"
|
||||||
|
curl -s http://192.168.68.110:9400/metrics && echo " - OK" || echo " - FAIL"
|
||||||
|
curl -s http://192.168.68.15:9400/metrics && echo " - OK" || echo " - FAIL"
|
||||||
|
|
||||||
|
# Prometheus targets
|
||||||
|
curl -s http://192.168.68.116:9090/api/v1/targets | jq '.data.activeTargets'
|
||||||
|
# Expected: All targets UP (may show some down if exporters not deployed)
|
||||||
|
|
||||||
|
# Grafana health
|
||||||
|
curl -s http://192.168.68.116:3001/api/health | jq '{status, version}'
|
||||||
|
# Expected: {"status":"ok","version":"..."}
|
||||||
|
|
||||||
|
# LiteLLM metrics
|
||||||
|
curl -s http://192.168.68.116:4001/metrics | head -20
|
||||||
|
# Expected: Prometheus-formatted metrics output
|
||||||
|
```
|
||||||
|
|
||||||
|
**Report format**: Summarize actual results from each probe. If any probe returns non-200 or empty output, flag as alert.
|
||||||
|
|
||||||
|
|
||||||
### Phase 1: GPU Exporters
|
### Phase 1: GPU Exporters
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user