inference-harness

abiba-bot/inference-harness

Fork 0

Author	SHA1	Message	Date
Abiba	776343f2ab	feat(plan): add fallback chains and resolve model identity gap - Added LiteLLM fallback chains for explicit GPU models - Changed allowed_fails: 0 -> 100 (router returns 503 on saturated) - Documented strict passthrough router change (already deployed) - Rewrote Appendix A as actual Model Identity Gap Analysis - Added risk mitigation for fallback chain masking real failures - Updated success metrics to reflect accurate per-model tracking - Reviewed and approved by Mumuni and Kagenz0	2026-06-14 22:48:53 +00:00
jerome	492a4fe68b	feat(plan): resolve all migration gaps and update router logic for LiteLLM integration	2026-06-14 17:04:40 -04:00
kagentz-botandAbiba	84e0d163ee	feat(plan): update LiteLLM migration plan for CT 116 deployment with Authentik OIDC + zero-downtime strategy - Target deployment host: CT 116 syslog-api (192.168.68.116) on minipve - DNS split-horizon: Option A /etc/hosts for auth.sysloggh.net → 192.168.68.11 - Add guardrails config (pre-call, post-call, content filter) - Add custom_sso.py for Authentik OIDC via x-authentik-* headers - Expand from 3-phase to 4-phase deployment with zero-downtime strategy - Add Phase 0: Infrastructure Prep (DNS, Postgres, config, custom_sso) - Add §11 GitOps workflow (branching, conventional commits, deployment flow) - Add §12 Zero-Downtime Migration Strategy (per-agent 2min, global rollback) - Update nginx config with Authentik forward auth + router fallback - Update docker-compose.yml for CT 116 with extra_hosts + postgres - Add multi-provider config placeholders (OpenAI, Anthropic) Co-authored-by: Abiba <abiba@sysloggh.net>	2026-06-14 08:22:32 -04:00

Author

SHA1

Message

Date

Abiba

776343f2ab

feat(plan): add fallback chains and resolve model identity gap

- Added LiteLLM fallback chains for explicit GPU models
- Changed allowed_fails: 0 -> 100 (router returns 503 on saturated)
- Documented strict passthrough router change (already deployed)
- Rewrote Appendix A as actual Model Identity Gap Analysis
- Added risk mitigation for fallback chain masking real failures
- Updated success metrics to reflect accurate per-model tracking
- Reviewed and approved by Mumuni and Kagenz0

2026-06-14 22:48:53 +00:00

jerome

492a4fe68b

feat(plan): resolve all migration gaps and update router logic for LiteLLM integration

2026-06-14 17:04:40 -04:00

kagentz-botandAbiba

84e0d163ee

feat(plan): update LiteLLM migration plan for CT 116 deployment with Authentik OIDC + zero-downtime strategy

- Target deployment host: CT 116 syslog-api (192.168.68.116) on minipve
- DNS split-horizon: Option A /etc/hosts for auth.sysloggh.net → 192.168.68.11
- Add guardrails config (pre-call, post-call, content filter)
- Add custom_sso.py for Authentik OIDC via x-authentik-* headers
- Expand from 3-phase to 4-phase deployment with zero-downtime strategy
- Add Phase 0: Infrastructure Prep (DNS, Postgres, config, custom_sso)
- Add §11 GitOps workflow (branching, conventional commits, deployment flow)
- Add §12 Zero-Downtime Migration Strategy (per-agent 2min, global rollback)
- Update nginx config with Authentik forward auth + router fallback
- Update docker-compose.yml for CT 116 with extra_hosts + postgres
- Add multi-provider config placeholders (OpenAI, Anthropic)

Co-authored-by: Abiba <abiba@sysloggh.net>

2026-06-14 08:22:32 -04:00

1 changed files with 490 additions and 308 deletions

LITELLM-MIGRATION-PLAN.md

+487 -305

View File

File diff suppressed because it is too large Load Diff

Compare commits