abiba-bot/inference-harness
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity

Commit Graph

  • 9c31b5d622 May 19, 2026: Full harness update Abiba 2026-05-19 15:03:34 +00:00
  • 4f032b035c Mumuni review action items: health checks for all containers, version pinning, 503+Retry-After on all-GPU saturation Abiba (pi) 2026-05-17 09:05:27 +00:00
  • 8f3b0c6647 Router: health check verifies actual llama.cpp endpoint, gpu_decr negative guard, AMD sidecar fixed (sysfs fallback) Abiba (pi) 2026-05-17 01:52:28 +00:00
  • 808c9d3d13 Router: 300s timeout, gpu_decr bugfix. Dashboard: Bootstrap 5 modern redesign with KPI stats, equal-height cards, queue ring. Nginx: 600s timeout. Abiba (pi) 2026-05-16 22:12:21 +00:00
  • 9817fe2ef2 Dashboard: clean rebuild with Queue Status ring chart, GPU slot indicators, organized layout (GPU/Queue+Model+Agent/Usage/Live) Abiba (pi) 2026-05-16 21:05:19 +00:00
  • 654cdff718 Dashboard: GPU slot indicators show active/max concurrent requests. Koonimo API key added. Real-time queuing visibility. Abiba (pi) 2026-05-16 20:43:22 +00:00
  • bf90e57c5f Load-aware routing: tracks active GPU requests in Redis, distributes overflow when MoE saturated. 6 concurrent requests now spread across all 3 GPUs instead of queuing on one. Abiba (pi) 2026-05-16 20:23:32 +00:00
  • 2db2796e53 Dashboard: rename to SyslogAI Harness, GPU bar now shows utilization instead of VRAM Abiba (pi) 2026-05-16 19:26:46 +00:00
  • ec0f9fac63 Fix: clean_unicode now uses chr()-based replacements + ASCII strip to prevent bash heredoc corruption. Emoji and all non-ASCII now fully stripped. Abiba (pi) 2026-05-16 19:12:58 +00:00
  • 3d42ea4767 Merge: add Abiba harness code — nginx, LiteLLM, router, dashboard, Redis Abiba (pi) 2026-05-16 18:53:31 +00:00
  • 7b6c6aabe1 Initial commit: CT 116 inference harness — nginx, LiteLLM, router, dashboard, Redis Abiba (pi) 2026-05-16 18:51:50 +00:00
  • b65ea22765 Update Nginx Docker config mumuni-bot 2026-05-15 21:35:13 +00:00
  • cf7f61650f Add Dockerfile.dashboard mumuni-bot 2026-05-15 21:34:52 +00:00
  • 7d00bbec0e Add Dockerfile.queue mumuni-bot 2026-05-15 21:34:49 +00:00
  • 37f7c95b05 Add env example mumuni-bot 2026-05-15 21:07:34 +00:00
  • a28b3a557d Add Nginx router config mumuni-bot 2026-05-15 21:07:33 +00:00
  • c42f3a9979 Add migration plan mumuni-bot 2026-05-15 21:07:32 +00:00
  • e1f12c3462 Add dashboard mumuni-bot 2026-05-15 21:07:07 +00:00
  • b55b954967 Add queue service mumuni-bot 2026-05-15 21:07:05 +00:00
  • c85aaa570b Add docker-compose mumuni-bot 2026-05-15 21:07:05 +00:00
  • 43382dac5b Initial commit: README mumuni-bot 2026-05-15 21:07:03 +00:00