abiba-bot
  • Joined on 2026-05-16
abiba-bot pushed to main at abiba-bot/inference-harness 2026-06-07 22:49:51 +00:00
85608d7c60 Dashboard + LiteLLM config updates from maintenance
abiba-bot pushed to main at abiba-bot/inference-harness 2026-06-07 22:49:48 +00:00
24f0928ea1 Phase 0: model migration (qwen3.5-9b-vlm → gemma-4-12b), context alignment (all 262K), routing tiers + MoE spillover, fix dashboard window=1h parsing
abiba-bot pushed to main at SyslogSolution/syslog-harness 2026-06-06 01:46:57 +00:00
867a6189df Dashboard: fix undefined labels for retired models + safe fallback helpers
abiba-bot pushed to main at SyslogSolution/syslog-harness 2026-06-06 00:51:34 +00:00
39cf297a8f Phase 0: Dual-key router — no hardcoded keys, gemma sync, 262K context fix
abiba-bot pushed to main at SyslogSolution/syslog-harness 2026-06-05 23:49:04 +00:00
1e24bc3b9b docs: update model table with context windows, capabilities, GPU labels
abiba-bot pushed to main at SyslogSolution/syslog-harness 2026-06-05 23:48:47 +00:00
e6a6c30211 router: v3 — 5-tier routing with vision guard, MoE spillover, code hint
abiba-bot pushed to main at SyslogSolution/syslog-harness 2026-06-05 23:32:29 +00:00
c0be4c1699 router: reference - new 5-tier routing with vision guard (deployed CT116)
abiba-bot pushed to main at SyslogSolution/syslog-harness 2026-06-05 23:15:20 +00:00
424d943b12 router: fix Dense context window 98K→262K (matches actual n_ctx)
abiba-bot pushed to main at SyslogSolution/syslog-harness 2026-06-05 21:53:09 +00:00
b6abd84062 dashboard: rename VLM GPU label 'New Backend' → 'RTX 5070' for consistency
abiba-bot pushed to main at SyslogSolution/syslog-harness 2026-06-05 21:37:20 +00:00
dace488f93 VLM migration: qwen3.5-9b-vlm → gemma-4-12b across entire harness
abiba-bot pushed to main at SyslogSolution/syslog-harness 2026-06-05 21:26:54 +00:00
370f5546dd dashboard: migrate VLM model qwen3.5-9b-vlm → gemma-4-12b (new backend 192.168.68.110:8080/v1)
abiba-bot pushed to main at abiba-bot/inference-harness 2026-06-03 13:07:07 +00:00
0cb4597b0e security: move API keys to env var, strip from source code fallback
abiba-bot pushed to main at abiba-bot/inference-harness 2026-06-02 10:37:12 +00:00
9a633583ab fix: Security hardening from CT116 deep-dive review
abiba-bot pushed to main at abiba-bot/inference-harness 2026-05-30 13:15:20 +00:00
060a47fce9 revert: MoE back to 2 slots (cross-agent spread now prevents hotspot)
abiba-bot pushed to main at abiba-bot/inference-harness 2026-05-30 12:55:31 +00:00
34fb7516e1 fix: cross-agent GPU spreading prevents hotspot hammering
abiba-bot pushed to main at abiba-bot/inference-harness 2026-05-30 12:52:25 +00:00
acbcb20837 fix: MoE concurrency 2→1 (95C thermal emergency)
abiba-bot pushed to main at abiba-bot/inference-harness 2026-05-29 09:45:45 +00:00
a3bca93d9b fix: buffer SSE chunks for large streaming responses
abiba-bot pushed to main at abiba-bot/inference-harness 2026-05-28 21:45:24 +00:00
d53685d874 feat: agent-aware GPU load balancing
abiba-bot pushed to main at abiba-bot/inference-harness 2026-05-28 21:40:20 +00:00
54a4f26db7 fix: Default tier back to Dense-first (MoE overheating at 91°C)
abiba-bot pushed to main at abiba-bot/inference-harness 2026-05-27 07:22:32 +00:00
fb1d51b93b restructure: routing prioritized by reasoning requirements