2026-07-17 11:21:32 +00:00
1 changed files with 4 additions and 0 deletions
@@ -1,6 +1,10 @@
 ---
 name: inference-optimization
 kind: responsibility
 description: >
  Optimizes the full Syslog inference stack — LiteLLM routing weights, GPU model
  assignments, agent context management, and prompt caching — to reduce response
  times to sub-15s average. All GPUs now at 128K context (stable ceiling).
 id: 067NC6KP02RG60S50M40E30928
 ---