no-mistakes(document): Sweep residual gemma aliases; align compression rule contradiction

This commit is contained in:
root
2026-09-12 16:51:21 +00:00
parent 3d55764799
commit 1f1b47f59d
3 changed files with 7 additions and 7 deletions
+3 -3
View File
@@ -23,7 +23,7 @@ management, and prompt caching — without sacrificing agent capability.
.123, any others on .129/.122) including compression, model, context_window,
prompt_caching, memory settings
- `gpu-health`: health check response from all 3 GPU backends (strix-moe .15:8080,
qwen .8:8080, gemma .110:8080)
gpu-dense .8:8080, gpu-vision .110:8080)
### Maintains
@@ -56,8 +56,8 @@ duration.
**Context is the root cause.** Every ~46K prompt token costs ~87s of
prefill time at 532 tok/s. Fix context first, routing second.
- **Route by task**: qwen for code/standard queries; gemma for
compression/auxiliary; strix-moe for compression tasks.
- **Route by task**: gpu-dense for code/standard queries; gpu-vision for
vision/web-auxiliary; syslog-auto for compression.
- **Compress aggressively**: threshold at 40% (not 65%) — a 128K window should
compact at 51K, not 85K. Target 15% tail (not 30%).
- **Cache everything repeated**: system prompts, skill docs, AGENTS.md — these