diff --git a/hermes-config-template.prose.md b/hermes-config-template.prose.md index fda8075..c88f8a9 100644 --- a/hermes-config-template.prose.md +++ b/hermes-config-template.prose.md @@ -96,7 +96,7 @@ work immediately after restart. ```yaml # ─── Model Selection ─── model: - default: # e.g., ornith-1.0-35b, qwen3.6-27B-code + default: # e.g., strix-moe, qwen3.6-27B-code, syslog-auto provider: harness base_url: http://192.168.68.116/v1 api_key_env: LITELLM_API_KEY # Injected via infisical run -- wrapper @@ -259,7 +259,7 @@ The following MUST be identical across ALL profiles: - Agent profiles MUST route auxiliary tasks to the correct GPU: - `auxiliary.vision.model: gemma-4-12b` (RTX 5070) - `auxiliary.web_extract.model: gemma-4-12b` (RTX 5070) - - `auxiliary.compression.model: ornith-1.0-35b` (Strix Halo) + - `auxiliary.compression.model: strix-moe` (Strix Halo) - Default model (`model.default`) and custom_provider remain `syslog-auto` for auto-routing - For 262K context window: `threshold: 0.65` (fires at ~170K tokens) - Do NOT use `threshold: 0.25` — this fires at 65K, causing premature context loss @@ -277,7 +277,7 @@ The following MUST be identical across ALL profiles: ### Rule 10: Default Model Must Be `syslog-auto` (All Agents) - **Hermes agents**: `model.default: syslog-auto`, `custom_providers[0].model: syslog-auto` - **pi agents**: `defaultModel: syslog-auto` in `settings.json`, first model in `models.json` -- `syslog-auto` is the LiteLLM routing model — it load-balances between ornith-1.0-35b +- `syslog-auto` is the LiteLLM routing model — it load-balances between strix-moe and qwen3.6-27B-code, with gemma-4-12b as fallback. Using it protects against: - Model name typos that cause 403 errors and silent worker failures - Single GPU downtime (routing falls back automatically)