From 2b9b545ca92e7c1331709815bce455d36bbb08a7 Mon Sep 17 00:00:00 2001 From: root Date: Thu, 23 Jul 2026 09:10:43 +0000 Subject: [PATCH] no-mistakes(document): Fixed 2 stale model-name references in doc files --- gpu-fleet.prose.md | 2 +- hermes-config-template.prose.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/gpu-fleet.prose.md b/gpu-fleet.prose.md index 05c00ff..fcb7023 100644 --- a/gpu-fleet.prose.md +++ b/gpu-fleet.prose.md @@ -116,7 +116,7 @@ Note: All syslog-auto entries route directly to GPUs with `api_key: not-needed`. | Model | RPM Cap | Notes | |-------|---------|-------| -| strix-moe (Hermes V3) | 40 | Tight cap — prevents Strix overload | +| strix-moe (qwen3.6-35B-udq4) | 40 | Tight cap — prevents Strix overload | | qwen3.6-27B-code | 500 | High cap — primary workhorse | | gemma-4-12b | 500 | High cap — IQ4_NL+MTP, 122 tok/s | diff --git a/hermes-config-template.prose.md b/hermes-config-template.prose.md index 36171ce..b3d0dda 100644 --- a/hermes-config-template.prose.md +++ b/hermes-config-template.prose.md @@ -272,7 +272,7 @@ The following MUST be identical across ALL profiles: ### Rule 8: GPU Workload Distribution (UPDATED 2026-07-18) - **RTX 3090 (24GB, 128K ctx, qwen3.6-27B-code)**: Heavy reasoning, code gen, long conversations — also handles ~55% of compression via syslog-auto pool - **RTX 5070 (12GB, 128K ctx, gemma-4-12b)**: Vision, web search, quick tasks, web_extract — handles ~15% of compression via syslog-auto pool -- **Strix Halo (64GB, 128K ctx, Geneis Hermes V3 APEX)**: Agent reasoning, compression (~30% via syslog-auto pool), fallback for other GPUs +- **Strix Halo (64GB, 128K ctx, qwen3.6-35B-udq4)**: Agent reasoning, compression (~30% via syslog-auto pool), fallback for other GPUs - Agent profiles MUST route auxiliary tasks to the correct GPU: - `auxiliary.vision.model: gpu-light` (RTX 5070) - `auxiliary.web_extract.model: gpu-light` (RTX 5070)