diff --git a/README.md b/README.md index 0aea3cf..877a107 100644 --- a/README.md +++ b/README.md @@ -8,7 +8,7 @@ CT 116 Docker stack for routing local GPU models through a unified OpenAI-compat nginx :80 → router :9000 → GPU backends ├─ qwen3.6-35B-A3B (MoE) @ 192.168.68.15:8080 [2 slots] ├─ qwen3.6-27B-code (Dense) @ 192.168.68.8:8080 [2 slots] - └─ qwen3.5-9b-vlm (VLM) @ 192.168.68.110:8080 [2 slots] + └─ gemma-4-12b (VLM) @ 192.168.68.110:8080 [2 slots] Total: 6 concurrent slots LiteLLM :8081 (fallback) | Dashboard :3000 | Redis :6379 (local) @@ -63,7 +63,7 @@ When all GPUs are saturated, requests enter a polling queue (500ms intervals) in |-----|-------|------|-------| | Strix Halo | qwen3.6-35B-A3B (MoE) | 65GB | 2 | | RTX 3090 | qwen3.6-27B-code (Dense) | 24GB | 2 | -| RTX 5070 | qwen3.5-9b-vlm (VLM) | 12GB | 2 | +| New Backend | gemma-4-12b (VLM) | 7.1GB | 2 | ## Maintenance diff --git a/dashboard/dashboard.py b/dashboard/dashboard.py index 62626ae..5a30ec1 100644 --- a/dashboard/dashboard.py +++ b/dashboard/dashboard.py @@ -111,9 +111,15 @@ body { background: #0b0f17; color: #bcc3cd; font-family: -apple-system, BlinkMac