jerome
b671546622
Created complete documentation structure with: • Root README.md with repository overview • Documentation directory structure (01-05 + templates) • Migrated content from public repository • New operational documentation • Comprehensive templates for business workflows Sections: 1. 01-business-strategy/ - Business vision, market analysis, financials 2. 02-technical-architecture/ - Infrastructure, AI agents, deployment 3. 03-operations/ - Client onboarding, support processes 4. 04-customer-portal/ - Placeholder for client-facing docs 5. 05-development/ - Placeholder for dev standards 6. templates/ - 5 reusable business templates This commit establishes the foundation for the repository reorganization. Content review will be conducted separately.
43 lines
1.7 KiB
Markdown
43 lines
1.7 KiB
Markdown
1|# 04 - Qwen3.5 Model Setup — Home
|
|
2|**Purpose:** Installation and configuration guides for Qwen3.5 model variants.
|
|
3|
|
|
4|## Available Models
|
|
5|
|
|
6|### **Qwen3.5-MoE (Mixture of Experts)** — Optimized for production inference with dynamic expert routing.
|
|
7|
|
|
8|### **Qwen3.5-Base** — Standard dense model variant.
|
|
9|
|
|
10|### **Qwen3.5-FineTuned** — Domain-specific fine-tuned variants.
|
|
11|
|
|
12|## GPU Compatibility
|
|
13|
|
|
14|- **AMD Strix Halo** — See [AMD GPU Passthrough Guide](../03\ -\ AMD\ GPU\ Passthrough/00\ -\ AMD\ GPU\ Passthrough.md)
|
|
15|- **NVIDIA RTX 4090** — Standard CUDA setup
|
|
16|- **Multi-GPU Clusters** — Distributed inference setup
|
|
17|
|
|
18|## Quick Start
|
|
19|
|
|
20|### Install Qwen3.5-MoE via Ollama
|
|
21|```bash
|
|
22|ollama pull qwen3.5:250b-moe
|
|
23|ollama serve
|
|
24|
|
|
25|# Run locally at 192.168.68.8:8080
|
|
26|ollama run qwen3.5:250b-moe "What are the top AI trends for 2026?"
|
|
27|```
|
|
28|
|
|
29|### Advanced Configuration
|
|
30|
|
|
31|For production deployments with dynamic expert selection:
|
|
32|- See `/60\ -\ Syslog/02\ -\ TECHNICAL\ INFRASTRUCTURE/04\ -\ Qwen3.5\ Model\ Setup/01\ -\ Qwen3.5-MoE\ Configuration.md`
|
|
33|- GPU passthrough: `/60\ -\ Syslog/02\ -\ TECHNICAL\ INFRASTRUCTURE/03\ -\ AMD\ GPU\ Passthrough/00\ -\ AMD\ GPU\ Passthrough.md`
|
|
34|
|
|
35|## Scripts
|
|
36|
|
|
37|- `vulkan-qwen35-moe-setup.sh` — Complete setup script for Qwen3.5-MoE with Vulkan backend
|
|
38|- `qwen35-moe-inference-config.sh` — Production inference configuration script
|
|
39|
|
|
40|---
|
|
41|
|
|
42|*For AMD GPU-specific setup, refer to the AMD GPU Passthrough guide.*
|
|
43| |