Add local AI and Qdrant vector backends

This commit is contained in:
“BeeRad”
2026-05-02 09:57:57 +10:00
parent 00f0afb8f4
commit 782ace9a34
37 changed files with 1440 additions and 321 deletions
+47
View File
@@ -0,0 +1,47 @@
# Qdrant Deployment
Qdrant is the optional vector-search sidecar for environments where sqlite-vec is unavailable or unreliable.
Use Qdrant for:
- Alpine/musl Docker images
- Windows ARM64
- Linux ARM64 setups where sqlite-vec has not been validated
- any setup where sqlite-vec cannot be installed or loaded reliably
Qdrant is not required for local embeddings. The embedding model creates vectors; the vector backend stores and searches them.
## Start Qdrant
```bash
docker compose up -d qdrant
```
Configure RA-H:
```bash
VECTOR_BACKEND=qdrant
QDRANT_URL=http://localhost:6333
```
Validate:
```bash
npm run doctor:local-ai
```
## Rebuild
Switching from sqlite-vec to Qdrant, or changing embedding provider/model/dimensions, requires rebuilding vector indexes:
```bash
npm run rebuild:embeddings
```
If existing Qdrant collections have the wrong dimensions and you intentionally want to recreate them from SQLite source data:
```bash
QDRANT_RECREATE_COLLECTIONS=true npm run rebuild:embeddings
```
Nodes, edges, source text, chunks, and metadata remain in SQLite. Qdrant can be deleted and rebuilt from SQLite-derived source data.