wmj/falah-mobile
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

AI-Tools-Stack: add AnythingLLM, Perplexica, LibreChat deployment docs

WMJ Ismail
2026-07-08 10:22:58 +02:00
parent f5b28226cb
commit 56c2a0aa3e
2 changed files with 61 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
AI-Tools-Stack.md
+54
@@ -0,0 +1,54 @@
## 🔧 AI Tools Stack
Self-hosted AI productivity tools deployed on Docker Swarm (Contabo VPS). All tools use **OpenClaw API** (`https://opencode.ai/zen/go/v1`) as the LLM backend — no external API keys needed.
| Tool | URL | Status | Purpose |
|------|-----|--------|---------|
| **AnythingLLM** | https://anything.falahos.my | ✅ Running | Document RAG — upload wikis, SOPs, manuals, query with AI |
| **LibreChat** | https://chat.falahos.my | ✅ Running | Multi-model chat with MCP agents — can interface with Odysseus, OpenClaw, OpenHands |
| **Perplexica (Vane)** | https://search.falahos.my | 🟡 Starting | AI-powered search engine — self-hosted Perplexity alternative |
### Infrastructure
| Component | Detail |
|-----------|--------|
| **Deployment** | `/opt/falah-os/swarm/aitools-stack.yml` (separate Swarm stack) |
| **Swarm Stack** | `aitools` (4 services: anythingllm, librechat, librechat-mongodb, perplexica) |
| **Host Node** | `vmi3361598` (Contabo VPS, Docker 29.5.3) |
| **DNS** | Cloudflare A records, proxied, pointing to `13.140.161.244` |
| **LLM Backend** | OpenClaw API at `https://opencode.ai/zen/go/v1` (no auth required) |
| **Image Sizes** | AnythingLLM=4.78GB, LibreChat=3.83GB, Vane=13.1GB |
### AnythingLLM Setup
1. Visit https://anything.falahos.my
2. Create admin account on first login
3. Configure LLM provider: OpenAI-compatible → `https://opencode.ai/zen/go/v1`
4. Upload documents via drag-and-drop
5. Start asking questions against your knowledge base
### LibreChat Setup
1. Visit https://chat.falahos.my
2. Register first admin account
3. Configure endpoints for each agent:
- **OpenClaw**: `https://opencode.ai/zen/go/v1` (no key)
- **Odysseus**: (add via custom endpoint)
- **OpenHands**: (add via custom endpoint)
4. Supports: MCP tools, Code Interpreter, multi-model chat
### Perplexica Setup
1. Visit https://search.falahos.my
2. Configure LLM provider in settings
3. Start searching with source citations
### Initial Deployment Issues
| Issue | Cause | Resolution |
|-------|-------|------------|
| Synology Alpine VM kept breaking Swarm Raft | Docker 20.10.3 incompatible with Docker 29.x Raft consensus | Removed from Swarm. Only modern Docker nodes are managers |
| MongoDB exit 132 on Alpine VM | MongoDB 8.0+ requires AVX CPU instructions | Use `mongo:4.2` for older CPUs, or pin to Contabo node |
| AnythingLLM OOM on first start | 4.78GB app needs >1024M memory | Increased limit to 2048M |
| LibreChat crash on startup | Missing `JWT_SECRET` env var | Added `JWT_SECRET` to stack file |
| LibreChat Preplexica health checks killed containers | `wget` not available in Node images | Switched to `CMD node -e` for health checks |
Home.md
+7 -2
@@ -38,6 +38,7 @@ Welcome to the FalahOS wiki — infrastructure, architecture, design, and operat
## 🛠️ Infrastructure & Operations
- **[[AI-Tools-Stack]]** — Self-hosted AI productivity stack: AnythingLLM (RAG), Perplexica (search), LibreChat (multi-model chat + MCP agents) deployed on Docker Swarm
- **[[Infrastructure-Tool-Log]]** — Fleet-wide tool inventory: software, containers, services across all machines (Contabo, Synology, Mac Mini, MacBook Air, cPanel)
- **[[Falah-OS-Backend-QA-Gap-Analysis]]** — Comprehensive gap analysis of Falah OS backend: testing, pre-deploy, post-deployment, security, and infrastructure gaps. **Overall QA readiness: ~10%**
@@ -46,7 +47,8 @@ Welcome to the FalahOS wiki — infrastructure, architecture, design, and operat
| Page | Summary |
|------|---------|
| [[Home]] | You are here |
| [[Docker-Swarm-Architecture]] | Swarm nodes, services, traffic flow, standalone containers |
|| [[AI-Tools-Stack]] | Self-hosted AI tools: AnythingLLM, Perplexica, LibreChat on Docker Swarm |
|| [[Docker-Swarm-Architecture]] | Swarm nodes, services
| [[Architecture-Diagram]] | Mermaid + SVG + Excalidraw — full system nodes and connections |
| [[TOGAF-Architecture]] | TOGAF layer-by-layer + SVG + Excalidraw download |
| [[FalahOS-Team-Org-Chart]] | Team & agent org chart — founder, divisions, AI fleet, infrastructure |
@@ -70,7 +72,10 @@ Welcome to the FalahOS wiki — infrastructure, architecture, design, and operat
| **TOGAF SVG** | [FalahOS-TOGAF-Architecture.svg](./FalahOS-TOGAF-Architecture.svg) |
| **TOGAF Excalidraw** | [FalahOS-TOGAF-Architecture.excalidraw](./FalahOS-TOGAF-Architecture.excalidraw) |
| **Team Org SVG** | [FalahOS-Team-Org-Chart.svg](./FalahOS-Team-Org-Chart.svg) |
| **Team Org Excalidraw** | [FalahOS-Team-Org-Chart.excalidraw](./FalahOS-Team-Org-Chart.excalidraw) |
|| **Team Org Excalidraw** | [FalahOS-Team-Org-Chart.excalidraw](./FalahOS-Team-Org-Chart.excalidraw) |
|| **AnythingLLM** | https://anything.falahos.my |
|| **Perplexica (Search)** | https://search.falahos.my |
|| **LibreChat** | https://chat.falahos.my |
## 📊 Recent Audits