From 56c2a0aa3e5301dbb396b9df42c5063aadb4f03b Mon Sep 17 00:00:00 2001 From: WMJ Ismail Date: Wed, 8 Jul 2026 10:22:58 +0200 Subject: [PATCH] AI-Tools-Stack: add AnythingLLM, Perplexica, LibreChat deployment docs --- AI-Tools-Stack.md | 54 +++++++++++++++++++++++++++++++++++++++++++++++ Home.md | 9 ++++++-- 2 files changed, 61 insertions(+), 2 deletions(-) create mode 100644 AI-Tools-Stack.md diff --git a/AI-Tools-Stack.md b/AI-Tools-Stack.md new file mode 100644 index 0000000..b1844e0 --- /dev/null +++ b/AI-Tools-Stack.md @@ -0,0 +1,54 @@ +## 🔧 AI Tools Stack + +Self-hosted AI productivity tools deployed on Docker Swarm (Contabo VPS). All tools use **OpenClaw API** (`https://opencode.ai/zen/go/v1`) as the LLM backend — no external API keys needed. + +| Tool | URL | Status | Purpose | +|------|-----|--------|---------| +| **AnythingLLM** | https://anything.falahos.my | ✅ Running | Document RAG — upload wikis, SOPs, manuals, query with AI | +| **LibreChat** | https://chat.falahos.my | ✅ Running | Multi-model chat with MCP agents — can interface with Odysseus, OpenClaw, OpenHands | +| **Perplexica (Vane)** | https://search.falahos.my | 🟡 Starting | AI-powered search engine — self-hosted Perplexity alternative | + +### Infrastructure + +| Component | Detail | +|-----------|--------| +| **Deployment** | `/opt/falah-os/swarm/aitools-stack.yml` (separate Swarm stack) | +| **Swarm Stack** | `aitools` (4 services: anythingllm, librechat, librechat-mongodb, perplexica) | +| **Host Node** | `vmi3361598` (Contabo VPS, Docker 29.5.3) | +| **DNS** | Cloudflare A records, proxied, pointing to `13.140.161.244` | +| **LLM Backend** | OpenClaw API at `https://opencode.ai/zen/go/v1` (no auth required) | +| **Image Sizes** | AnythingLLM=4.78GB, LibreChat=3.83GB, Vane=13.1GB | + +### AnythingLLM Setup + +1. Visit https://anything.falahos.my +2. Create admin account on first login +3. Configure LLM provider: OpenAI-compatible → `https://opencode.ai/zen/go/v1` +4. Upload documents via drag-and-drop +5. Start asking questions against your knowledge base + +### LibreChat Setup + +1. Visit https://chat.falahos.my +2. Register first admin account +3. Configure endpoints for each agent: + - **OpenClaw**: `https://opencode.ai/zen/go/v1` (no key) + - **Odysseus**: (add via custom endpoint) + - **OpenHands**: (add via custom endpoint) +4. Supports: MCP tools, Code Interpreter, multi-model chat + +### Perplexica Setup + +1. Visit https://search.falahos.my +2. Configure LLM provider in settings +3. Start searching with source citations + +### Initial Deployment Issues + +| Issue | Cause | Resolution | +|-------|-------|------------| +| Synology Alpine VM kept breaking Swarm Raft | Docker 20.10.3 incompatible with Docker 29.x Raft consensus | Removed from Swarm. Only modern Docker nodes are managers | +| MongoDB exit 132 on Alpine VM | MongoDB 8.0+ requires AVX CPU instructions | Use `mongo:4.2` for older CPUs, or pin to Contabo node | +| AnythingLLM OOM on first start | 4.78GB app needs >1024M memory | Increased limit to 2048M | +| LibreChat crash on startup | Missing `JWT_SECRET` env var | Added `JWT_SECRET` to stack file | +| LibreChat Preplexica health checks killed containers | `wget` not available in Node images | Switched to `CMD node -e` for health checks | diff --git a/Home.md b/Home.md index 559de69..9c69ba0 100644 --- a/Home.md +++ b/Home.md @@ -38,6 +38,7 @@ Welcome to the FalahOS wiki — infrastructure, architecture, design, and operat ## 🛠️ Infrastructure & Operations +- **[[AI-Tools-Stack]]** — Self-hosted AI productivity stack: AnythingLLM (RAG), Perplexica (search), LibreChat (multi-model chat + MCP agents) deployed on Docker Swarm - **[[Infrastructure-Tool-Log]]** — Fleet-wide tool inventory: software, containers, services across all machines (Contabo, Synology, Mac Mini, MacBook Air, cPanel) - **[[Falah-OS-Backend-QA-Gap-Analysis]]** — Comprehensive gap analysis of Falah OS backend: testing, pre-deploy, post-deployment, security, and infrastructure gaps. **Overall QA readiness: ~10%** @@ -46,7 +47,8 @@ Welcome to the FalahOS wiki — infrastructure, architecture, design, and operat | Page | Summary | |------|---------| | [[Home]] | You are here | -| [[Docker-Swarm-Architecture]] | Swarm nodes, services, traffic flow, standalone containers | +|| [[AI-Tools-Stack]] | Self-hosted AI tools: AnythingLLM, Perplexica, LibreChat on Docker Swarm | +|| [[Docker-Swarm-Architecture]] | Swarm nodes, services | [[Architecture-Diagram]] | Mermaid + SVG + Excalidraw — full system nodes and connections | | [[TOGAF-Architecture]] | TOGAF layer-by-layer + SVG + Excalidraw download | | [[FalahOS-Team-Org-Chart]] | Team & agent org chart — founder, divisions, AI fleet, infrastructure | @@ -70,7 +72,10 @@ Welcome to the FalahOS wiki — infrastructure, architecture, design, and operat | **TOGAF SVG** | [FalahOS-TOGAF-Architecture.svg](./FalahOS-TOGAF-Architecture.svg) | | **TOGAF Excalidraw** | [FalahOS-TOGAF-Architecture.excalidraw](./FalahOS-TOGAF-Architecture.excalidraw) | | **Team Org SVG** | [FalahOS-Team-Org-Chart.svg](./FalahOS-Team-Org-Chart.svg) | -| **Team Org Excalidraw** | [FalahOS-Team-Org-Chart.excalidraw](./FalahOS-Team-Org-Chart.excalidraw) | +|| **Team Org Excalidraw** | [FalahOS-Team-Org-Chart.excalidraw](./FalahOS-Team-Org-Chart.excalidraw) | +|| **AnythingLLM** | https://anything.falahos.my | +|| **Perplexica (Search)** | https://search.falahos.my | +|| **LibreChat** | https://chat.falahos.my | ## 📊 Recent Audits