← sources

My local multi-node personal assistant setup (64 GB RAM cluster, 8 sub-agents & custom hardware integration)

source: reddit (reddit:selfhosted)published 2026-10-22 16:29ingested 2026-10-23 02:39

retained text

Hey everyone,  
I wanted to share my current architecture for a local-first, multi-node personal AI assistant ("Jarvis") that I've been building over the past few months.  
Instead of relying on cloud APIs or simple smart home routines, the goal was to build a fully self-hosted, agentic system running on hardware I had on hand, with zero cloud dependency for core tasks.

Hardware & Cluster Setup:  
Orchestrator Node: ASUS VivoBook (16GB RAM) running Linux/Ubuntu. Handles the primary routing and local 9B parameter LLM via Ollama.

Compute Nodes: 2x Fujitsu Esprimo D757 (32GB / 16GB RAM) acting as worker nodes for parallel sub-agent tasks and continuous background processing.

Peripherals & I/O: Grandstream GAC conference phone for multi-directional voice array capture, Sony Wi-Fi dashboard setup for visual status feeds, Sonoff Zigbee USB sticks for room telemetry, and Anycubic 3D printer integration for physical status notifications.

Agentic Architecture:  
The system uses a Hermes-based orchestrator model that dispatches tasks to specialized sub-agents:

1. System Agent: Node health, RAM/CPU allocation, and process management.
2. Tactical Agent: Fast execution of quick commands and local shell routines.
3. Voice Agent: STT/TTS pipeline integrated with the conference phone hardware.
4. Brain Agent: Long-term memory indexing and context retrieval via local vector storage.
5. Coder Agent: Development assistant executing local terminal workflows (Claude Code / Aider).
6. Recon Agent: Web research, scraping, and real-time page parsing for factual verification.
7. Hardware Agent: Interface for Zigbee sensors, microcontrollers, and IoT devices.

Integrations & Workflows:  
It hooks directly into local transit APIs (VBN) for live schedule updates, local calendar/mail feeds for morning briefs, and automated 3D printer status tracking.

Curious to hear how others here structure their setups! Are you running everything on a single beefy workstation, or moving towards distributed multi-node architectures with dedicated agent roles?

P.S. Since I couldn't find a dedicated space focused purely on technical, local-first personal AI builds and hardware integrations, I started [r/CustomAIAssistants](r/CustomAIAssistants). Feel free to join or share your own setup there if you're building something similar!

Edit: For voice detection, I am running openWakeWord combined with Whisper so Jarvis triggers as soon as it hears its name. It then analyzes the last two minutes of rolling transcriptions to determine whether it was actually being addressed and what action to take. I am also currently integrating it with OpenSCAD so Jarvis can generate 3D models directly via code and send them straight to my Anycubic printer through OctoPrint.

document fetched 2026-10-23 00:32 · canonical https://reddit.com/r/selfhosted/comments/1xcndl1/my_local_multinode_personal_assistant_setup_64_gb