It ain't much, but it's honest work
retained text
My homelab, in my "rack" (an IKEA shoe cabinet lol). Highlights: * ZFS mirrored DAS for NFS/Samba * 4G WAN failover, Tailscale to beat CG-NAT * Cloudflare DDNS client * WireGuard full-mesh trunk for backchannel traffic (nginx upstream, NFS, MySQL, UPS) * WireGuard remote access on the router and Ubuntu servers * ProtonVPN egress pool for outbound API calls * UPS graceful shutdown via NUT * Three SSIDs on their own VLANs (main, IoT, guest): main reaches IoT, guests only the TV and speaker, IoT reaches only the internet * Custom mDNS/SSDP relay as a RouterOS container, so IoT announces only the services I allow (AirPlay, Cast, Sonos, Spotify Connect) * Out-of-band access: break-glass port, AP management VLAN * nftables default-drop, fail2ban, hardened containers * Mail alerts via Brevo, SPF/DKIM/DMARC enforced * Split-horizon DNS with DoH * Authelia SSO with 2FA, also an OIDC provider for my own apps **Gear** * MikroTik RB5009UG+S+IN * Lenovo ThinkCentre M920q (32 GB RAM, 256 GB NVMe, i5-8500T) * Lenovo ThinkCentre M920q (32 GB RAM, 256 GB NVMe, i5-8400T) * Lenovo ThinkCentre M70q Gen 1 (8 GB RAM, 256 GB NVMe, i3-10100T) * QNAP TR-002 with 2×16 TB WD Ultrastar HC550 * PowerWalker VI 1200 SH UPS * Ubiquiti U7 Pro Wall **What runs on it** * OS: Ubuntu 26.04 on all nodes, RouterOS 7 on the router * Storage: ZFS, Samba, NFS * Edge: nginx, Authelia, Let's Encrypt wildcard * Media: Plex (QSV) * Music: Resilio Sync, OneTagger (DJ library sync and tagging), custom audio file pipeline with Plex and Rekordbox integration * AI: Ollama + Open WebUI * Data: MySQL, private Docker registry * Network: WireGuard, Tailscale, gluetun + HAProxy, UniFi controller * Ops: Docker, Cockpit, NUT, fail2ban, msmtp, Diun * Other: SearXNG, ntfy, Plausible, Mosquitto **How I run it** * Claude Code on every host, inside tmux so sessions survive dropped SSH * Shared git docs repo that every host pulls, so the agent knows the lab * My own zsh wrapper for multiple Claude profiles and accounts, useful when you exhaust your quota and chain multiple Max 20x/Ultra subscriptions. * I built a PWA to start or resume Claude Code sessions on any host, very nice when on the go **Challenges / things I wasn't sure about** * **ZFS over USB:** The usual advice is "don't." My TR-002 is USB BOT only, no UASP. Slower, but BOT sends one command at a time, and the USB horror stories are mostly about UASP. I ran a multi-day soak test (\~4 TB, zero errors) before trusting it with real data. Scrubs run at \~110 MB/s. * **USB boot race:** The DAS takes \~13 s to show up on cold boot, so ZFS tried to import before the disks existed. Fixed by making the import wait for udev. * **Slow writes on the DAS:** Large Docker registry pushes (\~700 MB layers) time out. An SSD tier between NVMe and the DAS is next. * **Docker bypasses the host firewall:** Published ports skip INPUT, so a default-drop nftables policy doesn't protect them. I bind containers to localhost or the WireGuard trunk, and anything else is gated explicitly. * **':rshared' on NFS binds:** Mounts leaked back into the host and doubled on every container recreate. I hit \~42k mounts and Docker froze. Switched to ':rslave'. * **CG-NAT on 4G failover:** Inbound traffic dies, and DDNS would happily publish an unreachable IP. The DDNS client now checks the router and pauses during failover. Tailscale covers my own access. * **Casting across VLANs:** RouterOS only reflects mDNS without filtering and has no SSDP relay. I wrote a small relay in Go that runs as a container on the router. It forwards only allowlisted services, so AirPlay, Cast and Spotify Connect work from main and guest without opening IoT up. Next up: more RAM for the M70q, then a dedicated LLM box, but only when my wallet allows for it :(
document fetched 2026-11-10 00:35 · canonical https://reddit.com/r/homelab/comments/1xrt8h7/it_aint_much_but_its_honest_work