# Homelab/office — retained record

> Retained reddit record from reddit:homelab.

Canonical: https://highsignal.app/data/records/3317f8d65400cdab

[← sources](https://highsignal.app/data)


source: [reddit](https://highsignal.app/data/reddit) (reddit:homelab)  published 2026-10-21 11:35 ingested 2026-10-22 02:41

[original source ↗](https://www.reddit.com/r/homelab/comments/1xbkq2p/homelaboffice/)

## retained text



```
Just wanted to share my setup and ghetto "rack". Still working on looming everything and getting the underdesk runs nice and neat but I'm pretty happy where it's at. Running a K3s cluster focused on AI inference with AMD hardware for a fully declarative config. I currently have 2 machines in the cluster. 

Top of rack down:

HP ryzen sff(HQ)--- Cluster control plane, 32gb ddr4, recently added RX 9060, ubuntu 26, also used for 3d slicing or browsing when needed. 

Ryzen 7 5700G rig(NAS)--- 32gb ddr4, Intel arc b580, ZimaOS, shared volumes get used within the cluster for cold model storage. Using this rig for standard homelab services being served  (jellyfin, arr stack, etc.)(not in cluster) 

Bottom shelf:

\- Orico hardrive bay with 2x 8tb WD red that is connected to the NAS. 

\- HP elitebook running proxmox for pentest lab enviro(not in cluster)

\- Eero mesh router

Then the second "rack":

Cluster worker-Ryzen 3900x, RX 7900 xtx, 32gb DDR4, Ubuntu 26 server

This setup is the main inference workhorse running my Hermes instance(with a  Debian trixie sandbox for Hermes SSH backend) as well as llamacpp and whispercpp. I am actively hunting for a second 7900xtx for this machine. Currently running gemma4-26b-a4b at a average of 75 tok/s. 
Yes I know the ram is mismatched I had a stick fail and just added in another matched speed 16gb I had on hand.

The monitor you see running is from a unitfile I wrote to launch amdgpu\_top on tty2 so I can easily view GPU stats and the printer below is for my a daily newspaper I have Hermes write in HTML on a cron loop then print to be ready to read with my morning coffee. 

More coming soon hopefully.

Take a look at my cluster repo for a more detailed write up and all the yaml. I will be packaging my k3s stack into a helm chart sometime this week to make the process of setting this up be no more than a handful of commands. 

https://github.com/bnice00/k3s-Hermes-Llama

Just for extra: on the desk I have my macbook air a1466 running arch and my macbook air m4 which I use as my main development rig. 
```



document fetched 2026-10-22 00:39 · canonical https://reddit.com/r/homelab/comments/1xbkq2p/homelaboffice
