← sources

Self hosted LLM Goals / possible?

source: reddit (reddit:selfhosted)published 2026-10-19 02:38ingested 2026-10-20 02:37

retained text

hello all! 

I have a project in mind that i want to try and figured i'd come here for some help to start out. 

  
I have a think center micro with very base specs:   
i5 or 7 processor (can't remember rn) 

8gb ram 

512 HDD   
windows 10 home 

  
i originally got it a while back to learn stuff about server things etc. haven't done much though. 

  
Realized that i really don't have much to be stored and looking into it i don't really want to store the few things i do have on a semi old HDD. 

  
anywho: 

My current goal is to get into a local llm that i can use. 

  
i know it can't be a massive one due to limitations, but i wanna start small with this device to learn then see if i want to upgrade it moving forward if i find it useful enough. 

  
the device is currently running as my exit node, and my mac has rustdesk on it so i can access it that way if needed. 

  
goals:   
1) LLM Locally 

2) ability to run llm from terminal on my mac (my guess is ssh over tailscale?)

3) ability to connect the llm to mcps of sorts (what're the implications here?) 

4) assuming i get this set up, is there any possible way to access it from my iphone? (also has tailscale on it) 



Thanks! 

document fetched 2026-10-20 00:30 · canonical https://reddit.com/r/selfhosted/comments/1x9ldb1/self_hosted_llm_goals_possible