← sources

What do I need to Run local LLM

source: reddit (reddit:homelab)published 2026-10-08 21:25ingested 2026-10-09 02:38

retained text

I am aware that running a local LLM like ollama requires a GPU or something like that, but my question is, what do I actually need? 

I’m looking for something that is a smaller form factor maybe something I can throw in a 10 inch rack, or something small like that. I’m not doing anything crazy just asking it to help format items and condense PDFs for the information I actually want vs the fluff. 

Recommendations? Really I just don’t want to put personal data into Claude. 

Thank you everyone 

document fetched 2026-10-09 00:39 · canonical https://reddit.com/r/homelab/comments/1x13az2/what_do_i_need_to_run_local_llm