← sources

Looking for advice for small office looking for local AI RAG

source: reddit (reddit:LocalLLaMA)published 2026-09-14 14:53ingested 2026-09-15 02:40

retained text

My company is looking for basically a local hardware back-end for an already set up Open WebUI Windows AD joined setup. We are already on the frontier models thru Open WebUI. ~10 users. 

Workload is a lot of contract and chat based email stuff, generate contracts, generate quotes. We want a local back end so we can get our RAG data set going that we have been preparing. Not a huge library but maybe ~500 pdfs ready to be converted to .md mostly standards related to the field we work in (civil). Budget ~$5-6k

Are the GB10 Blackwell rigs still the best option now? Last we looked was about 6 months ago.

document fetched 2026-09-15 00:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1wg5mv3/looking_for_advice_for_small_office_looking_for