Minimum amount of money for a local build to run 500Bish models at Q4 quant at decent speed (~20T/s)?
retained text
Trying to figure out what the options are for builds. I currently have 48GB VRAM through 2 3090s and 48GB DDR4 RAM but my current mobo only allows up to 128GB RAM. So I’m thinking about maybe trying the whole EYPC thing, but I don’t know. Thoughts?
document fetched 2026-10-27 00:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1xg05w1/minimum_amount_of_money_for_a_local_build_to_run