Best direction to go for my setup EPYC 32core + 512GB DDR4 + 44GB GPU ?
retained text
Just looking for some advice on what is possble with my setup and speeds I should be gettingI know it won't be super fast tps but I was more after getting the bigger models to run. This is my spec: Epyc 7502p - 32 Core Gigabyte MZ32-AR0 - 8 channel memory 512GB DDR4 1x 4070 12GB 2x 4060 16GB quite a few implementations I see which can be confusing. Is this build even useful now? that we have Project Maya which you can stream from the NVME drive? Anyone have similar setups and what to expect, what software best to use
document fetched 2026-11-16 00:37 · canonical https://reddit.com/r/LocalLLaMA/comments/1xx6dpd/best_direction_to_go_for_my_setup_epyc_32core