← sources

Any AMD optimized engines?

source: reddit (reddit:LocalLLaMA)published 2026-10-23 17:10ingested 2026-10-24 02:40

retained text

There's been a lot of talk around the subreddit regarding specialized engines (e.g. Strata) that are either tuned to the model or to the GPU, however all the fun seems to be going on mostly with Nvidia hardware, are there any similar projects going on aimed to be optimized at consumer tier AMD hardware? 

I'm currently running Swift 1.5 GSQ RCO at about 40-45 TPS on my 7800xt, I'm pretty happy with the setup I have, I was just wondering if there's anyone playing with similar hardware and how much more is there to squeeze out of it.

Thanks in advance!

document fetched 2026-10-24 10:43 · canonical https://reddit.com/r/LocalLLaMA/comments/1xdjx4q/any_amd_optimized_engines