← sources

Is there something like NInfer but for 16GB cards?

source: reddit (reddit:LocalLLaMA)published 2026-09-19 12:31ingested 2026-09-20 02:38

retained text

I envy the NInfer, but I don't have a 5090 card, I have a 5060 TI :(  
I would like tonrun Qwen 3.8 Q3 at extreme speeds :(
NInfer: [https://github.com/Neroued/ninfer](https://github.com/Neroued/ninfer) 

document fetched 2026-09-20 00:37 · canonical https://reddit.com/r/LocalLLaMA/comments/1wkl0c6/is_there_something_like_ninfer_but_for_16gb_cards