Is there something like NInfer but for 16GB cards?
retained text
I envy the NInfer, but I don't have a 5090 card, I have a 5060 TI :( I would like tonrun Qwen 3.8 Q3 at extreme speeds :( NInfer: [https://github.com/Neroued/ninfer](https://github.com/Neroued/ninfer)
document fetched 2026-09-20 00:37 · canonical https://reddit.com/r/LocalLLaMA/comments/1wkl0c6/is_there_something_like_ninfer_but_for_16gb_cards