← sources

Model weight inferencing

source: reddit (reddit:LocalLLaMA)published 2026-10-02 06:20ingested 2026-10-03 02:41

retained text

I have 4050 6gb gpu, 24 gb ram which model should i choose to run i need speed. i try qwen 3.8 27b and feel too slow tried from onslot studio.   
I have heard of weight inferencing does it helpful what should i do to try weight inferencing.

document fetched 2026-10-03 00:41 · canonical https://reddit.com/r/LocalLLaMA/comments/1wvmggs/model_weight_inferencing